Can I use a wireless Linksys router to create a wired network?

On the backside of my linksys wireless router there are 4 slots to plug in network cables. Can I connect a PC by plugging a cable into the wireless router? (and create a wired network instead of wireless) The wireless signal my PC picks up doesn't seem to be constant.