Mike, what is the router model?
Chances are you will have to visit the "routers website" and login with an administrator password.
Assuming this is windows..?
Click the Start Button > Run > 'cmd' > press enter. Command prompt will come up.
Type 'ipconfig' and look for the "Default Gateway ........ 192.168.x.x"
Open up your favorite web browser and head to
http://192.168.x.x (replaces x's with your gateway #'s).
If your lucky you'll see a Linksys login screen and if you know your password (likely "admin" if you've never changed it)... From there you'd want to see the DHCP settings, turn them off and then set the IP addresses manually which are bound to the MAC addresses of your NIC cards.
If you report back with your model # I can google and see if we can't find some online tutorials about the Linksys admin website and what you need to do.