The router should always show up in the list of wireless signals whether or not the DHCP server has reached the max number of IP addresses to dish out. Even if it has no more to give out, it should not disconnect existing connections in order to accommodate new ones.

What is the make and model (and revision where applicable) of your wireless router?