Essentially what you're describing is using the 2nd router (router A) as a switch rather than a router. You can do that if you do not have a separate switch available, you just need to make sure to turn off router A's DHCP and set it's LAN IP address to a free IP within your LAN's range.  Essentially the configuration is the same as post #13 without configuring any wireless.