How do I make this work?

For this to work easily, *all* TVs must be 3D capable. Either that or you have to start spoofing the EDID to fake 3D compatibility. The example below has the ability to spoof the EDID (and appears to be customizable over its USB port - I hadn't seen that before).

The one thing I don't see in your list is an AVR. You're going through a lot of expense to send the audio output through the very small speakers in today's TVs.

Using something like this should work. I show this as an example since there is more than one manufacturer out there. Before you look, remember HDMI is not cheap.

http://www.octavainc.com/HDMI%20Ethe...tch%204x4.html

Don't forget to also think about how you are going to control all this. Having to go into another room to change the channel gets old quickly. You may also find that competing for the DirecTV receiver means a second receiver is needed (in which case a 4x4 matrix won't work).

.
Run HDMI only to the 3D TV. Run component to the other TVs. Make sure to get an older Blu-Ray player so that component can output 1080i (anything made before 2011). You won't notice the difference on the DirecTV. Blu-Ray you probably won't either if you have decent TVs or small enough TVs.

And, you'll save a bunch of money.

You'll need a 4x1 HDMI switcher (somthing like this: http://www.monoprice.com/products/pr...seq=1&format=2) and a 4x2 component video/audio switcher (something like this: http://www.hdtvsupply.com/4to2covimasw.html). You would also need an HDMI run to the TV and two component video/audio runs to the other TVs. Where does the AVR go (I'm assuming with the 3D TV)?

Do you have a remote control method? The DirecTV box has an RF option. However, PS3 uses Bluetooth for the remote and that is more difficult (but can solved with money). My experience has been that for an easy-to-use multiroom system, you'll spend at least as much on the remote control setup as the video switching.

As to your question, yes you could do that. It would mean that you would have to plug your 3D source directly to the TV. Make sure you plug-in carefully since you don't want damage your in-wall cable. This would mean you would have an HDMI cables in the wall rather than Cat 6, if I followed your question correctly. Otherwise you'll still need to convert to Cat 6, which will add some money.