Believe me, I know all about tons of wires coming into the rack. When I had my component video matrix distribution set up with all of the source components and the whole-house audio system, I probably had close to 300 wires homerun into the rack when you include automation, network, triggers, etc. Throw in all the interconnect wires and the whole thing was packed. Here's a couple of pics when I was in the middle of wiring the rack:
Three dual-tuner cable DVRs and Lexicon 7-channel amplifier:
One of three Niles SI-1230 multi-zone amplifiers:
Perhaps my question above wasn't clear. With as many in-wall and in-ceiling speakers as you have, I'm surprised that the patch panel for the speaker wires is the direction you are taking. I get it for networking, phone and the other stuff....but with consolidating the speakers to a patch panel, doesn't this confine your system to being multi-room and not multi-zone? In other words, the benefit of having a speaker patch panel outside the rack puts a pretty big limitation on the distributed audio system, doesn't it? To say it another way, with the patch panel, if you put your system into "Party" mode where only selected speakers are on, won't ALL of your speakers connected to this patch panel be on and not just the ones you want? Am I missing a piece of equipment that you have which I am not seeing, like a Control4 audio matrix switch?