You did the ones on the left of the panel? That is a common problem. They're a bugger to get aligned but you haven't broken anything, just unplug them and line them up perfectly. When you plug the connector in, you'll feel a little "click" when you plug it in if you got it right. Of course, power must be off while doing this.
Your connectors of interest run along the bottom of the panel, not the side.