I'm just going to copy and paste my own comments from one of the other times this came up.
The RGB full/limited settings are poorly described. It should be labeled as PC levels (0 to 255) and video levels (16 to 235)
The PS3 simply remaps the values depending on the setting (for gaming, the RGB setting is completely ignored for movies)
A calibrated tv expecting video levels and receiving video levels from a PS3 will look the same as a calibrated tv expecting PC levels and receiving PC levels from the PS3.
If you are using a tv though even if it accepts PC levels you would be better off using limited and calibrating accordingly. Otherwise if you use your display for movies or tv your display will be calibrated for PC levels and everything would be off unless you kept a separate set of settings and constantly switched between them.
If you mix and match your settings you will end up with crushed blacks and other color inaccuracies. Your settings should be limited, superwhite on, and under BD / DVD Video Output Format (HDMI) you should take it out of auto and set it manually to Y Pb / Cb Pr
The manual setting in conjunction with superwhite on is the only way to get it to pass WTW and BTB due to a bug that I'm not sure if it was ever fixed. Blu-ray is natively YCC anyway and this is the reason for movies the PS3 ignores any limited or full settings so there is no reason not to manually be set to YCC in the first place.
So in short. RGB is meaningless when it comes to blu-ray movies as it is completely ignored by the PS3.
For gaming you can achieve results in both PC output and video output however if you calibrate for PC levels you will have to make sure you have a separate setting for movies and tv viewing on your display (if you use your display for that)
Lastly all of this is a moot point if you are using some out of the box setting like standard or vivid (torch mode) because you have inaccuracies all over the place anyway.