Phase buttons are pretty crude tools compared to the time delay options that many AVRs have.
Have you done any reliable acoustic measurements on this system, say with a measurement microphone, and software tools like Room Eq Wizard (freeware)?
No I haven't. I didn't realize that there is free software to do this, I will definitely try this.
And yes, the phase button is probably just polarity.