Originally Posted by audioguy
As you and I discussed, when I did the $2500 vs $25,000 processor blind test (Marantz vs Datasat), PERFECTLY level matched (no room EQ enabled), no one was able to pick the "higher priced spread" consistently. But, as I also noted, by accident, we had one of the processors set at 1/2dB louder, and it was elected 100% of the time.
As for perfectly level matching post room EQ, I think you will find that close to impossible. As I have stated ad nauseam, what you are really going to be testing is one room EQ solution vs another. This assumes that you will not be using amplification within the processor to drive speakers. THAT would not be a good idea.
Lastly, the only way this comparison will be 100% reliable, will be if the person who does the room calibration is an expert on which ever device they are calibrating. And this is particularly important as you look at both Dirac and Trinnov's Optimizer, since there are so many capabilities/options/features that can be employed during the calibration process. If this approach is not employed, you are no longer comparing processors or even room EQ software but rather the skill of the one who did the calibration.
You may want to reach out to some possible candidates for performing the calibration work. I would trust Mark Seaton and Adam Pelz for any of the products.
I had never run across your thread on the $2500 vs $25,000 processor blind test (Marantz vs Datasat) that you had run. Your results are exactly what the group I was with determined in similar testing.
After your identical findings, I completely agree about everything boiling down to the room correction system and calibration expertise to allow for comparison of the system. The real challenge is that I can't imagine how to wire a full blown ATMOS system to do instant, blind A/B testing.
As I think @Marc Alexander
intoned, for movies, games, TV - it will likely be very difficult to discern or quantify any sonic differences between any room correction system if the calibration was done well. Critical music listening is where I think the differences are more likely to be heard.
Following this line of thinking for my use (movies, games, TV), the money I'm considering to use for a Trinnov would likely be better spent on potentially upgrading my speakers. I've got a full ATMOS system using the 2000ish Kef Reference 201, 202, 203 series. My curiosity then becomes whether a JBL M2 or Revel Ultima system would make a clearly noticeable improvement in sound quality in my room. I love what I have but like everyone on this thread, I'm always striving to improve my system but am rapidly approaching the logarithmic curve of very small gains for very large capital investments.
Has has anyone gone from the Kef References to the M2s or Ultimas? If so, was it a "WOW!" type of change?