Originally Posted by arnyk
Ten (10) Requirements For Sensitive and Reliable Listening Tests
(1) Program material must include critical passages that enable audible differences to be most easily heard.
Wholeheartedly agree. So can you please repost your blind experiences with cables, amps, etc. and let's examine how this was achieved?
(2) Listeners must be sensitized to a audible differences, so that if an audible difference is generated by the equipment, the listener will notice it and have a useful reaction to it.
Again, fully agree. Evidence of this would be very useful too
(3) Listeners must be trained to listen systematically so that audible problems are heard.
Right on brother
(4) Procedures should be "open" to detecting problems that aren't necessarily technically well-understood or even expected, at this time. A classic problem with measurements and some listening tests is that each one focuses on one or only a few problems, allowing others to escape notice.
Another good one.
(5) We must have confidence that the Unit Under Test (UUT) is representative of the kind of equipment it represents. In other words the UUT must not be broken, it must not be appreciably modified in some secret way, and must not be the wrong make or model, among other things.
Goes without saying.
(6) A suitable listening environment must be provided. It can't be too dull, too bright, too noisy, too reverberant, or too harsh. The speakers and other components have to be sufficiently free from distortion, the room must be noise-free, etc..
I like to use headphones for this reason if we are not dealing with speakers/room. They allow me to listen at very elevated levels. For equipment I get the most transparent and distortion free that I can get.
(7) Listeners need to be in a good mood for listening, in good physical condition (no blocked-up ears!), and be well-trained for hearing deficiencies in the reproduced sound.
Yeh, I try to not do the listening test after being on AVS Forum in one of these threads.
Seriously, the heated arguments is what prompts me often to actually go and conduct such tests to get more data.
(8) Sample volume levels need to be matched to each other or else the listeners will perceive differences that are simply due to volume differences.
You tell them Arny.
(9) Non-audible influences need to be controlled so that the listener reaches his conclusions due to "Just listening".
(10) Listeners should control as many of the aspects of the listening test as possible. Self-controlled tests usually facilitate this. Most importantly, they should be able to switch among the alternatives at times of their choosing. The switchover should be as instantaneous and non-disruptive as possible.
Absolutely essential. Testing becomes harder when someone else controls the switching.
I may have missed something but I think my watermark example that I gave complied with all of this.