Validty of blind testing - Page 12 - AVS Forum
Forum Jump: 
Closed Thread
 
Thread Tools
post #331 of 355 Old 02-06-2014, 11:59 AM
AVS Addicted Member
 
Ratman's Avatar
 
Join Date: May 2002
Location: Collingswood, N.J.
Posts: 14,307
Mentioned: 1 Post(s)
Tagged: 0 Thread(s)
Quoted: 93 Post(s)
Liked: 260
I hope the OP got the info he was seeking.
Ratman is offline  
Sponsored Links
Advertisement
 
post #332 of 355 Old 02-06-2014, 12:03 PM
AVS Addicted Member
 
arnyk's Avatar
 
Join Date: Oct 2002
Location: Grosse Pointe Woods, MI
Posts: 13,909
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 457 Post(s)
Liked: 1068
Quote:
Originally Posted by amirm View Post

Quote:
Originally Posted by arnyk View Post

Please provide us with documentation on an equal level with that which I have already provided such as an article in a well-known audio publication (HFN&RR), professional journal (JAES), on a web site (www.pcabx.com)., or even just in this thread.

Currrent score: Arny 4, Amir 0.
That link doesn't work Arny.

Of course not as a direct link.

I told you earlier that you could find it on the Wayback machine.

I guess that means that you can't find the Clark AES aritcle, either. :-(
arnyk is offline  
post #333 of 355 Old 02-06-2014, 12:04 PM
Super Moderator
 
markrubin's Avatar
 
Join Date: May 2001
Location: Jersey Shore
Posts: 22,719
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 43 Post(s)
Liked: 286
Quote:
Originally Posted by Ratman View Post

I hope the OP got the info he was seeking.

I think the OP got exactly what he was expecting...and then some

are we done here yet? I think so...considering the number of reports received...

Please take the high road in every post
Please do not quote or respond to problematic posts: report them to mods to handle
markrubin is offline  
post #334 of 355 Old 02-06-2014, 12:08 PM - Thread Starter
 
goneten's Avatar
 
Join Date: Dec 2002
Location: South Africa
Posts: 3,681
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
Liked: 17
Quote:
Originally Posted by Ratman View Post

I hope the OP got the info he was seeking.

I wanted to know if the citations made in my initial opening post were at all valid. It appears not. I did not expect this discussion to drag on to 12 pages, but any discussion on this is appreciated, so don't stop on my account.

At least I offered some excellent entertainment via AVforums. biggrin.gif
goneten is offline  
post #335 of 355 Old 02-06-2014, 12:10 PM
AVS Special Member
 
Ethan Winer's Avatar
 
Join Date: Apr 2003
Location: New Milford, CT, USA
Posts: 5,747
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 7 Post(s)
Liked: 131
Quote:
Originally Posted by jim19611961 View Post

Perhaps you would have more luck if you offered to do the testing at their place, rather than at yours.

In fact, I always offer to visit them, up to a 2-hour drive away. I do this because if they come to my home and can't tell which [whatever] is which, they'll claim my system isn't "revealing" enough as an excuse.

--Ethan

RealTraps - The acoustic treatment experts
Ethan's Audio Expert book

Ethan Winer is offline  
post #336 of 355 Old 02-06-2014, 12:25 PM
AVS Addicted Member
 
arnyk's Avatar
 
Join Date: Oct 2002
Location: Grosse Pointe Woods, MI
Posts: 13,909
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 457 Post(s)
Liked: 1068
Quote:
Originally Posted by markrubin View Post

Quote:
Originally Posted by Ratman View Post

I hope the OP got the info he was seeking.

I think the OP got exactly what he was expecting...and then some

Only if he got some help with that forum in Zanzibar.

Quote:
are we done here yet? I think so...considering the number of reports received...

Yup, no surprises.
arnyk is offline  
post #337 of 355 Old 02-06-2014, 12:26 PM
AVS Special Member
 
CharlesJ's Avatar
 
Join Date: Jan 2006
Posts: 3,135
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 43 Post(s)
Liked: 89
Quote:
Originally Posted by Ethan Winer View Post

In fact, I always offer to visit them, up to a 2-hour drive away. I do this because if they come to my home and can't tell which [whatever] is which, they'll claim my system isn't "revealing" enough as an excuse.

--Ethan
Exactly how most are done at their homes. The Zipser test was at his house in Florida. Nousaine traveled lots of places to do those tests. The test Chris performed or try to, and posted to AVS, was at Mike's custom built listening room.
CharlesJ is offline  
post #338 of 355 Old 02-06-2014, 12:39 PM - Thread Starter
 
goneten's Avatar
 
Join Date: Dec 2002
Location: South Africa
Posts: 3,681
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 0 Post(s)
Liked: 17
Quote:
Originally Posted by arnyk View Post

Only if he got some help with that forum in Zanzibar.
Yup, no surprises.

Who cares? You don't even bother answering my PMs. rolleyes.gif It is South Africa, not Zanzibar.
goneten is offline  
post #339 of 355 Old 02-06-2014, 12:42 PM
FMW
AVS Special Member
 
FMW's Avatar
 
Join Date: Jun 2007
Posts: 4,594
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 150 Post(s)
Liked: 658
Quote:
Originally Posted by markrubin View Post

I think the OP got exactly what he was expecting...and then some

are we done here yet? I think so...considering the number of reports received...

it is a lively debate. what do you have against it?
FMW is offline  
post #340 of 355 Old 02-06-2014, 12:44 PM
AVS Addicted Member
 
arnyk's Avatar
 
Join Date: Oct 2002
Location: Grosse Pointe Woods, MI
Posts: 13,909
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 457 Post(s)
Liked: 1068
Quote:
Originally Posted by goneten View Post

Quote:
Originally Posted by arnyk View Post

Only if he got some help with that forum in Zanzibar.
Yup, no surprises.

Who cares? You don't even bother answering my PMs. rolleyes.gif It is South Africa, not Zanzibar.

I only answer emails asking new questions. I already answered you once about that forum.
arnyk is offline  
post #341 of 355 Old 02-06-2014, 01:10 PM
AVS Addicted Member
 
Chu Gai's Avatar
 
Join Date: Sep 2002
Location: NYC area
Posts: 14,739
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 130 Post(s)
Liked: 430
Quote:
Originally Posted by goneten View Post

Quote:
Originally Posted by arnyk View Post

Only if he got some help with that forum in Zanzibar.
Yup, no surprises.

Who cares? You don't even bother answering my PMs. rolleyes.gif It is South Africa, not Zanzibar.
And you don't sing me love songs, you don't send me flowers anymore.

"I've found that when you want to know the truth about someone that someone is probably the last person you should ask." - Gregory House
Chu Gai is online now  
post #342 of 355 Old 02-06-2014, 01:39 PM
AVS Special Member
 
Jack D Ripper's Avatar
 
Join Date: Jan 2014
Location: Burpelson Air Force Base
Posts: 1,136
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 4 Post(s)
Liked: 257
Quote:
Originally Posted by David James View Post

Just so I'm clear. Is it really being suggested that when taking a DBT, our brain could subconsciously push us towards not hearing a difference?

 

 

Quote:
Originally Posted by David James View Post
 
Quote:
Originally Posted by amirm View Post

Absolutely.
 
Quote:
Originally Posted by RobertR View Post

Suggested in post #277, yes. Backed up by any evidence, no.

Thanks. I guess I'm not surprised, that's a variety of the same technique used by masters of all types of belief related "woo".

So basically it's the same tactic used by anti-science folks everywhere. Rather then provide positive proof of their position, they attempt to shoot holes in the science which disputes their beliefs. Somehow they think by succeeding it some how means their belief is true. Of course even if they were to successfully refute the science, the burden of proof still lye's with them.

 

Maybe some drug company ought to complain about the tests of their products, being blind, interfering with the efficacy of their drugs.


God willing, we will prevail in peace and freedom from fear and in true health through the purity and essence of our natural fluids. God bless you all.
Jack D Ripper is offline  
post #343 of 355 Old 02-06-2014, 01:48 PM
AVS Special Member
 
krabapple's Avatar
 
Join Date: Apr 2003
Location: in a state bordered by Kentucky and Maine
Posts: 5,248
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 89 Post(s)
Liked: 155
Quote:
Originally Posted by CharlesJ View Post

But that implies that sighted testing is accurate to some degree, no? And DBT is just more accurate.

To this degree only: a person can establish themselves as a more reliable difference-detector than average , i.e., a true 'golden ear'. This for example is the basis fo Harman's 'trained listener' subject pool.

It means their 'guesses' at differences are more likely to be correct than the average listener's.

It doesn't give them a free pass to act as if every difference they claim to hear, must be real (certain sound engineers I can name act this way....as do virtually all audiophile reviewes a.g. Mikey Fremer, who I don't doubt has good discriminating ears)

And typically none of 'us' know, on this side of the computer if 'they', on that side, are really 'trained' listeners. They can claim to be such. Plenty of audiophile claim to have golden ears...I won't necessarily believe them, without some supporting evidence like, I happen to know for a fact that they've taken listener training, or.... they show me trustworthy DBT results. wink.gif

Even then, if the claim is really extraordinary, trained listener or not, skepticism is the more rational response absent blind test and measurement results.
krabapple is offline  
post #344 of 355 Old 02-06-2014, 01:54 PM
AVS Addicted Member
 
Ratman's Avatar
 
Join Date: May 2002
Location: Collingswood, N.J.
Posts: 14,307
Mentioned: 1 Post(s)
Tagged: 0 Thread(s)
Quoted: 93 Post(s)
Liked: 260
If I challenged you to a "triple blind test", that would be like a triple dog dare and you'd have to put your tongue on the cold flagpole. tongue.gif
Ratman is offline  
post #345 of 355 Old 02-06-2014, 02:00 PM
Advanced Member
 
Phil17108's Avatar
 
Join Date: Feb 2012
Location: Orange County California
Posts: 920
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 2 Post(s)
Liked: 53
I think this thread has out lived its stay, say good night mrs calabashes.
Phil17108 is online now  
post #346 of 355 Old 02-06-2014, 02:19 PM
AVS Special Member
 
krabapple's Avatar
 
Join Date: Apr 2003
Location: in a state bordered by Kentucky and Maine
Posts: 5,248
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 89 Post(s)
Liked: 155
Quote:
Originally Posted by Ethan Winer View Post

In fact, I always offer to visit them, up to a 2-hour drive away. I do this because if they come to my home and can't tell which [whatever] is which, they'll claim my system isn't "revealing" enough as an excuse.

--Ethan

Nousaine used to do the same: take the test to the claimant. And some here at AVSF did it for Mike Lavigne. Anyone tired of this thread but wanting more -- and wanting an example of how human nature can deny, deny, deny what it doesn't want to be true -- should go look up *that* episode.

EDIT: got the name wrong...corrected now.

And here's the thread part I and II

http://www.avsforum.com/t/918365/james-randi-s-attack-on-high-performance-audio/0_100

http://www.avsforum.com/t/941184/observations-of-a-controlled-cable-test/0_100
krabapple is offline  
post #347 of 355 Old 02-06-2014, 02:32 PM
AVS Special Member
 
JHAz's Avatar
 
Join Date: Mar 2009
Posts: 3,856
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 36 Post(s)
Liked: 148
Quote:
Originally Posted by krabapple View Post

I expect any page now we'll be down to debating whether cause and effect are real or an illusion.

they result from the observer's interference, of course.

And since time may be a mental construct not corresponding to an actual dimension of any n-dimensional universe, cause and effect lose their meaning ('cause the cause cannot be shown to precede the effect)

WHEEE!
JHAz is online now  
post #348 of 355 Old 02-06-2014, 03:03 PM
AVS Special Member
 
krabapple's Avatar
 
Join Date: Apr 2003
Location: in a state bordered by Kentucky and Maine
Posts: 5,248
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 89 Post(s)
Liked: 155
Classic example of audiophile hoo-hah here, trying to explain away inconvenient DBT results:

http://www.avsforum.com/t/941184/observations-of-a-controlled-cable-test/0_100#post_12265204
Quote:
Don't be discouraged by the results, many of these kinds of listening tests are amazingly INSENSITIVE to subtle sonic differences, and the fact that you thought that you were hearing things under the sighted informal sessions before the formal session really doesn't mean much, the formal portion literally changes the way your brain works and 'analyzes' the music. Thus, you may have been hearing what you thought you heard during the initial sighted sessions, and then later, you literally could no longer do so, your brain was running in a different mode than it was at first!

but later, a response from some authority on the *validity of blind testing*.

http://www.avsforum.com/t/941184/observations-of-a-controlled-cable-test/100_100#post_12271345

and requirements for a highest-sensitvity DBT

http://www.avsforum.com/t/941184/observations-of-a-controlled-cable-test/300_100#post_12671960

Quote:
If you really want highest sensitivity, first you have to train the listeners. Train, train, train, and give them full knowledge.

Then let them try DB trials, with feedback (i.e right vs. wrong ID). Allow them to do open trials for practice (but not for test results, obviously). Always ID the two test conditions even in the blind trials, only blinding the choice of 'X' in the ABX test.

All trials have to be clicklessly switched at the listener's demand with low latency.

This is what test after test has shown to provide the absolute most sensitivity to very small changes in auditory stimulii.

Any of this looking familiar, nvidio?
krabapple is offline  
post #349 of 355 Old 02-06-2014, 06:09 PM
AVS Addicted Member
 
Chu Gai's Avatar
 
Join Date: Sep 2002
Location: NYC area
Posts: 14,739
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 130 Post(s)
Liked: 430
Sounds like the stress defense to me, Krab.

"I've found that when you want to know the truth about someone that someone is probably the last person you should ask." - Gregory House
Chu Gai is online now  
post #350 of 355 Old 02-06-2014, 09:56 PM
AVS Special Member
 
krabapple's Avatar
 
Join Date: Apr 2003
Location: in a state bordered by Kentucky and Maine
Posts: 5,248
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 89 Post(s)
Liked: 155
Quote:
Originally Posted by Chu Gai View Post

Sounds like the stress defense to me, Krab.

Jon Risch's babble about formal and informal brain modes? Yeah. JJ shut him down pretty well in the response I linked to.
krabapple is offline  
post #351 of 355 Old 02-07-2014, 03:22 AM
AVS Special Member
 
tubetwister's Avatar
 
Join Date: Feb 2013
Location: Sacramento delta N. Cal. US Don't trust any air I can't see ☺
Posts: 2,220
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 237 Post(s)
Liked: 309
Quote:
Quote:
Originally Posted by amirm View Post

Quote:
Originally Posted by arnyk View Post

Please provide us with documentation on an equal level with that which I have already provided such as an article in a well-known audio publication (HFN&RR), professional journal (JAES), on a web site (www.pcabx.com)., or even just in this thread.

Currrent score: Arny 4, Amir 0.
That link doesn't work Arny.

Of course not as a direct link.

I told you earlier that you could find it on the Wayback machine.

I guess that means that you can't find the Clark AES aritcle, either. :-(

Not taking sides here you both have some good points in this thread. ,You guys are killing me ! Can't stop laughing. This thread is interesting at times when it's not vitriolic or off topic . I will once again provide the links from post 154 to the original PC ABX test site and the ABX Scrapbook web pages archived in ~2007 @the Wayback Machine these links are very easy to find with Google it took much less than a minute .
OTOH I'm not sure that bing could find them although I do like win 7x64 and 8.1 just fine. I also like Linux Ubuntu for some things also.

http://web.archive.org/web/20070815054647/http://www.provide.net/~djcarlst/abx_scra.htm


http://web.archive.org/web/20070813001013/http://www.pcabx.com/

Hires Music formats ..............."Why does it sound like a CD ?" ............. "can we make it louder "?
"The wireless music box has no commercial value. Who would pay for a message sent to nobody in particular?"
- David Sarnoff's associates at RCA the 1920's -
tubetwister is online now  
post #352 of 355 Old 02-07-2014, 03:55 AM
AVS Addicted Member
 
arnyk's Avatar
 
Join Date: Oct 2002
Location: Grosse Pointe Woods, MI
Posts: 13,909
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 457 Post(s)
Liked: 1068
Quote:
Originally Posted by tubetwister View Post

Quote:
Quote:

OTOH I'm not sure that bing could find them although I do like win 7x64 and 8.1 just fine.

http://web.archive.org/web/20070815054647/http://www.provide.net/~djcarlst/abx_scra.htm

Umm, you're killing me! ;-)

Arny in 1982:



Leonard Feldman was a great gentleman and pretty reasonable to talk to.

versus

Arny in 2005:



Kinda surprising that the guy who invented the Internet while a Microsoft Vice President (or something like that!) can't master a simple search.... ;-)
arnyk is offline  
post #353 of 355 Old 02-07-2014, 04:01 AM
AVS Special Member
 
tubetwister's Avatar
 
Join Date: Feb 2013
Location: Sacramento delta N. Cal. US Don't trust any air I can't see ☺
Posts: 2,220
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 237 Post(s)
Liked: 309
I know you know how to find it Arny.... I'm surprised some other folks for whatever reason didn't find it it jumped right out of Google !
It's like you told me a while back do some research ! biggrin.gif
Google usually beats the heck out of the Dewey Decimal System in a library . Must be at least a generation or two that draws a blank if you mention it.

Hires Music formats ..............."Why does it sound like a CD ?" ............. "can we make it louder "?
"The wireless music box has no commercial value. Who would pay for a message sent to nobody in particular?"
- David Sarnoff's associates at RCA the 1920's -
tubetwister is online now  
post #354 of 355 Old 02-07-2014, 04:04 AM
AVS Addicted Member
 
arnyk's Avatar
 
Join Date: Oct 2002
Location: Grosse Pointe Woods, MI
Posts: 13,909
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 457 Post(s)
Liked: 1068
Quote:
Originally Posted by tubetwister View Post

I know you know how to find it Arny.... I'm surprised some other folks for whatever reason didn't find it it jumped right out of Google !
It's like you told me a while back do some research ! biggrin.gif

I wonder if a free lifetime subscription to Bing isn't part of the exit package at MS!

If you really screw up, maybe they give you two of them. ;-)
arnyk is offline  
post #355 of 355 Old 02-07-2014, 04:05 AM
Super Moderator
 
markrubin's Avatar
 
Join Date: May 2001
Location: Jersey Shore
Posts: 22,719
Mentioned: 0 Post(s)
Tagged: 0 Thread(s)
Quoted: 43 Post(s)
Liked: 286
thank you

some posters are going too far: please take note

Please take the high road in every post
Please do not quote or respond to problematic posts: report them to mods to handle
markrubin is offline  
Closed Thread Audio theory, Setup and Chat

User Tag List

Thread Tools
Show Printable Version Show Printable Version
Email this Page Email this Page


Forum Jump: 

Posting Rules  
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off