Quote:
Originally Posted by
kwarny 
Referring to the order of the subs, I like the idea of starting with the lowest displacement subs first and then moving up to the largest if the majority of the content is movies.
It will be hard to judge first sub since there is nothing to compare it to from before though. I think subjective comments are useful since I assume most of us are not trained listeners as in what would measure better objectively. Someone may enjoy warmer bass which I believe relates to frequency response rise and/or higher distortion. Maybe we should all write down our personal biases before the test or our biggest priority of what we are looking for that way others can relate to our comments easier.
I think it would be fun to keep our favorite sealed set-up and compare it to the top ported subs for music and theater if there is time.
Quote:
Originally Posted by
Archaea 
In regards to KC's scoring system. I think it worked well overall!
With two notes for improvement - We didn't establish two things very well.
1) Some people used half scores IE 4.5, 2.5 etc - some didn't. That should have been established up front, as some people may not have wanted to put two subs identically at a 4, but they didn't think they were a 3 or a 5. I think the half scoring system is nice, but more difficult to manually add when you take into account this is all done with peoples scribbly unsupported and difficult to read handwriting, and periods you can't make out -etc. Perhaps just a system of 1-10 is best with 1 being the worst and 10 being the best. Easy numerically to add and average. Inevitably the score sheets were very difficult to read with multiple scratch outs and re-scores, and pens that were failing from writing half upside down and such.
2) This was stated, and agreed upon but I don't think everybody who scored at the KC meet either heard the note or perhaps just didnt take it to heart. The subs shouldn't really be evaluated against each other in the scoring system --- because you aren't hearing them at once and it becomes a grading nightmare - that final comparative analysis can be reserved for subjective written analysis (at which time let loose the dogs of war). What I mean is that it was most of our opinions in KC that each sub should be graded in a silo, at least as much as possible, with the subjective 1-5 rankings -- only graded against your opinion of ideal in the scoring section -- not graded against subs you anticipate to be better, but haven't heard yet. We should make it a point to try very hard to just listen to each sub individually out of context of the overall meet and not be afraid to give a lower priced sub a good score on x demo material if it sounded good on x demo material. So if a sub sounded really smooth - it didn't matter if it was a $500 sub. You could still give it a 5 on smoothness -- even if it was a cheaper sub. Basically --- you didn't have to rate it a 2 or 3 simply because you KNEW there would be better later. Heck if sounds good on x demo material give it a good score for that particular score. It'll all fall out in the wash because the lower quality subs will REALLY manifest that they are lower quality on some demo material - be it movies or test tone sweeps or whatever -- give them credit where credit is due and hit em hard where they deserve reprimand. I heard one comment that made me feel all parties were not onboard to this in KC when I heard a someone say aloud during the Jamo audition that - this sounds REALLY good, but I can't give it a five because I know there will be better coming up.
Well let the pieces fall where they may and then the subjective analysis can really point out any differences that the scoring doesn't pick up. I think the scoring will basically take care of itself in that you will see some people with less sub experience rate some of the cheaper subs higher, and some with more selective preferences may rate it lower --- but yet the scoring remains, when averaged, a valid indicator of quality.
This isn't perfect, but I think the alternative is worse.
For instance in the alternate rating system ---You label each sub 1-10 - 10 being best. Let's just say the subs happen to fall out in order of price --- just for ease of displaying this problem. Then your final score reveals you have collectively ranked the cheapest sub and average of 1 and the best sub an average of 10. Well that tells the reader nothing, about how the sub actually preforms in each category. The alternate ranking collectively system fails to point out that while the $500 DIY option wasn't that great at the single WOTW movie scene, it really did amazing for music, and was quite commendable on several of the other action movies ---- or whatever the case may be?!?!. It also fails to point out that the average Joe may be happy with that type of setup he realizes he can get 85% of the preformance at 30% of the cost --- and is willing to accept noted limitations.
I hope I didn't ramble to the point this discussion topic doesn't make sense...This is just my opinion. I default to Omaha's choice on the final ranking rules. It's his meet - I'm just happy I can attend!
Good points kwarny/Archaea.
desertdome and I have been emailing each other on a lineup and scoring system. After reading all I think:
Do a 1-10 grading on each sub in various categories similar to the KC GTG and then an OVERALL point grade.
Hand out a sheet of the sub specs/scoring points/notes area.
After each sub, collect scoring sheets and hand out the ones for the next sub in line.
I was envisioning a 8x11 sheet with divisions of sub/amp info, scoring bullets/numbers similar to Archaea's, and then a third and last division of lines. This would appear similar to a powerpoint notes page, if you have seen those.
Our ideas for lineups:
1) staggered with DIY and production models
2) DIY in a group before lunch, then production models after
3) DIY and production in an increasing anticipated output.
4) Ported/Horns and Sealed setups in different groups, increasing outputs.
#3 was my preferred choice. But after Archaea's thoughts on bias and thinking "the next sub will be cleaner/louder/punchier/etc" than the last, I do like the more of a staggered lineup. I'd like to hear more thoughts from those attending and anyone in general that has attended one or read what people ended up thinking would be the best.
Either way it would be EASIEST to start with the Cinema F-20s since they are already set up, then we could cycle each set of sub(s) down to the basement. The garage can be our staging area. Then we won't have any interference by activating drivers in other subs with bass waves, etc like desertdome has mentioned could happen. We would only have the subs tested in the basement at each time for measurements and listening.
Here are some lineup ideas:
9:00 – Introductions/Explanation of proceedings. Name Tags.
9:20 – Explanation of listening and scoring procedure. Pass out sheets.
9:30 – Dual LilMike Cinema F20s
10:15 – Rythmik DIY
11:00 – Dual MFW Turbo’s
11:45 – Klipsch Sonosub DIY
12:30 – Pizza
1:00 – Dual JTR Captivator Pros
1:45 – Dual BIC F12’s
2:30 – Hsu VTF-2 MK3 + MBM-12 MK1
3:15 – Dual CHT VS 18.1
4:00 – Dual CHT 18.1 We could do CHT sealed/ported combo here too
4:45 – eD a7s-450
5:30 – DTS-10/Growler
6:00 – Quad sealed MFW-15’s
6:45 – BBQ
7:15 – Quad sealed MFW-15’s and Dual CHT 18.1/eD a7s-450
7:45 – 10:00 Discussion, relisten to subs, tally scores, watch football
Alternative lineup:
9:30 LilMike Dual Cinema F-20s
10:15 Klipsch Sonosub DIY
11:00 HSU VTF-2 MK3 + MBM-12 MK1
11:45 Dual BIC F12s
12:30 Pizza
1:00 Rythmik DIY
1:45 eD a7s-450
2:30 Dual CHT 18.1
3:15 Dual Turbos
4:00 DTS-10/Growler
4:45 Dual CHT VS 18.1
5:30 Dual Captivators
6:15 Quad Sealed MFWs Dual Opp
7:00 BBQ
7:45 Quad Sealed MFWs plus CHT 18.1s
(This is pretty much in anticipated increasing output, though I'm unsure on the DTS10 vs Caps vs VS 18.1s). The Quad Sealed will be the biggest pain to move so would do those last in any setup-regardless of expected output.
9:30 - Dual LilMike Cinema F20s
10:15 – DTS-10/Growler
11:00 – Dual MFW Turbo’s
11:45 – Klipsch Sonosub DIY
12:30 – Pizza
1:00 – Dual JTR Captivator Pros
1:45 – Dual BIC F12’s
2:30 – Hsu VTF-2 MK3 + MBM-12 MK1
3:15 – Dual CHT VS 18.1
4:00 – Dual CHT 18.1 We could do CHT sealed/ported combo here too
4:45 – eD a7s-450
5:30 – Rythmik DIY
6:00 – Quad sealed MFW-15’s
6:45 – BBQ
7:15 – Quad sealed MFW-15’s and Dual CHT 18.1/eD a7s-450
This last one is a bit modded so that we could hear the DTS10 and F-20s right next together, then all of the sealed setups at the end.
What do you guys think?
EDIT: If we actually stick to the schedule, say get done around 8pm with the rundown, we could then compare say the VS 18.1s directly to the Cap Pros, etc.
Or $$$ vs $$$ with any setups that are approx the same costs...etc....Totally whatever people want to do if they are sticking around all night.