The idea isn't to test every unit and include a printout with the unit. The idea is to test one unit before and after the mod. The cost of the test is amortized across all of the sales. This is the idea behind spec sheets. You test one (or a small sample) and publish the results as being representative of the product you're selling. This is basic marketing. It would help sell units.
Sure but time is money and the cost of test time adds up fast.
I challenge anyone to quantify the difference between a v3 and a psp2. And simple metrics like s/n or frequency response will not explain why one sounds 'better' (which is what really matters). If these tests are so easy to do, someone please show us.
You're not serious are you? Do you really think that engineers should redesign stuff without using any test equipment to quantify and verify the improvements that they are trying to achieve? As long as you are doing the tests (as any responsible audio engineer will do), it takes very little effort to document the results of those tests. It will save you money in the long run and it gives you a way to quantitatively show the improvements you've made.
Again, this is a marketing issue. It's just one more way to show your customer that your product is worth the money you charge. 5 minutes of bench time to do a test will pay for itself over and over and over again. Like they say, a picture is worth a 1000 words. Do the test once. Publish the picture a 1000 times. You'll sell more units as a result.
It sure is a marketing issue.. Specs and graphs have been used for years to dupe folks into making bad purchases. If graphs and specs could tell us what sounds best, we could be a lot more objective and save a lot of time.
There are a lot of amplifiers with great specs that sound lousy. Same for speakers. Folks in the hifi world have laughed about that for many *decades*. I'll bet we could fill a 25 page thread with stories of gear with great specs but lousy sound.
I'd venture the same can be said of pre-amps. Just because it has great specs or a pretty graph doesn't mean it sounds better than an m148, psp2 or v3. Or how about microphones? There sure are a lot of them with great specs. Maybe I should sell my MGs, Schoeps and DPAs and replace them all with a cheap multi-pattern from my local guitar center? The specs sure look great.
In comp tests comparing the v3 a/d to v3 > r09, the r09 was very often preferred. What tests, SPECIFICALLY, would quantify why that is the case?
If you figure out how to do a test that shows why an m148, v3 or psp2 sounds so good, we're all ears. But until then, it just seems like random venting about testing. Don't insist this can be easily meaningfully tested when you cannot tell us how. Simplistic graphs of frequency response or noise floor are of limited interest when considering the big picture of 'what sounds best'.
Tests for the sake of tests mean nothing.