Posted by Wayne Parham [ 65.69.120.174 ] on June 14, 2005 at 19:00:18:
In Reply to: Re: A/B Testing/Weber Fachner Law posted by manualblock on June 14, 2005 at 12:54:29:
This is why the volume levels are to be held constant in any A/B test. It's also why I don't consider power increases less than 2x to be particularly significant. If you A/B test two things with 10% difference, you'll surely hear it and the louder one has a slight advantage. But if you're not A/B testing, you really have to double power to notice much of a change. A ten percent increase seems like almost nothing at all, barely perceptible unless compared side-by-side.
[ General Forum ] [ Help ]