Category: a/b testing
Within the web analytics world, I have noticed two common themes regarding the "Taguchi Methods" and how they are used within the Web Analytics Space. I was working with a client whom had mentioned they had wanted to use the "taguchi methods" in order to test the optimum pay per click ads for their keyword programs. The first thing he had confusion about is the difference between multivariate testing, A/B testing, and Taguchi functions. The second thing he asked me about was why some of the tests created through Taguchi Metho
You are testing too many things at one time: Whether you are testing more than two pages in an A/B test, or running a multi-variable test, the more variables you test, the more samples you are going to take to get a high confidence result. The problem is that by design, MOST of the items you are testing are not the prime driver! The more you test, the larger the haystack you are going to have to look for.
