You are testing too many things at one time: Whether you are testing more than two pages in an A/B test, or running a multi-variable test, the more variables you test, the more samples you are going to take to get a high confidence result. The problem is that by design, MOST of the items you are testing are not the prime driver! The more you test, the larger the haystack you are going to have to look for.
If the ultimate goal of site optimization testing is to generate the maximum conversion rate, which I believe it is, then every site optimization task should be carried out until the optimum conversion rate has been discovered. When you have determined there is an area of your web site that you would like to optimize for conversion rates, it can at times be like trying to find a new job: a bunch of failures before you finally get a break. You don't send your resume out once, and if you don't get the job consider your job search a failure. Instead, you learn fro
