Enter your conversion rate and the smallest lift worth detecting. You get the visitors each version needs and how many weeks the test should run at your traffic.
Worked example: a 3% conversion rate and a 20% lift at 95% confidence and 80% power need 13,914 visitors per version. With 1,000 visitors a day split across two versions, that is 28 days.
Across 450 tests run on Stellar, the median test had 2,016 visitors per version and ran 57 days, and the median lift of the best variant over the control was +1.0%. Big lifts are rare, so a plan built on a 30% lift usually ends without an answer. See the A/B testing benchmarks and how long to run an A/B test.
Already have results? Use the A/B test significance calculator, or the combined A/B test calculator to plan and analyze in one place.