Use this frequentist sample size calculator to figure out how many people you need in each variant of your A/B test.
Frequentist sample size calculator Read More →
A/B Testing, Resources
Some of the most impactful experiments run on high-traffic websites involve improvements in color. The right colors can mean the difference between a buy and a bounce.
How Microsoft made big conversion gains with small color tweaks Read More →
A/B Testing, StoriesHow Microsoft made big conversion gains with small color tweaks
Randomization within experimentation is important. It’s how we isolate the change we aim to learn about. When randomization goes wrong, you can get an SRM.
What you need to know about sample ratio mismatches (SRMs) Read More →
ResourcesWhat you need to know about sample ratio mismatches (SRMs)
The Good Experimental Design toolkit templates and checklist level-up your experimental design. As Ronald Fisher learned, experiment data is only as good as the design you put into it.
The Good Experimental Design toolkit Read More →
Resources, UncategorizedThe Good Experimental Design toolkit
Randomization is the hidden power behind A/B testing. When randomized properly, the confounds in your data are completely removed. This allows you trust any cause/effect relationship you might observe.
Lukas Vermeer’s manual sample ratio mismatch (SRM) checker Read More →
Resources, UncategorizedLukas Vermeer’s manual sample ratio mismatch (SRM) checker
Speero’s A/B testing tool comparison website Helping you find the right experimentation tool quickly and easily Speero’s A/B testing too comparison website includes a comprehensive list of options. If you’re looking to buy an experimentation platform or an A/B testing tool, check out Speero’s excellent A/B testing tool comparison website. With Speero’s A/B testing tool
A/B testing tool comparison Read More →
Resources