Some of the most impactful experiments run on high-traffic websites involve improvements in color.
The right colors can mean the difference between a buy and a bounce. A prime example of this is a case study from Bing. Ron Kohavi, an expert in online experimentation and author of the book “Trustworthy Online Controlled Experiments” shared this experiment in a Harvard Business Review article.
How Microsoft made big conversion gains with small color tweaks Read More →
A/B Testing
Randomization within experimentation is important. It’s how we isolate the change we aim to learn about. When randomization goes wrong, you can get an SRM.
What you need to know about sample ratio mismatches (SRMs) Read More →
Resources
The Good Experimental Design toolkit Templates and checklist to level-up your experimental design The Good Experimental Design Toolkit by Erin Weigel. As Ronald Fisher learned, experiment data is only as good as the design you put into it. This calls-to-mind a common mantra among data scientists and software engineers: “Garbage in, garbage out.” If the
The Good Experimental Design toolkit Read More →
Resources, Uncategorized
Lukas Vermeer’s manual sample ratio mismatch (SRM) checker Quickly learn if your data is randomized properly or not Simply plug in the sample size you observe for both the control and the treatment groups and learn if there’s likely to be a sample ratio mismatch or not. Randomization is the hidden power behind A/B testing.
Lukas Vermeer’s manual sample ratio mistmatch (SRM) checker Read More →
Resources, Uncategorized
Speero’s A/B testing tool comparison website Helping you find the right experimentation tool quickly and easily Speero’s A/B testing too comparison website includes a comprehensive list of options. If you’re looking to buy an experimentation platform or an A/B testing tool, check out Speero’s excellent A/B testing tool comparison website. With Speero’s A/B testing tool
A/B testing tool comparison Read More →
Resources