“I would say 5 to 10%, but mostly 10% means you will have nine failure tests out of the 10 tests you're running.”

eCommerce Fastlane: Shopify Growth Strategies - Where AI Efficiency Meets Human Connection · Why 9 Out of 10 A/B Tests Fail (and How Shopify Brands Pick the Ones That Win)

Play from 8:48
8:48

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

measured the win-rate of all A/B tests run on their platform

5-10% (average ~10%) of tests beat the original

Said nearby on the same subject

“We have a tool that measures your values… 200,000 people have taken this test in the last year… 91% accuracy.”
SW
Susie Welch
BigDeal ·
Tool 200,000 tests taken in the last year; 91% accuracy Share this moment
“I wanted to test all these configurations of CockroachDB across different vertical scaling… test across all this huge matrix”
PM
Peter Mattis
The Pragmatic Engineer ·
How they work Share this moment
“You have to test your backups under pressure with the clock running.”
MP
Melanie Pedrone
Tell Me Everything | Logistics Freight Podcast ·
How they work Share this moment
“You want to be testing like 10 to 15% of your budget, whether it's content, whether it's media, whether it's different platforms.”
♫
Said on The Marketing Millennials
How they work 10-15% Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.