Multi-day review
Programme health check
A look across several concurrent A/B tests: overlapping assignment, shared metrics, and the habits that create false winners.
When this is useful
Teams that run several experiments at once often share users, share a checkout metric, and share a Friday habit of peeking. A health check lists the collisions and the reporting habits that make last quarter’s “wins” hard to trust.
What we examine
Assignment overlap, metric reuse, undocumented peeks, tests that never received a written close-out, and holdout groups that were quietly used as a dumping ground for leftover traffic.
Delivery
A findings letter and a ninety-minute debrief with the people who actually start tests, not only the director who sponsored the visit.
Request a quote with a list of live and recently closed tests via contact.