About / How the Hub runs experiments
How the Hub runs experiments
Sometimes the Hub tries two versions of a page to see which works better for people. No experiment is running at the moment. This page says what may be tested and what never will.
What may be tested
On pages where the Hub asks for money, a test can change how it asks and nothing else:
- where an ask sits on the page
- how it is worded
- the order of the options
- how a package is presented
- when in a journey it appears
- the order of onboarding steps
- which free route is shown
What is never tested
- Prices. A product has the same published price for every buyer at the same moment, in the same currency and place.
- Discounts, or what a purchase entitles you to.
- Tax and sanctions treatment.
- Consent and privacy wording, legal terms, moderation outcomes and safety messages.
- Accessibility, and anything on the free tier's published floor.
If you are in a test
You see one version for the whole test. The Hub works out which from a pseudonymous token and stores no record of you against it, so a test builds no profile of you. Each test is registered before it starts, with what it is for and how it will be read. If a test harms errors, speed, whether people finish what they came to do, or complaints, it is switched off automatically within a minute. Every test keeps its result on record, including those that changed nothing.