Varypilot/ DOCUMENTATION
Open app ↗

Experimentation

Original and variations

Configure two to sixteen experiences with explicit traffic weights.

Define a clear control

The first variant is the original or control experience. Use its exact key as the SDK's fallback. Give each additional variation a stable, unique key and document what changes.

An experiment supports two to sixteen variants. Weights are integer basis points and must sum to 10,000. Keep comparisons interpretable and account for multiple comparisons when adding arms.

Variant payloads and browser changes

Variant payloads are application data. Your application can read the assigned payload and render the appropriate experience. The browser integration also supports declared text, visibility and class operations against selectors.

Review selectors and changes on your own product before launching. A payload is not a trusted instruction to an AI assistant. Do not place private server credentials or personal visitor data in public configuration.

Keep assignments stable

Started experiment variations and their weights are locked. Configuration history preserves published versions, rather than rewriting earlier results to match later design changes.