Skip to main content

Guardrail Metrics

Guardrail metrics are secondary metrics you monitor alongside your primary metric to catch unintended side effects.

Why guardrails matter

Your experiment might boost revenue (your primary metric) but tank visits or spike churn. Guardrails ensure you don't celebrate a win on one number while another is quietly collapsing.

Example: You raise prices at test locations. Revenue goes up 8%—great. But visits drop 15% and churned members spike. Guardrails catch this before you roll out a net-negative change.

Adding guardrails

On the test detail page (Overview tab), you'll see a Guardrail Metrics section with a dropdown to add metrics. The dropdown excludes your primary metric (no point guardrailing what you're already measuring).

Available guardrail metrics include any metric your organization tracks: revenue, transactions, visits, enrollments, churned members, and more.

You can add or remove guardrails at any time, even after analysis has run. When you change guardrails, ProofPod re-runs the analysis to include them.

Reading guardrail results

Each guardrail metric gets its own results card showing:

  • The estimated effect on that metric
  • Whether the change is concerning (warning or critical)
  • Confidence intervals

Impact on recommendations

Guardrail results directly affect recommendations:

  • Critical guardrail failure can trigger a Kill recommendation, even if the primary metric looks good
  • Warning-level guardrail issues appear in the recommendation checklist but don't override the primary metric's signal
  • Clean guardrails (no concerning changes) contribute to a Scale recommendation's confidence
tip

Start with 2–3 guardrails that represent the most important "do no harm" metrics for your business. Too many guardrails can make it hard to ever reach a Scale recommendation.