Skip to main content

Produce a Stakeholder Summary

Lead with the decision and its conditions. A compact summary should include:

  • treated geography, outcome, launch, cooldown, and measurement dates;
  • eligible donor universe and material exclusions;
  • design-stage MDE at the stated target power and plausible lift range;
  • inference status, ATT in outcome units, interval, p-value, and placebo count;
  • pre-period fit and donor concentration;
  • concurrent media, spillover, data, and sensitivity caveats;
  • a clear recommendation: proceed, interpret cautiously, redesign, or reject.

Example:

GeoSC estimated average incremental revenue of £X per week against the pre-specified SparseSC counterfactual over dates A–B. The two-sided in-space placebo p-value was P using N placebo assignments; the interval was [L, U]. Interpretation is conditional on the recorded donor-eligibility and treatment- isolation assumptions. The design-stage grid-based MDE was M% at T% target power, so effects below M% were not reliably detectable under the fitted DGP.

Do not translate statistical significance into ROI without campaign cost and a commercial value definition. Do not describe status: ok as proof of causal validity.

Use the interval level recorded in ci.level, independently of the configured significance threshold. An 80% average-ATT interval must not be labelled 95%, and its bounds must remain in the ATT’s unscaled outcome units. Scaled diagnostic bounds cannot fill missing primary uncertainty. The uplift plot’s horizontal band concerns average ATT uncertainty, not coverage of the effect path.

For partial results, retain warnings and state which quantities remain available. For failed or unknown status, report errors and unavailable inference instead of interpreting retained diagnostic numbers. Read significance_available before the stored significant flag; an unavailable decision is not evidence of no effect. The maintained renderers apply these rules consistently and the HTML report escapes artifact-derived text.