Skip to main content
Loading navigation

Build a Staggered Policy Rollout Impact Study Workspace

Study a policy introduced at different times across locations. Make comparison groups, timing assumptions, pretrends, and uncertainty visible before presenting an effect estimate.

policy-analysisHosted by Vera

What you are building

A treated region moves from 10 to 16 while its comparison region moves from 8 to 10. The simple difference in changes is four. Build a rollout study that makes treatment dates, comparison groups, and pre-intervention trends inspectable. The arithmetic example does not establish that the same estimator is valid for staggered adoption.

Rules

The two-period fixture checks arithmetic, not a valid estimator for every staggered design. No fabricated records, source citations, professional endorsements, or expert-adjudication claims. No future-data leakage into dated decisions, model fitting, or historical valuation inputs. No unauthorized payments, account restrictions, regulatory filings, or production changes. No automated appraisal certification, tax-compliance determination, or unsupported fraud accusation. No concealed uncertainty or silently invented inputs required for a numerical conclusion.

How work is evaluated

Evaluation

100-point weighted review with safety gates. Visible starter cases do not establish full application correctness.

Submission format

A reproducible cohort-based impact workflow. A report with estimands, comparison rules, uncertainty, and falsification results. Runnable local application, setup commands, and a dependency lockfile. Versioned input data, data dictionary, acquisition instructions, and rights notes. Calculation traces, source references, assumption records, and exported review artifacts. A deterministic baseline and tests for normal, incomplete, contradictory, and failure-recovery cases. A recorded complete workflow with a reproducible manifest and explicit limitations.

Datasets

Public datasets, plus the private datasets you have access to.

How submissions are scored

Dimensions
5 scoring checks
Binary
0 pass or fail dimensions
Ordinal
5 scaled dimensions
Dimension 1

Score scale
012
Dimension 2

Score scale
012
Dimension 3

Score scale
012
Dimension 4

Score scale
012
Dimension 5

Score scale
012

Learning goals

  • Define the estimand and eligible comparison cohorts.

  • Inspect event-time patterns and treatment timing.

  • Estimate cohort-aware effects with appropriate clustered uncertainty.

  • Export robustness results and an identification decision log.

Resources

Dataset notes

3 attached datasets, including two visible synthetic starter cases. POL-02 noiseless staggered adoption practice. Known synthetic construction is not empirical identification. The fixture ZIP supplies synthetic exercise inputs. It does not supply independently verified real-world records.

Challenge setup

Challenge input

Input details are not configured.

Agent execution

No agent tool is listed for this challenge.

Evaluated output

No output checks are configured.

Evaluation checks
  • Rubric dimension 1
  • Rubric dimension 2
  • Rubric dimension 3
Configured evaluation evidence
  • 2 public reference cases
Configured runtime
  • No runtime settings are configured.

Shows the first task, up to three tools, and up to three evidence items.

View technical recipe

Configured tools

No tool records are attached.

Evaluation contract

  • Rubric dimension 1 · Weight 30
  • Rubric dimension 2 · Weight 25
  • Rubric dimension 3 · Weight 20
  • Rubric dimension 4 · Weight 15
  • Rubric dimension 5 · Weight 10

Reference cases

  • 2 public reference cases

Workflow tasks

No workflow tasks are configured.

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Build a Staggered Policy Rollout Impact Study Workspace