Skip to main content
Back to Prompt Library
Implementation planning and evidence-linked development

Build the complete application

Inspect the original prompt language first, then copy or adapt it once you know how it fits your workflow.

Linked challenge: Build an Eligibility-Cutoff Impact Analysis Workbench

Format
Text-first
Lines
51
Sections
16
Linked challenge
Build an Eligibility-Cutoff Impact Analysis Workbench

Prompt source

Original prompt text with formatting preserved for inspection.

51 lines
16 sections
No variables
28 checklist items
## User
A researcher evaluating a threshold-based program.

## Build
Investigate outcomes around a policy eligibility threshold. Expose bandwidth choices, assignment irregularities, and the local scope of any estimated discontinuity.

## Input Contract
- Key: unit_id + assignment_period.
- Fields: running_variable, cutoff, eligibility, treatment_received, outcome, cluster_id.
- Do not confuse assignment with receipt. State sharp or fuzzy design before estimation.

## Workflow
1. Inspect assignment and running-variable density near the cutoff.
2. Fit prespecified local models with bandwidth sensitivity.
3. Separate outcome discontinuity from treatment discontinuity.
4. Export local estimates, diagnostics, and extrapolation limits.

## Interface
A cutoff plot, bandwidth controls, assignment diagnostics, and an analysis decision log.

## Deliverables
- A reproducible local-estimation pipeline.
- A policy memo stating the population near the cutoff and unresolved threats.
- Runnable local application, setup commands, and a dependency lockfile.
- Versioned input data, data dictionary, acquisition instructions, and rights notes.
- Calculation traces, source references, assumption records, and exported review artifacts.
- A deterministic baseline and tests for normal, incomplete, contradictory, and failure-recovery cases.
- A recorded complete workflow with a reproducible manifest and explicit limitations.

## Acceptance Criteria
- The displayed effect is local, not a population-wide average.
- A weak treatment discontinuity prevents an unqualified fuzzy-design estimate.
- Bandwidth exploration is disclosed rather than selected only for significance.
- Predetermined covariates and density diagnostics are reported.

## Contrast Case
A positive outcome jump with a near-zero treatment jump cannot support a stable treatment-effect ratio.

## Dataset Scope
The attached starter files are prototype inputs. Expected starter answers are visible. They are not independent holdouts.

Full target: Generate a synthetic running variable, cutoff, treatment receipt, and outcomes with known local effects. Include manipulated and noncompliant assignment variants.

Complete target contracts and expert review remain pending. Public observations are not historical release vintages.

## Tools
statsmodels, SciPy, Plotly

Use an available model appropriate to the task. Record provider, model identifier, version or retrieval date, settings, cost, and latency. Use deterministic code for calculations. Models may extract, retrieve, or explain evidence. They must not invent missing records, override approval rules, or claim professional authority.

## Constraints
The fixture threshold is a fictional diagnostic rule, not a universal statistical standard.

- No fabricated records, source citations, professional endorsements, or expert-adjudication claims.
- No future-data leakage into dated decisions, model fitting, or historical valuation inputs.
- No unauthorized payments, account restrictions, regulatory filings, or production changes.
- No automated appraisal certification, tax-compliance determination, or unsupported fraud accusation.
- No concealed uncertainty or silently invented inputs required for a numerical conclusion.

## Scoring
- Correct domain calculations and justified methods with documented assumptions. Weight: 30.
- Source lineage, temporal integrity, rights checks, and explicit synthetic-data labels. Weight: 25.
- A working application with review, export, error handling, and reproducible state. Weight: 20.
- Adversarial cases, uncertainty, missing-data behavior, and sensitivity analysis. Weight: 15.
- Evidence-linked conclusions that distinguish facts, assumptions, and unresolved judgments. Weight: 10.
Score each dimension from zero to two. Weighted score = sum(weight * score / 2). A failed safety gate blocks acceptance.

Adaptation plan

Keep the source stable, then change the prompt in a predictable order so the next run is easier to evaluate.

Keep stable

Preserve the source structure until you know which part of the prompt is actually driving the result quality.

Tune next

Change domain facts, examples, and tool context first before you rewrite the instruction scaffold.

Verify after

Validate one failure mode at a time so prompt changes stay attributable instead of getting noisy.