Challenge

Build a Claude Agents SDK Reproductive Psychiatry Legal & Risk Inspector

High-risk psychiatric medications prescribed during postpartum conditions carry complex liability and adverse event reporting considerations. Build a Claude Agents SDK agent utilizing extended thinking capabilities to review psychiatric encounter records, flag liability exposure, and ensure protocol compliance.

Data ScienceHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Construct an agent using Anthropic Claude Agents SDK with extended thinking to evaluate high-risk clinical records and legal compliance.

Delivery guide

How work is evaluated

Evaluation

Evaluates extended thinking agent performance in detecting undocumented psychiatric risk factors.

Datasets

Shared data for this challenge

Review public datasets and any private uploads tied to your build.

Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

flag_missing_consent

Ensures missing consent is captured in flagged_omissions list.

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

risk_classification_precision

Precision of assigned liability levels across audited psychiatric chart benchmarks. • target: 0.92 • range: 0-1

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Build a Claude Agents SDK workflow with extended thinking enabled for deep clinical reasoning

  • Extract medication changes, black-box warning advisories, and consent documentation from notes

  • Assess risk scores for medico-legal liability in reproductive psychiatry cases

  • Output structured JSON compliance audits highlighting omitted clinical safeguards

Resources and assets

Reference links and supporting material

Dataset notes

25 de-identified synthetic psychiatric clinical notes detailing perinatal and postpartum treatment plans with variable documentation quality.

How this agent runs

Evaluates extended thinking agent performance in detecting undocumented psychiatric risk factors.

Challenge input

JSON containing encounter_note (string) and prescribed_meds (list of strings).

Claude Agents SDK

Official SDK with deep extended thinking for multi-step reasoning.

Evaluated output

JSON containing liability_level (string), flagged_omissions (list), and protocol_compliant (boolean).

Checks for
  • Ensures missing consent is captured in flagged_omissions list.
  • Precision of assigned liability levels across audited psychiatric chart benchmarks. • target: 0.92 • range:...
Proof of success
  • Benchmark: Medico-Legal Audit Benchmark
  • Risk Classification Precision target: 0.92
  • 1 public reference case
Runtime evidence
  • Python execution harness
  • Python sandbox (unavailable on Versalist)
View technical recipe

Configured tools

Action Space
  • ONNX Runtime · Required
  • Retool · Optional
  • Anthropic · Optional

Evaluation contract

  • flag_missing_consent · Weight 1
  • risk_classification_precision · Weight 1

Recipe state

This is a preview. The configuration can change before the evaluation recipe is locked.

Frequently Asked Questions about Build a Claude Agents SDK Reproductive Psychiatry Legal & Risk Inspector