Back to evaluations
Draft evaluation
Pydantic AI Muni Debt Disaster Recovery Financing Auditor — evaluation
Evaluates compliance validation accuracy for municipal debt draw requests.
Evaluation type
task based
Challenge
Pydantic AI Muni Debt Disaster Recovery Financing Auditor
Difficulty
Intermediate
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
Muni Bond Draw Audit Task
Audits single construction draw request against bond covenant debt limits.
Input format
JSON draw request containing cost_categories, amount_usd, and bond_covenant_limits
Output format
JSON audit result with is_compliant, flagged_items, approved_amount_usd