Back to evaluations
Draft evaluation
OpenAI Agents SDK & Claude 4 Opus IPO Financial Compliance Audit — evaluation
Evaluates accuracy in detecting revenue discrepancies across AA streams and trial balances.
Evaluation type
task based
Challenge
OpenAI Agents SDK & Claude 4 Opus IPO Financial Compliance Audit
Difficulty
Advanced
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
Financial Reconciliation
Processes company banking logs and GST returns to identify tax discrepancy flags.
Input format
JSON with company financial statements, AA bank feeds, and GST return summary
Output format
JSON with audited_revenue, discrepancy_found (bool), and discrepancy_amount