Back to evaluations
Public evaluation
eia_compliance_check
Evaluates streaming output response validity and accuracy of regulatory breach identification.
Evaluation type
task based
Challenge
Oil Project Regulatory Compliance Assistant with AI SDK
Difficulty
Intermediate
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
eia_compliance_check
Checks EIA metrics against Kuwait EPA maximum limits
Input format
JSON object with proposed water reinjection volume and flaring limits
Output format
JSON containing status, non_compliant_items array, and recommended remedy