Back to evaluations
Public evaluation

potline_inspection_parsing

Evaluates Pydantic schema validation adherence and extraction precision on smelter logs.

Evaluation type
task based
Challenge
Develop an Industrial Smelter Equipment Restoration Agent with Pydantic AI and Writer
Difficulty
Intermediate
Rigor
Unspecified
Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

potline_inspection_parsing

Parses raw potline thermal report and outputs validated Pydantic work order model.

Input format

Raw text log string from refractory inspection team.

Output format

JSON validated against WorkOrder Pydantic schema.