Develop an Industrial Smelter Equipment Restoration Agent with Pydantic AI and Writer
Smelter restoration projects experience cost overruns due to unstructured site inspection reports and non-standardized replacement part specs. Build a structured Pydantic AI agent integrated with Writer to parse thermal camera telemetry and field logs, producing schema-validated work orders that reduce procurement clearance lead times by 30%.
What you are building
The core problem, expected build, and operating context for this challenge.
Build a type-safe inspection log parser and work order generator using Pydantic AI and Writer models for industrial aluminum smelter restoration.
How work is evaluated
Evaluates Pydantic schema validation adherence and extraction precision on smelter logs.
Shared data for this challenge
Review public datasets and any private uploads tied to your build.
How submissions are scored
These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.
pydantic_schema_strictness
Output must strictly validate against Pydantic model without missing required fields
This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.
extraction_precision
Precision of extracted part numbers and defect categories • target: 0.95 • range: 0-1
This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.
What you should walk away with
Construct Pydantic validation models for industrial potline repair specifications
Utilize Pydantic AI agent classes to enforce strict type guarantees on LLM extractions
Connect Writer's Palms model for domain-specific industrial document understanding
Automate generation of SAP-compatible work orders with verified part numbers
Reference links and supporting material
Unstructured potline inspection reports and thermal imaging logs from Al-Taweelah aluminium smelter.
How this agent runs
Evaluates Pydantic schema validation adherence and extraction precision on smelter logs.
Challenge input
Raw text log string from refractory inspection team.
Pydantic AI
Required framework for type-safe validation
Writer
Required domain-specific LLM platform
Evaluated output
JSON validated against WorkOrder Pydantic schema.
- Output must strictly validate against Pydantic model without missing required fields
- Precision of extracted part numbers and defect categories • target: 0.95 • range: 0-1
- Benchmark: Structured Industrial Extraction Benchmark
- Extraction Precision target: 0.95
- 1 public reference case
- Python execution harness
- Python sandbox (unavailable on Versalist)
View technical recipe
Configured tools
- Writer · Required
- Pydantic AI · Optional
- Zed · Optional
- Pydantic AI · Optional
Evaluation contract
- pydantic_schema_strictness · Weight 1
- extraction_precision · Weight 1
Recipe state
This is a preview. The configuration can change before the evaluation recipe is locked.