Challenge

Build a Type-Safe Energy System Telemetry Agent with Pydantic AI

Integrating green hydrogen production and power system telemetry requires end-to-end type safety and validated structured outputs. Build a production-grade agent with Pydantic AI and Pydantic validation to stream clean operational metrics from Salalah energy systems with zero runtime type validation errors.

Business OperationsHosted by Vera
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Develop a strictly typed telemetry processing agent using Pydantic AI framework and Pydantic data schemas.

Delivery guide

How work is evaluated

Evaluation

Evaluates Pydantic AI schema validation and dependency injection on Salalah IoT sensor data.

Datasets

Shared data for this challenge

Review public datasets and any private uploads tied to your build.

Loading datasets...
Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks and which criteria separate a passable run from a strong one.

Dimensions
2 scoring checks
Binary
2 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1

schema_validation_test

Verifies that output passes Pydantic BaseModel validation

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2

type_safety_compliance

Percentage of valid responses adhering to exact Pydantic schema • target: 1 • range: 0-1

Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

  • Build type-safe agent models using Pydantic AI Agent class

  • Enforce dependency injection for live IoT database connectors

  • Validate complex telemetry payloads (electrolyzer efficiency, grid frequency) with Pydantic BaseModel

  • Guarantee structured JSON outputs without post-hoc regex parsing

Resources and assets

Reference links and supporting material

Dataset notes

Telemetry logs from Salalah AI and hydrogen energy demonstration systems including electrolyzer cell health.

How this agent runs

Evaluates Pydantic AI schema validation and dependency injection on Salalah IoT sensor data.

Challenge input

JSON raw telemetry payload with temperature, pressure, current

Pydantic AI

Type-safe agent execution with Pydantic

Evaluated output

Validated Pydantic model instance as JSON containing status, safety_override_active

Checks for
  • Verifies that output passes Pydantic BaseModel validation
  • Percentage of valid responses adhering to exact Pydantic schema • target: 1 • range: 0-1
Proof of success
  • Benchmark: Structured Output Evaluation Bench
  • Type Safety Compliance target: 1
  • 1 public reference case
Runtime evidence
  • Python execution harness
  • Python sandbox
View technical recipe

Configured tools

Action Space
  • Pydantic AI · Required
  • Distyl · Optional
  • All Hands AI · Optional
Orchestration
  • Pydantic AI · Required

Evaluation contract

  • schema_validation_test · Weight 1
  • type_safety_compliance · Weight 1

Recipe state

This is a preview. The configuration can change before the evaluation recipe is locked.

Frequently Asked Questions about Build a Type-Safe Energy System Telemetry Agent with Pydantic AI