Back to evaluations
Public evaluation

alarm_triage_validation

Evaluates schema compliance, validation error rates, and alarm grouping accuracy under heavy alarm load.

Evaluation type
task based
Challenge
Type-Safe SCADA Alarm Triaging with Pydantic AI
Difficulty
Intermediate
Rigor
Unspecified
Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

alarm_triage_validation

Ingests burst of 50 SCADA alarms and outputs dynamic prioritized action model.

Input format

JSON array of raw SCADA alarm records

Output format

Pydantic JSON object conforming to TriageResult schema