Back to evaluations
Public evaluation
sdc_latency_eval
Evaluates agent diagnosis accuracy when provided mixed network packet captures and virtual PLC cycle timing logs.
Evaluation type
task based
Challenge
Software-Defined Control System Anomaly Analyzer with Claude Agents SDK
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
sdc_latency_eval
Analyzes telemetry logs during a simulated switch buffer drop.
Input format
JSON containing network_switch_logs and virtual_plc_cycle_times.
Output format
JSON containing faulty_component, anomaly_type, and confidence_score.