Back to evaluations
Public evaluation

sdc_latency_eval

Evaluates agent diagnosis accuracy when provided mixed network packet captures and virtual PLC cycle timing logs.

Evaluation type
task based
Challenge
Software-Defined Control System Anomaly Analyzer with Claude Agents SDK
Difficulty
Advanced
Rigor
Unspecified

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

sdc_latency_eval

Analyzes telemetry logs during a simulated switch buffer drop.

Input format

JSON containing network_switch_logs and virtual_plc_cycle_times.

Output format

JSON containing faulty_component, anomaly_type, and confidence_score.