Back to evaluations
Public evaluation
switch_fault_diagnosis
Evaluates the agent's root-cause accuracy and fault detection speed across simulated OT switch topology failures.
Evaluation type
task based
Challenge
Claude Agents SDK Network Switch Diagnostics Engine with Neurolink
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
switch_fault_diagnosis
Analyze network switch logs and PLC comm status to diagnose lost safety nodes.
Input format
JSON containing syslogs, port status tables, and PLC alarm state transitions
Output format
JSON with root_cause_device (string), fault_type (string), impacted_safety_loops (list), severity (string)