Back to evaluations
Public evaluation

switch_fault_diagnosis

Evaluates the agent's root-cause accuracy and fault detection speed across simulated OT switch topology failures.

Evaluation type
task based
Challenge
Claude Agents SDK Network Switch Diagnostics Engine with Neurolink
Difficulty
Advanced
Rigor
Unspecified

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

switch_fault_diagnosis

Analyze network switch logs and PLC comm status to diagnose lost safety nodes.

Input format

JSON containing syslogs, port status tables, and PLC alarm state transitions

Output format

JSON with root_cause_device (string), fault_type (string), impacted_safety_loops (list), severity (string)