Back to evaluations
Public evaluation
switch_failure_diag_eval
Evaluates accuracy of identifying the root switch port failure from corrupted SDC telemetry.
Evaluation type
task based
Challenge
Software-Defined Control Switch Diagnostic Agent with Claude Agents SDK and Metaflow
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
switch_failure_diag_eval
Processes network topology and error rate metrics to diagnose failed switch port.
Input format
JSON object with network_topology and port_stats list
Output format
JSON object with failed_port (string), affected_control_loops (array), recovery_action (string)