Back to evaluations
Public evaluation

Ethernet/IP Fault Resolver

Evaluates response faithfulness and task resolution for industrial networking fault scenarios.

Evaluation type
task based
Challenge
Control Integrator Troubleshooting Copilot using Vercel AI SDK and Galileo
Difficulty
Intermediate
Rigor
Unspecified
Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

Ethernet/IP Fault Resolver

Evaluates recommended diagnostic steps given network logs and switch status.

Input format

JSON containing fault_code, packet_drop_rate, and switch_logs

Output format

JSON with root_cause, corrective_action, and confidence