Back to evaluations
Draft evaluation

Control Integrator Troubleshooting Copilot using Vercel AI SDK and Galileo — evaluation

Evaluates response faithfulness and task resolution for industrial networking fault scenarios.

Evaluation type
task based
Challenge
Control Integrator Troubleshooting Copilot using Vercel AI SDK and Galileo
Difficulty
Intermediate
Rigor
Not declared

The author has not specified a rigor level.

Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

Ethernet/IP Fault Resolver

Evaluates recommended diagnostic steps given network logs and switch status.

Input format

JSON containing fault_code, packet_drop_rate, and switch_logs

Output format

JSON with root_cause, corrective_action, and confidence