Back to evaluations
Public evaluation
telemetry_anomaly_detection
Evaluates agent anomaly detection precision, latency, and function calling validity against simulated PLC telemetry logs.
Evaluation type
task based
Challenge
OpenAI Agents SDK PLC Telemetry Anomaly Detector with Qwen 3
Difficulty
Intermediate
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
telemetry_anomaly_detection
Process a stream of aeration tank telemetry samples and identify sensor failures vs process anomalies.
Input format
JSON lines with timestamp, dissolved_oxygen, air_flow_rate, blower_rpm, valve_position
Output format
JSON object with anomaly_detected (bool), root_cause (string), confidence (float), latency_ms (int)