Back to evaluations
Public evaluation
dpi_api_monitoring_eval
Evaluates streaming output response schema and time-to-first-token metric.
Evaluation type
task based
Challenge
Real-Time DPI API Monitoring Dashboard using Vercel AI SDK
Difficulty
Beginner
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
dpi_api_monitoring_eval
Parses API telemetry object and streams incident summary JSON.
Input format
JSON containing api_endpoint, current_error_rate, average_latency_ms, and region.
Output format
JSON containing incident_severity ('LOW', 'HIGH', 'CRITICAL'), suspected_cause, and stream_validity (bool).