Back to evaluations
Draft evaluation
Real-Time DPI API Monitoring Dashboard using Vercel AI SDK — evaluation
Evaluates streaming output response schema and time-to-first-token metric.
Evaluation type
task based
Challenge
Real-Time DPI API Monitoring Dashboard using Vercel AI SDK
Difficulty
Beginner
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
dpi_api_monitoring_eval
Parses API telemetry object and streams incident summary JSON.
Input format
JSON containing api_endpoint, current_error_rate, average_latency_ms, and region.
Output format
JSON containing incident_severity ('LOW', 'HIGH', 'CRITICAL'), suspected_cause, and stream_validity (bool).