Back to evaluations
Public evaluation

dpi_api_monitoring_eval

Evaluates streaming output response schema and time-to-first-token metric.

Evaluation type
task based
Challenge
Real-Time DPI API Monitoring Dashboard using Vercel AI SDK
Difficulty
Beginner
Rigor
Unspecified

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

dpi_api_monitoring_eval

Parses API telemetry object and streams incident summary JSON.

Input format

JSON containing api_endpoint, current_error_rate, average_latency_ms, and region.

Output format

JSON containing incident_severity ('LOW', 'HIGH', 'CRITICAL'), suspected_cause, and stream_validity (bool).