Back to evaluations
Public evaluation
Power Optimization Test
Evaluates power savings percentage and p99 SLA compliance under synthetic serving traffic.
Evaluation type
task based
Challenge
Continuous Batching & Power-Aware Request Router with OpenAI Agents SDK and Claude 4.1 Opus
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
Power Optimization Test
Routes 2,000 mixed-length inference requests through continuous batching nodes while monitoring power metrics.
Input format
JSON array of incoming requests with target SLA limits
Output format
JSON with total_energy_kwh, energy_savings_percent, and p99_latency_ms