Back to evaluations
Public evaluation

hotel_room_delivery_stream

Evaluates streaming endpoint latency and structural schema accuracy for hotel completion telemetry.

Evaluation type
task based
Challenge
Hospitality Megaproject Construction Copilot with Vercel AI SDK & Aider
Difficulty
Intermediate
Rigor
Unspecified
Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

hotel_room_delivery_stream

Validates structured JSON stream output for room delivery progress across property portfolios.

Input format

JSON with portfolio_id and target_quarter

Output format

Stream of JSON objects containing total_rooms, delivered_rooms, and status