Back to evaluations
Public evaluation

KV Cache Allocation Task

Evaluates KV-cache planner accuracy under simulated bursty tenant workloads.

Evaluation type
task based
Challenge
LangChain & AutoGen KV-Cache Multi-Tenant Capacity Planner
Difficulty
Advanced
Rigor
Unspecified

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

KV Cache Allocation Task

Evaluates agent system's dynamic page allocation when 10 concurrent requests scale context lengths from 4k to 64k tokens.

Input format

JSON array of incoming requests with start times, context lengths, and priority tiers.

Output format

JSON execution trace showing block allocations, swap events, and total throughput achieved.