Back to evaluations
Draft evaluation
LangChain & AutoGen KV-Cache Multi-Tenant Capacity Planner — evaluation
Evaluates KV-cache planner accuracy under simulated bursty tenant workloads.
Evaluation type
task based
Challenge
LangChain & AutoGen KV-Cache Multi-Tenant Capacity Planner
Difficulty
Advanced
Rigor
Not declared
The author has not specified a rigor level.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
KV Cache Allocation Task
Evaluates agent system's dynamic page allocation when 10 concurrent requests scale context lengths from 4k to 64k tokens.
Input format
JSON array of incoming requests with start times, context lengths, and priority tiers.
Output format
JSON execution trace showing block allocations, swap events, and total throughput achieved.