Back to evaluations
Public evaluation
Compute Strategy Planner
Evaluate the agent's ability to propose optimal infrastructure configurations based on constraints.
Evaluation type
task based
Challenge
Advanced Compute Strategy Modeling with LlamaIndex
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
Compute Strategy Planner
Assesses if the agent proposes a balanced compute procurement strategy.
Input format
Constraint map
Output format
Infrastructure plan JSON