Back to evaluations
Public evaluation

Parallel Topology Optimization Task

Evaluates distributed parallel configuration suggestions on simulated multi-node clusters.

Evaluation type
task based
Challenge
CrewAI Distributed Interconnect & Tensor Parallelism Simulator
Difficulty
Advanced
Rigor
Unspecified

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

Parallel Topology Optimization Task

Evaluates optimization of TP and PP partitioning across 16 GPUs over 2 nodes connected via 400 Gbps EFA links.

Input format

JSON cluster spec containing GPU count, node count, interconnect bandwidth, and model size (70B parameters).

Output format

JSON optimization layout specifying TP size, PP size, expected AllReduce latency, and throughput gain %.