Back to evaluations
Public evaluation

MissionPlanningEfficiency

The evaluation will assess the system's ability to autonomously plan, execute, and adapt a drone swarm mission under simulated dynamic conditions. Emphasis will be on agent coordination, decision-making quality, and robustness.

Evaluation type
task based
Challenge
Autonomous Swarm Mission Orchestration
Difficulty
Advanced
Rigor
Unspecified

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
2
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

MissionPlanningEfficiency

Evaluates the initial mission plan generated by the Commander agent for efficiency and feasibility given objectives and constraints.

Input format

JSON object with 'mission_objectives': string[], 'area_constraints': string[], 'drone_capabilities': string[]

Output format

JSON object with 'initial_plan': { 'steps': string[], 'duration_estimate': string, 'resource_allocation': object }, 'reasoning_trace': string

Task 2

AdaptiveRe-planning

Tests the swarm's ability to adapt its plan when unexpected events (e.g., a drone failure or new threat) are introduced mid-mission.

Input format

JSON object with 'current_state': object, 'new_event': { 'type': string, 'details': string }

Output format

JSON object with 'revised_plan': { 'steps': string[], 'reasoning': string }, 'a2a_log_excerpt': string