Back to evaluations
Public evaluation

EdgePerceptionTask

The evaluation will assess the system's ability to process multi-modal input at the edge, securely transmit relevant information to the cloud, and enable the Cloud Command Agent to make intelligent, context-aware decisions in simulated scenarios.

Evaluation type
task based
Challenge
Multi-Modal Edge AI for Defense with AutoGen and OpenAI o3/GPT-5
Difficulty
Advanced
Rigor
Unspecified
Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
2
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

EdgePerceptionTask

Simulate real-time multi-modal input (image + audio) at the edge and evaluate the Edge Perception Agent's ability to identify objects and key audio cues.

Input format

JSON object: {'image_path': 'path/to/image.jpg', 'audio_path': 'path/to/audio.wav'}

Output format

JSON object: {'detected_objects': ['obj1', 'obj2'], 'audio_events': ['event1'], 'confidence': 0.X}

Task 2

CloudCommandDecision

Evaluate the Cloud Command Agent's ability to synthesize edge insights, RAG context, and strategic goals to generate an actionable response plan.

Input format

JSON object: {'edge_report': {'detected_objects': [...], 'audio_events': [...]}, 'mission_context': 'string', 'strategic_goals': ['goal1', 'goal2']}

Output format

Markdown string of a detailed action plan, including justification and risk assessment.