Back to evaluations
Public evaluation

ScenarioAnalysis

The evaluation will assess the system's ability to accurately process information, generate coherent tactical recommendations, and demonstrate proper MCP tool integration and A2A communication.

Evaluation type
task based
Challenge
Tactical Intelligence Agent System
Difficulty
Advanced
Rigor
Unspecified
Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
2
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

ScenarioAnalysis

Evaluate the agent system's ability to analyze a simulated geopolitical scenario and produce tactical recommendations.

Input format

{'scenario_description': 'string', 'data_feeds': [{'type': 'string', 'content': 'string'}]}

Output format

{'summary': 'string', 'recommendations': ['string'], 'confidence_score': 'float'}

Task 2

ToolIntegrationVerification

Verify that agents successfully use MCP-enabled tools for data validation and ethical review.

Input format

{'data_point': {'key': 'value'}, 'expected_tool_call': 'string'}

Output format

{'tool_called': 'boolean', 'tool_output': 'json'}