Back to evaluations
Public evaluation
CrossPlatformQuery
The solution will be evaluated on its ability to accurately and coherently answer cross-platform technical queries by effectively leveraging information from multiple simulated knowledge bases through A2A communication.
Evaluation type
task based
Challenge
A2A Cross-Platform Knowledge Bridge
Difficulty
Intermediate
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
CrossPlatformQuery
Evaluate the agent system's ability to answer a technical question that requires synthesizing information from both simulated platform knowledge bases (iOS and Android).
Input format
{ "user_query": "string", "ios_docs": "string[]", "android_docs": "string[]" }
Output format
{ "unified_response": "string", "sources": "string[]" }