Market Trend Summary
The evaluation will assess the agent's ability to effectively leverage adaptive reasoning, demonstrating judicious model selection, prompt optimization, and accurate tool integration, all while balancing cost and performance metrics.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Task templates
Inputs and expected outputs.
Market Trend Summary
Given a dataset of mock market reports and news articles, generate a concise summary of emerging market trends, identifying key influencing factors. This task should ideally use Gemini 3 Flash for speed, unless a critical detail requires deep reasoning.
{'market_reports': ['report1_text', 'report2_text'], 'news_articles': ['article1_text', 'article2_text']}
{'summary': 'string', 'estimated_model_cost': 'float', 'latency_ms': 'int', 'models_used': ['Gemini 3 Flash', 'Gemini 2.5 Pro']}
Complex Financial Risk Analysis
Analyze a complex financial statement and a series of economic indicators to identify potential investment risks and suggest mitigation strategies. This task requires in-depth reasoning, potentially triggering Gemini 2.5 Pro usage.
{'financial_statement': 'text', 'economic_indicators': {'gdp_growth': 'float', 'inflation_rate': 'float'}}
{'risk_assessment': 'string', 'mitigation_strategies': ['strategy1', 'strategy2'], 'estimated_model_cost': 'float', 'latency_ms': 'int', 'models_used': ['Gemini 3 Flash', 'Gemini 2.5 Pro']}