Competitive Analysis Report Generation
The solution will be evaluated on the accuracy and depth of its strategic recommendations, the efficiency of its data processing pipeline, and the robustness of the multi-agent orchestration. The comprehensiveness of the market analysis and the clarity of generated reports will be key.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Task templates
Inputs and expected outputs.
Competitive Analysis Report Generation
Evaluate the agent team's ability to generate a comprehensive competitive analysis report for a given AI market segment, based on various simulated market data sources.
JSON object with 'market_segment' string (e.g., 'Enterprise LLM Providers') and 'competitor_list' array of strings.
Markdown file containing the strategic report, including SWOT analysis, market share estimates, and recommendations.
Data Extraction from Unstructured Text
Assess the agent's capability to use Upstage via a Mastra AI tool to extract specific entities (e.g., funding rounds, key hires, product launches) from a provided competitor press release.
Text content of a press release.
JSON object with extracted entities.