Geopolitical Event Analysis
The solution will be evaluated on the correctness and relevance of its geopolitical risk assessments for commodities, the robustness of its data pipelines, and the clarity of its generated insights.
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Task templates
Inputs and expected outputs.
Geopolitical Event Analysis
Evaluate the system's ability to identify and summarize relevant geopolitical events impacting a commodity.
{'event_description': 'string', 'commodity': 'string', 'date': 'YYYY-MM-DD'}
{'summary': 'string', 'potential_impact': 'string', 'risk_score': 'float (0-10)'}
Market Sentiment & Prediction
Assess the system's capability to analyze market sentiment and provide a short-term price direction prediction.
{'commodity': 'string', 'period': 'string (e.g., '24h', '1w')'}
{'sentiment': 'positive|neutral|negative', 'prediction_direction': 'up|down|stable', 'justification': 'string'}
Dagster Pipeline Robustness
Verify the Dagster pipeline successfully ingests data, executes LLM analysis, and stores results without failure.
{'pipeline_name': 'string', 'config': 'dict'}
{'status': 'success|failure', 'error_log': 'string (if failure)'}