Public evaluation

Geopolitical Impact Assessment

The system must accurately identify a geopolitical risk and update a commodity security score.

Evaluation type

task based

Challenge

Build a Mineral Supply Chain Risk Agent

Difficulty

Advanced

Rigor

Unspecified

Open linked challenge

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks

Benchmarks

Criteria

Task templates

Inputs and expected outputs.

Task 1

Geopolitical Impact Assessment

Evaluate the agent's ability to adjust the security score of Copper after a simulated policy change in Chile.

Input format

JSON object with commodity name and a simulated news headline

Output format

JSON object with updated Risk Score and Arize trace ID

Linked challenge

Build a Mineral Supply Chain Risk Agent

The US government is implementing a new strategy in Latin America to secure critical minerals like copper and rare earths, as evidenced by the $1.6B deal for USA Rare Earth and Ivanhoe's Chilean exploration. In this challenge, you will build an autonomous Supply Chain Intelligence Agent using the Mastra AI framework. The agent must orchestrate a RAG-based workflow that monitors mining news, identifies geopolitical risks in specific jurisdictions (e.g., Chile, Venezuela), and calculates a 'Supply Security Score' for specific commodities. You will integrate Arize AI to provide observability into the agent's decision-making process. Mastra AI's built-in memory will be used to track the evolution of mining M&A trends (like Zijin's $4B Allied Gold acquisition), while Arize AI will monitor for hallucinations or drift in the risk scoring logic. The final system should provide actionable alerts for supply chain managers when policy shifts or price surges (like Gold's recent warning signal) indicate impending volatility.

Open challenge