Agent Building
Advanced
Always open

Prediction Market Intelligence System

The world of prediction markets like Kalshi and Polymarket offers unique insights into public sentiment and future events. This challenge tasks you with creating a multi-agent system using CrewAI that autonomously researches, analyzes, and synthesizes information about prediction market trends, trader behavior, and potential profitability patterns. The system should generate actionable market intelligence reports on specific market categories or recent events. You will define distinct roles for your agents (e.g., 'Market Data Analyst', 'Trend Spotter', 'Report Generator'), assign them specific goals, and enable them to collaborate effectively. The system will leverage Gemini 2.5 Pro for its advanced analytical capabilities and integrate tools for data retrieval and report generation, presenting findings through an intuitive interface.

Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

The world of prediction markets like Kalshi and Polymarket offers unique insights into public sentiment and future events. This challenge tasks you with creating a multi-agent system using CrewAI that autonomously researches, analyzes, and synthesizes information about prediction market trends, trader behavior, and potential profitability patterns. The system should generate actionable market intelligence reports on specific market categories or recent events. You will define distinct roles for your agents (e.g., 'Market Data Analyst', 'Trend Spotter', 'Report Generator'), assign them specific goals, and enable them to collaborate effectively. The system will leverage Gemini 2.5 Pro for its advanced analytical capabilities and integrate tools for data retrieval and report generation, presenting findings through an intuitive interface.

Datasets

Shared data for this challenge

Review public datasets and any private uploads tied to your build.

Loading datasets...
Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks, how much each dimension matters, and which criteria separate a passable run from a strong one.

Max Score: 5
Dimensions
5 scoring checks
Binary
5 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1report_format_adherence

Report Format Adherence

Generated report adheres to the specified JSON structure.

binary
Weight: 1
Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2agent_workflow_completion

Agent Workflow Completion

All defined agent tasks in the crew are completed.

binary
Weight: 1
Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 3report_factual_accuracy

Report Factual Accuracy

Percentage of statements in the report that are factually correct based on mock data. • target: 90 • range: 0-100

binary
Weight: 1
Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 4insight_generation_quality

Insight Generation Quality

Rating of the depth and novelty of insights provided. • target: 4 • range: 1-5

binary
Weight: 1
Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 5collaboration_coherence

Collaboration Coherence

Smoothness and logical flow of agent handoffs and information exchange. • target: 4.5 • range: 1-5

binary
Weight: 1
Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

Master CrewAI's core concepts: Agents, Tasks, Tools, and the Crew for building robust, collaborative multi-agent systems.

Implement specialized agents with distinct roles (e.g., MarketDataFetcher, BehavioralAnalyst, ReportSynthesizer) and assign them specific goals using CrewAI.

Design custom tools for agents to interact with a simulated prediction market API, fetching historical data, current odds, and trader statistics.

Leverage Gemini 2.5 Pro as the primary reasoning engine for complex market trend analysis and nuanced report generation within agent tasks.

Deploy and manage specialized analytical models or faster inference needs using RunPod for efficient real-time data processing.

Integrate Hume AI to provide an intuitive voice interface for users to submit queries and receive audio summaries of generated market intelligence reports.

Orchestrate sequential and parallel agent tasks to build a comprehensive market intelligence workflow.

Start from your terminal
$npx -y @versalist/cli start prediction-market-intelligence-system

[ok] Wrote CHALLENGE.md

[ok] Wrote .versalist.json

[ok] Wrote eval/examples.json

Requires VERSALIST_API_KEY. Works with any MCP-aware editor.

Docs
Manage API keys
Challenge at a glance
Host and timing
Vera

AI Research & Mentorship

Starts Available now
Evergreen challenge
Your progress

Participation status

You haven't started this challenge yet

Timeline and host

Operating window

Key dates and the organization behind this challenge.

Start date
Available now
Run mode
Evergreen challenge
Explore

Find another challenge

Jump to a random challenge when you want a fresh benchmark or a different problem space.

Useful when you want to pressure-test your workflow on a new dataset, new constraints, or a new evaluation rubric.

Tool Space Recipe

Draft
Evaluation
Rubric: 5 dimensions
·Report Format Adherence(1%)
·Agent Workflow Completion(1%)
·Report Factual Accuracy(1%)
·Insight Generation Quality(1%)
·Collaboration Coherence(1%)
Gold items: 2 (2 public)

Frequently Asked Questions about Prediction Market Intelligence System