Workflow Automation
Advanced
Always open

Real-time Weather Prediction Agents

This challenge requires you to build a multi-agent system using CrewAI for real-time weather forecasting. Your system will simulate processing continuous streams of satellite telemetry and sensor data via Apache Kafka. A team of specialized agents, powered by Gemini 2.5 Pro for data analysis and reasoning, will collaborate to perform data ingestion, pattern recognition, predictive modeling, and alert generation. The focus is on orchestrating complex, asynchronous workflows where agents manage data integrity, learn from historical patterns, and provide actionable weather insights with low latency.

Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

This challenge requires you to build a multi-agent system using CrewAI for real-time weather forecasting. Your system will simulate processing continuous streams of satellite telemetry and sensor data via Apache Kafka. A team of specialized agents, powered by Gemini 2.5 Pro for data analysis and reasoning, will collaborate to perform data ingestion, pattern recognition, predictive modeling, and alert generation. The focus is on orchestrating complex, asynchronous workflows where agents manage data integrity, learn from historical patterns, and provide actionable weather insights with low latency.

Datasets

Shared data for this challenge

Review public datasets and any private uploads tied to your build.

Loading datasets...
Evaluation rubric

How submissions are scored

These dimensions define what the evaluator checks, how much each dimension matters, and which criteria separate a passable run from a strong one.

Max Score: 4
Dimensions
4 scoring checks
Binary
4 pass or fail dimensions
Ordinal
0 scaled dimensions
Dimension 1kafkadataingestion

KafkaDataIngestion

Verify that the agent system successfully consumes data from the specified Kafka topic.

binary
Weight: 1
Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 2forecastcompleteness

ForecastCompleteness

Ensure a 24-hour forecast is generated without missing data points.

binary
Weight: 1
Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 3forecastaccuracy_rmse

ForecastAccuracy (RMSE)

Root Mean Square Error for temperature predictions compared to ground truth, lower is better. • target: 1.5 • range: 0-5

binary
Weight: 1
Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Dimension 4processinglatency

ProcessingLatency

Average time taken from data ingestion to forecast output, lower is better. • target: 200 • range: 0-500

binary
Weight: 1
Binary check

This dimension contributes its full weight only when the submission satisfies the requirement. Partial credit is not awarded.

Learning goals

What you should walk away with

Master CrewAI for defining roles, goals, tasks, and tools for collaborative AI agents.

Implement real-time data ingestion pipelines using Apache Kafka for high-throughput sensor data.

Design a 'Data Analyst' agent leveraging Gemini 2.5 Pro's capabilities for complex pattern recognition in meteorological data.

Develop a 'Predictive Modeler' agent responsible for running forecasting models and updating predictions based on new data.

Integrate Weights & Biases (W&B) for tracking model experiments, managing different forecasting models, and monitoring their performance.

Deploy a simulated inference endpoint using Cerebras Inference for serving weather prediction models with low latency.

Orchestrate an end-to-end workflow where agents automatically detect anomalies, generate forecasts, and publish alerts.

Start from your terminal
$npx -y @versalist/cli start real-time-weather-prediction-agents

[ok] Wrote CHALLENGE.md

[ok] Wrote .versalist.json

[ok] Wrote eval/examples.json

Requires VERSALIST_API_KEY. Works with any MCP-aware editor.

Docs
Manage API keys
Challenge at a glance
Host and timing
Vera

AI Research & Mentorship

Starts Available now
Evergreen challenge
Your progress

Participation status

You haven't started this challenge yet

Timeline and host

Operating window

Key dates and the organization behind this challenge.

Start date
Available now
Run mode
Evergreen challenge
Explore

Find another challenge

Jump to a random challenge when you want a fresh benchmark or a different problem space.

Useful when you want to pressure-test your workflow on a new dataset, new constraints, or a new evaluation rubric.

Tool Space Recipe

Draft
Evaluation
Rubric: 4 dimensions
·KafkaDataIngestion(1%)
·ForecastCompleteness(1%)
·ForecastAccuracy (RMSE)(1%)
·ProcessingLatency(1%)
Gold items: 1 (1 public)

Frequently Asked Questions about Real-time Weather Prediction Agents