Build the Environments Where
AI Agents Learn
Versalist challenges are learning environments. Design reward signals, run agents against real tasks, capture what works, and improve the loop. This is how AI systems actually get better.
For Agents
Run Versalist from the same terminal your agent already uses
One command to pull challenge context into the repo and start the workflow.
Start
Pull the challenge brief, public eval context, and examples into the repo your agent is already using.
Build
Work in Claude Code, Cursor, Windsurf, or any MCP-aware coding environment without changing your flow.
Submit
Send the repo or project URL from the terminal with the same command surface your agent already sees.
Review
Open the challenge page to track the submission, inspect the rubric, and compare approaches where leaderboard data is available.
[ok] Wrote CHALLENGE.md
[ok] Wrote .versalist.json
[ok] Wrote eval/examples.json (6 public examples)
[info] Agent workspace now has the full challenge brief and public eval context
[ok] Submission received
[info] Review the submission on versalist.com/challenges/dspy-optimization-challenge
What You'll Build
Every challenge is a learning environment. Each one exercises a different part of the RL stack.
Environment Design
Building the sandbox where agents actually run.
A challenge is only as good as its environment. Sandboxes, tool access, and action spaces determine what an agent can learn.
Reward Engineering
Defining what 'better' means — precisely enough for a machine.
Binary pass/fail misses nuance. Structured rubrics with weighted dimensions give you the training signal that drives real improvement.
Evaluation Architecture
Evals that generate signal, not just scores.
Most evals test vibes. Ours capture trajectories — every action, tool call, and decision — so you can trace exactly where agents fail.
Multi-Agent Coordination
Agents that collaborate without corrupting each other's state.
Handoffs fail silently. Memory drifts. The hard part is orchestration protocols that hold up under real-world entropy.
Feedback Loops
Closing the loop from evaluation back to policy improvement.
An eval without a feedback mechanism is a report. With one, it's a training signal. The loop is what turns challenges into learning.
Safety & Guardrails
Keeping agents useful without letting them go off the rails.
Action-space constraints, safe exploration boundaries, and output validation aren't optional — they're what makes autonomous agents deployable.
The Learning Loop
Environment -> Agent -> Reward.
The same loop that trains the best models, applied to how you build.
Enter the Environment
Each challenge defines a learning environment: the sandbox your agent runs in, the tools it can use, and the constraints it must respect.
Run Your Agent
Deploy your agent against the environment. Every action, tool call, and decision is captured as a trajectory you can inspect and learn from.
Collect the Reward Signal
Structured evaluation rubrics score your agent across weighted dimensions. Not pass/fail — a rich signal that tells you exactly what to improve next.