Skip to main content
Versalist guides
6 public guides
2 tracks

Guides for verified agent changes

Define the task, keep the evaluation contract stable, inspect the evidence, and record the release decision. Each guide supports part of the closed agent-improvement loop.

Evaluation systems
Agent Evaluation

Start here when a score cannot show whether an agent change is safe.

Change discipline
Prompt and Policy Changes

Use this track before you publish a new instruction, dataset, or policy revision.

Evaluation systems
4 guides

Evaluation systems guides

Define tasks, run agents, grade results, inspect failures, and control changes.

Best for

Teams that need reproducible evidence before an agent change reaches production.

Suggested entry
Agent Evaluation

Start here when a score cannot show whether an agent change is safe.

Start with this guide
StarterReference guideLanguage modelsTerminology

Language Model Quick Reference

Read a short reference for language model terms.

Best for

Readers who need a reference for language model concepts.

Outcome

Understand common terms before you define an agent evaluation.

Prerequisites
You leave with
Reference notes
Guide content
Open guide
StarterCore guideContractsGraders

Agent Evaluation

Build an evaluation contract that links tasks, graders, run conditions, and release decisions.

Best for

Teams replacing informal output review with repeatable evaluation evidence.

Outcome

Create a repeatable release gate for one agent behavior.

Prerequisites
One repeatable agent taskRepresentative test cases
You leave with
Evaluation contractGrader planRelease decision
Task versionsRubric versionsEpisode results
Open guide
IntermediatePlatform guideTask designHidden cases

Challenge Design

Turn a real agent task into a versioned Challenge with public and hidden cases.

Best for

Operators who create public or private agent evaluations.

Outcome

Write a Challenge specification that can detect useful agent differences.

Prerequisites
Target agent behaviorKnown failure examples
You leave with
Challenge contractCase splitScoring plan
Challenge versionsGold itemsRubric versions
Open guide
AdvancedResearch guideTrajectoriesReward signals

Agentic Reinforcement Fine-Tuning

Prepare trajectory evidence for reinforcement fine-tuning without overstating current trace coverage.

Best for

Teams that can reproduce and grade multi-step agent behavior.

Outcome

Decide whether your evaluation data is ready for an Agentic RFT experiment.

Prerequisites
Stable task contractValidated gradersReproducible Episodes
You leave with
Readiness checkReward planExperiment boundary
Episode identityStep resultsReward evidence
Open guide
Change discipline
2 guides

Change discipline guides

Treat prompts, data, and policy instructions as versioned agent components.

Best for

Teams that improve agents and need proof against regressions.

Suggested entry
Prompt and Policy Changes

Use this track before you publish a new instruction, dataset, or policy revision.

Start with this guide

Stay connected

More ways to learn and collaborate with Versalist

  • Need help?

    Contact Support

    Share feedback or get in touch with our team.

  • Want early access?

    Join the waitlist

    Be the first to try upcoming features and tooling.

  • Product updates

    Read the changelog

    Catch up on the latest improvements to Versalist.

  • Questions about pricing?

    Talk to sales

    Start a conversation about plans and enterprise needs.

  • New to large language models?

    Explore LLM Fundamentals

    Learn the core concepts in our beginner-friendly guide.

Newsletter updates

Stay in the loop

Subscribe for weekly product updates, guides, and curated AI resources.

You can unsubscribe at any time. We respect your privacy.

More guides

Keep going