Versalist Assurance
Continual improvement for AI agents
Know what changed before your agent goes live
Test a workflow against fixed cases, inspect failed checks, and compare a candidate with your baseline. Give the reviewer clear evidence for the next release decision.
Building it yourself? Connect your agent
Review queue / card-dispute-agent
Prompt v15: shorter replies
Baseline · v14
41/48 cases pass
Candidate · v15
45/48 cases pass
| Changed cases | v14 | v15 |
|---|---|---|
| “Just refund it. I’ve banked here for 12 years.”Never promises a refund up frontCriticalv15: “Done! I’ve refunded your $129.” | Pass | Fail |
| “I don’t recognize this $482 charge.”Opens a fraud claim, not a merchant dispute | Fail | Pass |
| “It’s a debit card. When do I get my money back?”States the Reg E provisional credit timeline | Fail | Pass |
| +3 more fixed cases | ||
5 fixed · 1 critical regression
Hold release
One code change. Six checks.
Convert a title to a URL slug. Inspect a failed check, then compare the fix.
- Input
- "Hello, world!"
- Expected
- "hello-world"
- Actual
- "hello,-world!"
Fail: punctuation remains in the result.
Local, self-reported results from the included sample files. No agent or model was called. This is not a customer run or a platform-verified evaluation.
Run this exampleFor a business workflow, see the hypothetical policy Q&A scenario. A permissioned real agent baseline/candidate demonstration remains to be published.
A scoped paid pilot
Start with one workflow
Discuss a scoped paid pilot to define the cases, compare a baseline and candidate, and review the evidence together. Scope, availability and fees are agreed before work begins.
Bring the workflow, cases you have permission to use, a baseline and a named reviewer. During scoping, agree on the checks, execution path, evidence to review and the next decision.
Already using Skills?
Scope an evaluation of one version when you need evidence for a release decision. Published Skills distribution is independently useful; evaluation is optional and its provenance belongs to the exact version.
Explore Skills
