Back to Prompt Library
testing

Set up Ax Experimentation

Inspect the original prompt language first, then copy or adapt it once you know how it fits your workflow.

Linked challenge: Secure Enterprise Financial Automation

Format
Text-first
Lines
1
Sections
1
Linked challenge
Secure Enterprise Financial Automation

Prompt source

Original prompt text with formatting preserved for inspection.

1 lines
1 sections
No variables
0 checklist items
Design and implement an Ax experiment to evaluate the robustness and accuracy of your 'Client Vetting Agent'. Define relevant parameters for the experiment (e.g., varying client data quality, presence of compliance red flags) and metrics to track (e.g., approval accuracy, false positive/negative rates). Set up the Ax experiment to run multiple trials and collect performance data. Provide code snippets for initializing and running an Ax experiment.

Adaptation plan

Keep the source stable, then change the prompt in a predictable order so the next run is easier to evaluate.

Keep stable

Preserve the rubric, target behavior, and pass-fail criteria as the baseline for evaluation.

Tune next

Adjust fixtures, mocks, and thresholds to the system under test instead of weakening the assertions.

Verify after

Make sure the prompt catches regressions instead of just mirroring the happy-path examples.