Back to Prompt Library
testing
Evaluation Harness Integration
Inspect the original prompt language first, then copy or adapt it once you know how it fits your workflow.
Linked challenge: Agent for Robotaxi Safety Policy Analysis & Dynamic Procedure Generation
Format
Code-aware
Lines
1
Sections
1
Linked challenge
Agent for Robotaxi Safety Policy Analysis & Dynamic Procedure Generation
Prompt source
Original prompt text with formatting preserved for inspection.
1 lines
1 sections
No variables
0 checklist items
Describe how you would integrate an evaluation harness (like a custom Python script or LangChain Eval) to automatically test the safety and compliance of the generated procedures. Focus on defining metrics for correctness, specificity, and adherence to regulatory standards. Provide a conceptual outline or pseudo-code for a test function that would check if a generated procedure addresses a specific identified root cause or complies with a new regulation.
Adaptation plan
Keep the source stable, then change the prompt in a predictable order so the next run is easier to evaluate.
Keep stable
Preserve the rubric, target behavior, and pass-fail criteria as the baseline for evaluation.
Tune next
Adjust fixtures, mocks, and thresholds to the system under test instead of weakening the assertions.
Verify after
Make sure the prompt catches regressions instead of just mirroring the happy-path examples.