Skip to main content
Loading navigation
Back to prompt library

Evaluation Harness Integration

Linked challenge: Agent for Robotaxi Safety Policy Analysis & Dynamic Procedure Generation

Prompt source

testing1 lines1 sectionsNo variables0 checklist items
Describe how you would integrate an evaluation harness (like a custom Python script or LangChain Eval) to automatically test the safety and compliance of the generated procedures. Focus on defining metrics for correctness, specificity, and adherence to regulatory standards. Provide a conceptual outline or pseudo-code for a test function that would check if a generated procedure addresses a specific identified root cause or complies with a new regulation.