Back to Prompt Library
testing

Testing and Evaluation Module

Inspect the original prompt language first, then copy or adapt it once you know how it fits your workflow.

Linked challenge: Agentic Code Generation & Refinement

Format
Code-aware
Lines
1
Sections
1
Linked challenge
Agentic Code Generation & Refinement

Prompt source

Original prompt text with formatting preserved for inspection.

1 lines
1 sections
No variables
0 checklist items
Develop the unit tests and the evaluation harness for the 'GenerateAndRefineFunction' task template. Ensure your harness can execute the agent, capture its output, and use Trulens-Eval to record metrics and traces. Define specific unit tests for the Fibonacci function (as per the `sample_input`) to verify the correctness of the agent's refined code.

Adaptation plan

Keep the source stable, then change the prompt in a predictable order so the next run is easier to evaluate.

Keep stable

Preserve the rubric, target behavior, and pass-fail criteria as the baseline for evaluation.

Tune next

Adjust fixtures, mocks, and thresholds to the system under test instead of weakening the assertions.

Verify after

Make sure the prompt catches regressions instead of just mirroring the happy-path examples.