Skip to main content
Loading navigation
Back to prompt library

Implement Evaluation with Continue.dev

Linked challenge: Mathematical Proof Assistant

Prompt source

testing1 lines1 sectionsNo variables0 checklist items
Integrate Continue.dev to create an iterative testing loop for your proof assistant. Define test cases based on the provided `eval_data.json` (which contains new mathematical statements and their expected proofs/counter-examples). Use Continue.dev to automatically run tests against your LlamaIndex agent, compare generated proofs against ground truth, and report discrepancies. Focus on how Continue.dev helps in rapid iteration and debugging of agent behavior.