Back to prompt library
Implement Evaluation with Continue.dev
Linked challenge: Mathematical Proof Assistant
Prompt source
testing1 lines1 sectionsNo variables0 checklist items
Integrate Continue.dev to create an iterative testing loop for your proof assistant. Define test cases based on the provided `eval_data.json` (which contains new mathematical statements and their expected proofs/counter-examples). Use Continue.dev to automatically run tests against your LlamaIndex agent, compare generated proofs against ground truth, and report discrepancies. Focus on how Continue.dev helps in rapid iteration and debugging of agent behavior.