Back to Prompt Library
planning

DSPy Evaluation Pipeline Design

Inspect the original prompt language first, then copy or adapt it once you know how it fits your workflow.

Linked challenge: Hybrid Reasoning AI Evaluation Engine

Format
Text-first
Lines
1
Sections
1
Linked challenge
Hybrid Reasoning AI Evaluation Engine

Prompt source

Original prompt text with formatting preserved for inspection.

1 lines
1 sections
No variables
0 checklist items
Design a DSPy evaluation pipeline that can take an LLM's output and a corresponding benchmark question, then verify its factual accuracy using an external knowledge source (simulated via LlamaIndex RAG). Detail how DSPy modules will orchestrate calls to Gemini 2.5 Pro for verification and incorporate hybrid reasoning.

Adaptation plan

Keep the source stable, then change the prompt in a predictable order so the next run is easier to evaluate.

Keep stable

Preserve the role framing, objective, and reporting structure so comparison runs stay coherent.

Tune next

Swap in your own domain constraints, anomaly thresholds, and examples before you branch variants.

Verify after

Check whether the prompt asks for the right evidence, confidence signal, and escalation path.