Back to Prompt Library
deployment

Orchestrate Evaluation Workflow with Prefect

Inspect the original prompt language first, then copy or adapt it once you know how it fits your workflow.

Linked challenge: Automated Generative AI Model Evaluation

Format
Text-first
Lines
1
Sections
1
Linked challenge
Automated Generative AI Model Evaluation

Prompt source

Original prompt text with formatting preserved for inspection.

1 lines
1 sections
No variables
0 checklist items
Design and implement a `Prefect` flow that orchestrates the entire evaluation process. This flow should trigger an evaluation run, pass input to your `CrewAI` team, collect results, and ensure all data is logged to `MLflow`. Demonstrate scheduling and error handling within the `Prefect` workflow.

Adaptation plan

Keep the source stable, then change the prompt in a predictable order so the next run is easier to evaluate.

Keep stable

Preserve the source structure until you know which part of the prompt is actually driving the result quality.

Tune next

Change domain facts, examples, and tool context first before you rewrite the instruction scaffold.

Verify after

Validate one failure mode at a time so prompt changes stay attributable instead of getting noisy.