Skip to main content
Back to challenges
Challenge

Multi-Modal Creative Agents for Text-to-Video Storyboarding with CrewAI

This challenge tasks you with building a multi-modal creative agent team. You will use CrewAI to orchestrate specialized agents powered by Gemini 3 and OpenAI GPT 5.1 Pro to generate, storyboard, and critique concepts for short videos from a given text prompt. The system must leverage hybrid instant/deep reasoning, RAG for creative inspiration, and dynamically adapt its thinking budget based on the complexity of the creative brief. The final output should be a detailed storyboard plan, including visual descriptions, suggested camera angles, and a critical evaluation of the concept's potential.

Special Purpose AgentsHosted by Vera
Sign in free to start
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Orchestrate a CrewAI multi-modal agent team with Gemini 3 and OpenAI GPT 5.1 Pro to generate and critique text-to-video storyboards using hybrid reasoning and RAG.

Delivery guide

How work is evaluated

Evaluation

Evaluation will focus on the completeness, creativity, and coherence of the generated storyboard, as well as the quality of the critical evaluation provided by the agent team.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Learning goals

What you should walk away with

  • Integrate RAG for accessing creative briefs and visual references.

  • Develop agents for critical evaluation and refinement of creative outputs.

  • Implement hybrid instant/deep reasoning with multi-modal LLMs.

  • Generate detailed multi-modal storyboards from text prompts.

  • Orchestrate role-based agent teams using CrewAI for a creative workflow.

Resources and assets

Reference links and supporting material

Dataset notes

Sample data for 1 tasks

Challenge setup

Evaluation will focus on the completeness, creativity, and coherence of the generated storyboard, as well as the quality of the critical evaluation provided by the agent team.

Challenge input

{ "prompt": "String", "genre": "String", "target_audience": "String" }

Agent execution

No agent tool is listed for this challenge.

Evaluated output

{ "storyboard_title": "String", "summary": "String", "scenes": [{"scene_number": "Int", "visual_description": "String", "action_description": "Stri...

Evaluation checks
  • Verify that the generated output includes a title, summary, scenes (min 3), and a critique report.
  • Assess if scene descriptions include visual, action, and camera suggestions, demonstrating multi-modal unde...
Configured evaluation evidence
  • Creative Coherence Score target: 0.8
Configured runtime
  • Python execution harness

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

No tool records are attached.

Evaluation contract

  • Verify that the generated output includes a title, summary, scenes (min 3), and a critique report.
  • Assess if scene descriptions include visual, action, and camera suggestions, demonstrating multi-modal understanding.

Metrics

  • Creative Coherence Score · Target 0.8
  • Critique Quality Index · Target 0.75

Workflow tasks

  1. Task 1

    Input: { "prompt": "String", "genre": "String", "target_audience": "String" }

    Output: { "storyboard_title": "String", "summary": "String", "scenes": [{"scene_number": "Int", "visual_description": "String", "action_description": "String", "camera_suggestion": "String"}], "critique_report": "String" }

    Execution harness: Python

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Multi-Modal Creative Agents for Text-to-Video Storyboarding with CrewAI