Skip to main content
Back to challenges
Challenge

Craft Generative AI for User Generated Content

Inspired by vision to include generative AI-powered user-generated content (UGC), this challenge tasks participants with building a sophisticated multi-agent system for creating, moderating, and personalizing short-form multimodal content. The system will employ Claude Opus 4.1 for its advanced creative generation and nuanced ethical reasoning capabilities, ensuring content aligns with user defined brand safety and creative guidelines. LangGraph will be used to orchestrate a dynamic, graph-based workflow for content generation, review, and iteration. This will include agents specializing in ideation, multimodal asset generation (text-to-video/image), and a crucial moderation agent that applies 'Guidance' for constrained generation, ensuring content adheres to specific brand safety and thematic rules. The challenge emphasizes balancing creative freedom with strict content policy enforcement.

Workflow AutomationHosted by Vera
Sign in free to start
Challenge brief

What you are building

The core problem, expected build, and operating context for this challenge.

Develop a LangGraph-orchestrated multi-agent system using Claude Opus 4.1 and Guidance for generating and moderating multimodal UGC.

Delivery guide

How work is evaluated

Evaluation

The evaluation will focus on the system's ability to generate high-quality, Disney-appropriate multimodal content while strictly adhering to moderation guidelines. It will assess the LangGraph workflow's efficiency and the effectiveness of Guidance in enforcing constraints.

Datasets

Challenge datasets

Public datasets, plus the private datasets you have access to.

Learning goals

What you should walk away with

  • Implement multimodal content generation (text, image, short video) using Claude Opus 4.1 and Llama 4.

  • Utilize Guidance to enforce brand safety and thematic constraints during content generation and review.

  • Orchestrate a multi-agent system for iterative content refinement and automated moderation against Disney+ guidelines.

  • Design a LangGraph workflow for generative AI content creation and moderation.

Resources and assets

Reference links and supporting material

Dataset notes

Sample data for 2 tasks

Challenge setup

The evaluation will focus on the system's ability to generate high-quality, brand-appropriate multimodal content while strictly adhering to moderation guidelines. It will assess the LangGraph workflow's efficiency and...

Challenge input

{ 'user_prompt': 'A cheerful short story about Mickey Mouse discovering a hidden magical garden.' }

Agent execution

No agent tool is listed for this challenge.

Evaluated output

{ 'generated_text': '...', 'generated_image_url': '...', 'video_concept': '...', 'moderation_status': 'approved|rejected', 'moderation_report': '.....

Evaluation checks
  • The LangGraph workflow completes successfully, generating and moderating content without errors.
  • The moderation agent correctly flags at least 80% of intentionally violating content using Guidance.
  • Generated content adheres to general family-friendly and positive themes.
Configured evaluation evidence
  • Creative Diversity target: 0.7
Configured runtime
  • Python execution harness

Summary shows the first task, up to three tools, and up to three evidence items. Open the technical recipe to view all configured items.

View technical recipe

Configured tools

No tool records are attached.

Evaluation contract

  • The LangGraph workflow completes successfully, generating and moderating content without errors.
  • The moderation agent correctly flags at least 80% of intentionally violating content using Guidance.
  • Generated content adheres to general family-friendly and positive themes.

Metrics

  • Creative Diversity · Target 0.7
  • Constraint Efficacy · Target 0.85

Workflow tasks

  1. Task 1

    Input: { 'user_prompt': 'A cheerful short story about Mickey Mouse discovering a hidden magical garden.' }

    Output: { 'generated_text': '...', 'generated_image_url': '...', 'video_concept': '...', 'moderation_status': 'approved|rejected', 'moderation_report': '...' }

    Execution harness: Python

  2. Task 2

    Input: { 'content_to_moderate': {'text': '...', 'image_concept': '...', 'video_concept': '...'}, 'rules': ['no violence', 'no copyrighted characters not from IP owners'] }

    Output: { 'violations_detected': ['rule_id_1'], 'justification': '...' }

    Execution harness: JavaScript

Recipe freeze marker

No recipe freeze time is recorded.

Frequently Asked Questions about Craft Generative AI for User Generated Content