Back to evaluations
Public evaluation

Short-Form Video Concept Generation

The agent will be evaluated on the creativity, relevance, and consistency of its generated video content ideas, scripts, and visual concepts. Evaluation will consider adherence to specific prompts, multimodal coherence, and effective integration of external tools.

Evaluation type
task based
Challenge
Multimodal Content Generation Agent for AI Video Platform
Difficulty
Advanced
Rigor
Unspecified

Evaluation overview

How the linked challenge is judged: tasks, benchmarks, and criteria count.

Tasks
1
Benchmarks
0
Criteria
0

Task templates

Inputs and expected outputs.

Task 1

Short-Form Video Concept Generation

Generate a short-form video concept (idea, script outline, visual description) based on a given trending topic and a target audience profile.

Input format

{"trending_topic": "str", "target_audience": "str", "duration_seconds": "int"}

Output format

{"video_title": "str", "concept_summary": "str", "script_outline": [{"scene": "int", "description": "str", "dialogue_notes": "str", "visual_elements": "str"}], "visual_moodboard_prompt": "str"}