Back to evaluations
Public evaluation
GenerateMarketingAsset
The evaluation will assess the system's ability to generate high-quality multimodal assets that accurately follow creative briefs, adhere to brand guidelines, and exhibit excellent text rendering within the image. It will use a combination of automated metrics and qualitative assessment.
Evaluation type
task based
Challenge
Multimodal Asset Generation
Difficulty
Advanced
Rigor
Unspecified
Evaluation overview
How the linked challenge is judged: tasks, benchmarks, and criteria count.
Tasks
1
Benchmarks
0
Criteria
0
Task templates
Inputs and expected outputs.
Task 1
GenerateMarketingAsset
Generate a marketing image with embedded text based on a detailed brief and brand guidelines.
Input format
{ "brief": "string", "brand_guidelines_doc": "string (path/URL to text doc)", "key_message": "string" }
Output format
{ "image_url": "string", "embedded_text_detected": "string", "metadata": {} }