Multi-Modal Image Editing Agent
This challenge involves building an advanced, multi-modal AI agent system capable of interpreting complex text and voice prompts to perform sophisticated image editing operations. The system will leverage a graph-based workflow to break down high-level requests into a sequence of atomic image manipulation tasks, executing them via integrated tools. Developers will focus on enabling 'extended thinking' within the agent to handle nuanced instructions, ensuring iterative refinement and adaptive problem-solving during the editing process. This project requires designing a robust LangGraph state machine that manages the image editing pipeline. The core agent, powered by Gemini 2.5 Pro, will interpret multi-modal input, generate intermediate editing plans, and dynamically select and invoke image manipulation tools. The challenge emphasizes creating a seamless user experience where text or voice commands translate into visually stunning, refined image outputs through intelligent agent orchestration and tool integration.
What you are building
The core problem, expected build, and operating context for this challenge.
This challenge involves building an advanced, multi-modal AI agent system capable of interpreting complex text and voice prompts to perform sophisticated image editing operations. The system will leverage a graph-based workflow to break down high-level requests into a sequence of atomic image manipulation tasks, executing them via integrated tools. Developers will focus on enabling 'extended thinking' within the agent to handle nuanced instructions, ensuring iterative refinement and adaptive problem-solving during the editing process. This project requires designing a robust LangGraph state machine that manages the image editing pipeline. The core agent, powered by Gemini 2.5 Pro, will interpret multi-modal input, generate intermediate editing plans, and dynamically select and invoke image manipulation tools. The challenge emphasizes creating a seamless user experience where text or voice commands translate into visually stunning, refined image outputs through intelligent agent orchestration and tool integration.
Shared data for this challenge
Review public datasets and any private uploads tied to your build.
What you should walk away with
Master LangGraph for building stateful, cyclic agent workflows with dynamic tool invocation and decision nodes.
Implement multi-modal input processing with Gemini 2.5 Pro, leveraging its advanced understanding for image editing directives.
Design and develop robust tool integration via function calling, connecting the agent to external image processing libraries (e.g., OpenCV, Pillow) or simulated APIs.
Build 'extended thinking' pipelines using Gemini 2.5 Pro's capabilities for iterative self-correction and adaptive reasoning in complex generative tasks.
Orchestrate agent-to-tool communication patterns for efficient and reliable execution of image manipulation commands.
Deploy the agent system in a local environment, demonstrating multi-modal interaction and visual output generation.
How this agent runs
The evaluation assesses the agent's ability to interpret multi-modal prompts, generate accurate editing plans, successfully execute tools, and produce high-quality image edits.
Challenge input
{'prompt': 'string', 'image_path': 'string'}
Agent execution
The configured agent processes the input under the challenge policy.
Evaluated output
{'edited_image_path': 'string', 'final_plan': 'list of strings'}
- Checks if an output image file is successfully generated for each task.
- Verifies that the generated plan aligns logically with the input prompt.
- VisualQualityScore target: 8
- Python execution harness
View technical recipe
Configured tools
No tool records are attached.
Evaluation contract
- The evaluation module defines the checks.
Recipe state
This is a preview. The configuration can change before the evaluation recipe is locked.
Run this agent on your dataset
Versalist can run this agent on your behalf with your data. Tell us about your dataset and the result you need.
Discuss your dataset[ok] Wrote CHALLENGE.md
[ok] Wrote .versalist.json
[ok] Wrote eval/examples.json
Requires VERSALIST_API_KEY. Works with any MCP-aware editor.
DocsFind another challenge
Jump to a random challenge when you want a fresh benchmark or a different problem space.