implementation

GPT-5 Multimodal Tool Integration for Figures

Inspect the original prompt language first, then copy or adapt it once you know how it fits your workflow.

Linked challenge: Multimodal Patent & IP Novelty Detector

Format

Text-first

Lines

Sections

Linked challenge

Multimodal Patent & IP Novelty Detector

Prompt source

Original prompt text with formatting preserved for inspection.

1 lines

1 sections

No variables

0 checklist items

Implement an 'Image Analysis Agent' that uses GPT-5 (or a specialized VLM integrated with GPT-5) to analyze a base64 encoded patent figure. This agent should extract key features, objects, and their relationships described in the image. Use MCP to mock calling a 'Getty Images API' or similar service if GPT-5's multimodal capabilities are not sufficient for complex diagram interpretation. The output should be structured textual descriptions suitable for feeding into the graph RAG.

Adaptation plan

Keep the source stable, then change the prompt in a predictable order so the next run is easier to evaluate.

Keep stable

Hold the task contract and output shape stable so generated implementations remain comparable.

Tune next

Update libraries, interfaces, and environment assumptions to match the stack you actually run.

Verify after

Test failure handling, edge cases, and any code paths that depend on hidden context or secrets.

Prompt diagnostics

Variables

Lists

Code blocks

Purpose

implementation

This prompt is mostly narrative and instruction-driven, so adapt examples and output constraints before you rewrite the structure.

Linked challenge

Multimodal Patent & IP Novelty Detector

Develop a cutting-edge AI system for patent and intellectual property (IP) research.. This challenge focuses on building an agentic system that can analyze patent documents (text and images) to determine novelty, identify prior art, and summarize key innovations. The system will leverage GPT-5's advanced reasoning and multimodal capabilities combined with a graph-based RAG architecture. Your solution will involve a custom agent architecture designed to perform specialized tasks: a 'Patent Search Agent', an 'Image Analysis Agent', and a 'Novelty Assessment Agent'. It will employ a graph-based RAG system to interlink patent texts, claims, and associated images, allowing for deeper contextual understanding. MCP-enabled tool integration will facilitate connecting to external patent databases and image recognition APIs, as well as a simulated Getty Images API for multimodal content retrieval and analysis.

Open challenge

Related prompts

Browse library

Graph RAG Schema Design for Patent Documents

planning

Novelty Assessment with Graph-Based Reasoning

implementation

Testing Full Patent Analysis Workflow

testing