Multimodal Patent & IP Novelty Detector
Develop a cutting-edge AI system for patent and intellectual property (IP) research.. This challenge focuses on building an agentic system that can analyze patent documents (text and images) to determine novelty, identify prior art, and summarize key innovations. The system will leverage GPT-5's advanced reasoning and multimodal capabilities combined with a graph-based RAG architecture. Your solution will involve a custom agent architecture designed to perform specialized tasks: a 'Patent Search Agent', an 'Image Analysis Agent', and a 'Novelty Assessment Agent'. It will employ a graph-based RAG system to interlink patent texts, claims, and associated images, allowing for deeper contextual understanding. MCP-enabled tool integration will facilitate connecting to external patent databases and image recognition APIs, as well as a simulated Getty Images API for multimodal content retrieval and analysis.
What you are building
The core problem, expected build, and operating context for this challenge.
Develop a cutting-edge AI system for patent and intellectual property (IP) research.. This challenge focuses on building an agentic system that can analyze patent documents (text and images) to determine novelty, identify prior art, and summarize key innovations. The system will leverage GPT-5's advanced reasoning and multimodal capabilities combined with a graph-based RAG architecture. Your solution will involve a custom agent architecture designed to perform specialized tasks: a 'Patent Search Agent', an 'Image Analysis Agent', and a 'Novelty Assessment Agent'. It will employ a graph-based RAG system to interlink patent texts, claims, and associated images, allowing for deeper contextual understanding. MCP-enabled tool integration will facilitate connecting to external patent databases and image recognition APIs, as well as a simulated Getty Images API for multimodal content retrieval and analysis.
Shared data for this challenge
Review public datasets and any private uploads tied to your build.
What you should walk away with
Master GPT-5's advanced reasoning, summarization, and multimodal understanding capabilities for comprehensive patent analysis and novelty detection.
Implement a graph-based RAG architecture, where patent documents, claims, entities, and associated images are nodes, and relationships (citations, 'contains image', 'describes feature') are edges, for deep contextual retrieval.
Build MCP-enabled tool integration with external patent search APIs (e.g., USPTO, EPO) and simulated image recognition services (like a Getty Images API for image context).
Develop multimodal agents that can process both patent text and embedded diagrams/schematics, using GPT-5 (or an integrated vision model) to extract features and understand visual context.
Design and train embedding models for both textual and visual patent content to populate the graph-based vector store for efficient RAG.
Create a 'Novelty Assessment Agent' that combines insights from text and image analysis to identify prior art, potential infringements, and the unique aspects of a given invention.
Orchestrate a workflow where agents collaborate: a 'Patent Search Agent' retrieves relevant documents, an 'Image Analysis Agent' extracts visual insights, and a 'Novelty Assessment Agent' synthesizes findings.
[ok] Wrote CHALLENGE.md
[ok] Wrote .versalist.json
[ok] Wrote eval/examples.json
Requires VERSALIST_API_KEY. Works with any MCP-aware editor.
DocsAI Research & Mentorship
Participation status
You haven't started this challenge yet
Operating window
Key dates and the organization behind this challenge.
Find another challenge
Jump to a random challenge when you want a fresh benchmark or a different problem space.