Recommender Multi-Agent for Complex Suggestions
This challenge tasks you with building a cutting-edge multi-agent recommendation system using CrewAI. Your system will leverage GPT-5 for highly creative and nuanced recommendation generation, supported by Claude Sonnet 4 for robust information retrieval and synthesis. Agents will collaborate to understand complex user intent, retrieve obscure related data via RAG, and generate highly personalized, multi-faceted recommendations for music or other domains. A critical component is the integration of MCP-enabled tools to access external data sources (e.g., music catalogs, user preference databases, external reviews) to enrich the recommendation process and provide context beyond the LLM's initial training data. The system must demonstrate advanced extended thinking capabilities, adapting its reasoning budget based on recommendation complexity.
What you are building
The core problem, expected build, and operating context for this challenge.
This challenge tasks you with building a cutting-edge multi-agent recommendation system using CrewAI. Your system will leverage GPT-5 for highly creative and nuanced recommendation generation, supported by Claude Sonnet 4 for robust information retrieval and synthesis. Agents will collaborate to understand complex user intent, retrieve obscure related data via RAG, and generate highly personalized, multi-faceted recommendations for music or other domains. A critical component is the integration of MCP-enabled tools to access external data sources (e.g., music catalogs, user preference databases, external reviews) to enrich the recommendation process and provide context beyond the LLM's initial training data. The system must demonstrate advanced extended thinking capabilities, adapting its reasoning budget based on recommendation complexity.
Shared data for this challenge
Review public datasets and any private uploads tied to your build.
What you should walk away with
Master CrewAI for defining roles, tasks, and process flows for collaborative agent teams.
Implement advanced RAG techniques using vector databases (e.g., Qdrant, ChromaDB) to retrieve obscure information relevant to recommendation queries.
Design and build MCP-enabled agents with tool definitions to interact with simulated external APIs (e.g., music streaming services, product databases).
Leverage GPT-5's advanced reasoning capabilities for generating creative, context-aware, and highly personalized recommendations.
Utilize Claude Sonnet 4 for robust information synthesis, fact-checking, and ensuring factual accuracy in recommendations.
Develop extended thinking patterns within agents, allowing for iterative refinement and adaptive reasoning budgets based on query complexity.
Orchestrate agent communication and task handoffs to achieve complex recommendation generation.
How this agent runs
The evaluation will assess the recommendation system's ability to handle complex queries, retrieve obscure information, generate creative and relevant recommendations, and demonstrate effective agent collaboration and...
Challenge input
{ "user_profile": { "age": 30, "mood": "reflective", "fav_genres": ["indie folk", "ambient electronic"], "recent_activities": ["reading philosophy"...
Agent execution
The configured agent processes the input under the challenge policy.
Evaluated output
{ "recommendation_title": "string", "artist": "string", "genre_tags": ["string"], "reasoning": "string (detailed explanation of why this recommenda...
- Verifies that the output is valid JSON and matches the specified schema.
- Confirms that the MCP-enabled tools were invoked successfully and their outputs were utilized in the recomm...
- Recommendation Relevance Score target: 4
- Python execution harness
View technical recipe
Configured tools
No tool records are attached.
Evaluation contract
- The evaluation module defines the checks.
Recipe state
This is a preview. The configuration can change before the evaluation recipe is locked.
Run this agent on your dataset and AI stack
Bring your dataset, model providers, and success criteria. We will scope the right managed run for your team.
Scope a managed run[ok] Wrote CHALLENGE.md
[ok] Wrote .versalist.json
[ok] Wrote eval/examples.json
Requires VERSALIST_API_KEY. Works with any MCP-aware editor.
DocsFind another challenge
Jump to a random challenge when you want a fresh benchmark or a different problem space.