Enterprise Gemini Integration with MCP for Secure AI Services
This challenge simulates the complexities of securely integrating a powerful generative AI model like Gemini into a mission-critical, high-volume enterprise system. Your task is to design and implement a robust integration layer focusing on secure, standardized communication using the MCP, comprehensive observability, and efficient API management. This involves ensuring data integrity, managing model context, monitoring performance, and routing requests effectively, all within an enterprise-grade setup.
What you are building
Implement an enterprise-grade integration layer for Gemini 3 Pro using MCP, OpenTelemetry, and Kong Gateway for secure and observable AI services.
How work is evaluated
The evaluation focuses on the robustness, security, and observability of the Gemini integration. Key aspects include correct MCP implementation, effective API management via Kong, end-to-end tracing with OpenTelemetry, and continuous performance monitoring simulated with Arize AI.
Datasets
Public datasets, plus the private datasets you have access to.
Learning goals
Master the implementation of the MCP to standardize context propagation and tool invocation across your AI services for Gemini 3 Pro.
Configure Kong Gateway as an API gateway for secure access, rate limiting, authentication, and intelligent routing of requests to your Gemini 3 Pro inference endpoints.
Implement comprehensive tracing and metrics collection using OpenTelemetry across the entire AI service pipeline, from client request to Gemini inference and response generation.
Deploy and serve Gemini 3 Pro effectively using Google Cloud's Vertex AI Endpoints (or a local simulation), ensuring high availability, low latency, and scalable inference.
Integrate Arize AI (or a similar evaluation framework) to continuously monitor the performance, safety, and bias of your Gemini 3 Pro integration in a production-like environment.
Resources
Sample data for 2 tasks
Challenge setup
The evaluation focuses on the robustness, security, and observability of the Gemini integration. Key aspects include correct MCP implementation, effective API management via Kong, end-to-end tracing with OpenTelemetry...
Challenge input
{'user_query': 'string', 'context': {'user_id': 'string', 'session_id': 'string', 'tool_access': ['string']}}
Agent execution
No agent tool is listed for this challenge.
Evaluated output
{'mcp_request_payload': {'context': {...}, 'query': 'string'}, 'gemini_response_excerpt': 'string'}
- Ensures the MCP payload structure adheres to the specified protocol.
- Verifies that key spans (gateway, MCP, Gemini) are present in the OpenTelemetry trace.
- EndToEndLatency Ms target: 250
- Python execution harness
Shows the first task, up to three tools, and up to three evidence items.
View technical recipe
Configured tools
No tool records are attached.
Evaluation contract
- Ensures the MCP payload structure adheres to the specified protocol.
- Verifies that key spans (gateway, MCP, Gemini) are present in the OpenTelemetry trace.
Metrics
- EndToEndLatency_ms · Target 250
- GeminiResponseRelevance · Target 0.9
Workflow tasks
- Task 1
Input: {'user_query': 'string', 'context': {'user_id': 'string', 'session_id': 'string', 'tool_access': ['string']}}
Output: {'mcp_request_payload': {'context': {...}, 'query': 'string'}, 'gemini_response_excerpt': 'string'}
Execution harness: Python
- Task 2
Input: {'user_query': 'string', 'context': 'dict'}
Output: {'trace_id': 'string', 'spans': [{'name': 'string', 'duration_ms': 'integer', 'attributes': 'dict'}]}
Execution harness: Python
Recipe freeze marker
No recipe freeze time is recorded.