LMDeploy Model Integration & Serving

implementationChallenge

Prompt Content

Set up LMDeploy to serve at least two different LLMs (e.g., OpenAI o3 and a Llama variant). Implement the logic within your evaluation engine to dynamically switch between these models for benchmarking. Design the MCP-enabled tool to feed model outputs from LMDeploy into the DSPy evaluation pipeline.

Try this prompt

Open the workspace to execute this prompt with free credits, or use your own API keys for unlimited usage.

Usage Tips

Copy the prompt and paste it into your preferred AI tool (Claude, ChatGPT, Gemini)

Customize placeholder values with your specific requirements and context

For best results, provide clear examples and test different variations