Back to AI Tools
LMDeploy
Open Sourceby InternLM / Shanghai AI Lab
Models · Large Language Models
4.5(0 ratings)
Best For
About LMDeploy
Open-source LLM serving toolkit by InternLM.
Toolkit for compressing & serving LLMs (KV quantization, blocked KV cache, batching, TP).
Prompts for LMDeploy
Challenges using LMDeploy
Key Capabilities
Tool Details
- License
- Open Source
- Cost
- Free (OSS)
- Supported Languages
- Python, C/C++
Similar Tools
Works Well With
Curated combinations that pair nicely with LMDeploy for faster experimentation.
We're mapping complementary tools for this entry. Until then, explore similar tools above or check recommended stacks on challenge pages.