Back to AI Tools
LM
LMDeploy
Open Source
Open-source LLM serving toolkit by InternLM.
Models · Large Language Models
CompanyInternLM / Shanghai AI Lab
PricingFree (OSS)
Best For
About LMDeploy
What this tool does and how it can help you
Toolkit for compressing & serving LLMs (KV quantization, blocked KV cache, batching, TP).
Prompts for LMDeploy
Challenges using LMDeploy
Tool Details
Technical specifications and requirements
License
Open Source
Pricing
Free (OSS)
Supported Languages
PythonC/C++