Back to AI Tools
LM
Models · Large Language ModelsInternLM / Shanghai AI LabOpen source

LMDeploy

Open-source LLM serving toolkit by InternLM.

Company
InternLM / Shanghai AI Lab
Pricing
Free (OSS)
Website GitHub
Versalist

How it performs on Versalist

Real signals from Versalist challenges, evaluations, and community usage.

Be the first to run a challenge with this tool and create a useful signal for the next builder.

Challenges using LMDeploy

Prompts for LMDeploy

About LMDeploy

What this tool does and where it fits best.

Toolkit for compressing & serving LLMs (KV quantization, blocked KV cache, batching, TP).

Similar Tools

VendorLicense: Open Source

Frequently Asked Questions about LMDeploy