Back to AI Tools
LL
Models · Large Language Modelsllama.cpp CommunityOpen source

llama.cpp

Local/offline LLM inference in C/C++.

Company
llama.cpp Community
Pricing
Free (OSS)
Website GitHub

About llama.cpp

What this tool does and where it fits best.

Portable C/C++ LLM inference (GGUF) with many backends (CUDA, Metal, Vulkan, HIP, SYCL).

Prompts for llama.cpp

Challenges using llama.cpp

Tool details

Core technical and commercial details.

License
Open Source
Pricing
Free (OSS)
Supported languages

C/C++, Python, Go, Node

Similar Tools

Frequently Asked Questions about llama.cpp