Back to AI Tools
LL
llama.cpp
Open Source
Local/offline LLM inference in C/C++.
Models · Large Language Models
Companyllama.cpp Community
PricingFree (OSS)
Best For
About llama.cpp
What this tool does and how it can help you
Portable C/C++ LLM inference (GGUF) with many backends (CUDA, Metal, Vulkan, HIP, SYCL).
Prompts for llama.cpp
Challenges using llama.cpp
Tool Details
Technical specifications and requirements
License
Open Source
Pricing
Free (OSS)
Supported Languages
C/C++PythonGoNode