Back to AI Tools
llama.cpp
Open Sourceby llama.cpp Community
Models · Large Language Models
4.5(0 ratings)
Best For
About llama.cpp
Local/offline LLM inference in C/C++.
Portable C/C++ LLM inference (GGUF) with many backends (CUDA, Metal, Vulkan, HIP, SYCL).
Prompts for llama.cpp
Challenges using llama.cpp
Key Capabilities
Tool Details
- License
- Open Source
- Cost
- Free (OSS)
- Supported Languages
- C/C++, Python, Go, Node
Similar Tools
Works Well With
Curated combinations that pair nicely with llama.cpp for faster experimentation.
We're mapping complementary tools for this entry. Until then, explore similar tools above or check recommended stacks on challenge pages.