Back to AI Tools
LL
Models · Large Language Modelsllama.cpp CommunityOpen source

llama.cpp

Local/offline LLM inference in C/C++.

Company
llama.cpp Community
Pricing
Free (OSS)
Website GitHub
Versalist

How it performs on Versalist

Real signals from Versalist challenges, evaluations, and community usage.

Be the first to run a challenge with this tool and create a useful signal for the next builder.

Challenges using llama.cpp

Prompts for llama.cpp

About llama.cpp

What this tool does and where it fits best.

Portable C/C++ LLM inference (GGUF) with many backends (CUDA, Metal, Vulkan, HIP, SYCL).

Similar Tools

VendorLicense: Open Source

Frequently Asked Questions about llama.cpp