🧰
Open Source Toolkit

Know how to use it before you click: online, self-hosted, desktop, CLI

中文

llama.cpp

ggml-org/llama.cpp
Download & install Download and install locally. No server needed.

LLM inference in C/C++

Local LLMCommand line
llama.cpp repository card
Stars
★ 129.2k
Language
C++
License
MIT
Last updated
2026-09-23
Category
AI tools
Section
General