llama.cpp Local Inference
llama.cpp provides llama-server, a local C/C++ inference server with OpenAI-compatible chat/completions/responses endpoints and Anthropic-compatible /v1/messages endpoints. It is the primary local-agentic-coding backend.
Use this section when serving local GGUF models, wiring a local provider into Pi/Claude/Codex/OpenCode, or managing the model router.
Mental model
The local stack has four layers: install the llama.cpp tooling, place curated GGUF files on disk, serve one of those files through the router, then point each agent harness at the local provider.
Each page owns one layer.
Using it
| Navigation slice | Owns |
|---|---|
| Install and models | Homebrew install, GGUF manifest, opt-in sync hook |
| Router control plane | models.ini, ,llama-cpp serve/status/load/unload, runtime env |
| Pi provider | readonly Pi model provider and startup migration behavior |
| Launchers | Codex metadata, ,codex-llama-cpp, ,opencode-llama-cpp, ,claude-llama-cpp |
Related
- Add a llama.cpp model — manifest recipe
- Model registry & routing — cloud model definitions