llama.cpp Quickstart with CLI and Server
#Cheatsheet #AI #LLM #DevOps #OpenAI #API #SelfHosting #Prometheus #llamacpp
www.glukhov.org/llm-hosting/llama-c…
glukhov.org
llama.cpp Quickstart with CLI and Server
Install llama.cpp, run GGUF models with llama-cli, and serve an OpenAI-compatible API with llama-server. Flags, examples, and tuning.