inference

Guide to running AI models locally on Linux for privacy, predictable costs, and offline use. Explains choosing model families and quantizations, RAM/VRAM needs, and licenses; fast start with Ollama and a deeper llama.cpp build plus OpenAI-style server; Bash/API integrations for logs, commits, and docs; GPU offload tips, troubleshooting, and a CTA to automate your shell workflow.