- Posted on
- Featured Image
A hands-on guide for Linux Bash users to run private, offline AI without cloud: compares llama.cpp vs Ollama for local LLMs, uses whisper.cpp for transcription, and builds lightweight RAG with Chroma + sentence-transformers; provides apt/dnf/zypper installs, copy/paste commands, Hugging Face CLI + Git LFS model management, plus tips for performance, reproducibility, and scaling.