model inference

Step-by-step guide to running local LLMs on Linux with Bash. Shows how to install dependencies, choose a runtime, download and quantize models, and write shell scripts for prompts, chat loops, and batch inference. Covers GPU/VRAM limits, memory tuning, streaming output, logging, and cron automation—enabling private, offline workflows and reproducible pipelines.