- Posted on
- Featured Image
Hands-on homelab guide to AI on K3s: set up a tiny, multi-arch Kubernetes with Helm and MetalLB, then ship CPU-friendly Triton ONNX image classification, a llama.cpp LLM via GGUF, and full metrics with Prometheus+Grafana. Includes copy-paste manifests, curl tests, LAN LoadBalancers, plus GPU/multi-node tips and troubleshooting—portable, reproducible, and fast on edge hardware.