gpu passthrough

A practical, distro-agnostic guide to near-bare-metal AI in VMs via GPU passthrough with KVM/VFIO: why it boosts isolation, reproducibility, and multi-tenant efficiency; required hardware/BIOS (IOMMU, Above 4G), host setup (apt/dnf/zypper), binding GPUs to vfio-pci, creating OVMF/Q35 VMs, installing guest drivers, validating with PyTorch, performance tuning (hugepages, CPU pinning), and clear troubleshooting tips.

A practical Linux guide to near‑native AI performance in VMs using GPU passthrough: covers why it matters (isolation, reproducibility, security), hardware needs, and a step‑by‑step setup with VFIO, KVM/QEMU, libvirt, and virt‑manager—enable IOMMU, bind the GPU, create a UEFI Q35 guest, install NVIDIA/ROCm—plus tuning, troubleshooting, and a real‑world multi‑VM workflow.