latency

All posts tagged latency by Linux Bash
  • Posted on
    Featured Image
    Practical, Linux-first guide to trustworthy vector database benchmarking: bash-friendly apt/dnf/zypper setup, a reproducible harness to generate data or plug in embeddings, and measurements of recall@k, p50/p95 latency and QPS for FAISS (in-process) and Qdrant (via Podman). Match recall before comparing speed, pin CPUs, test filters/concurrency, track cost, and extend the script to other engines.
  • Posted on
    Featured Image
    Practical Linux performance guide focused on MCP—Memory, CPU, and Processes. Install observability tools and capture a baseline, then apply targeted tweaks: CPU governors, IRQ balance/pinning, optional core isolation; swappiness/dirty ratios, THP=madvise, NUMA binding; raise ulimits and tune cgroups; choose I/O schedulers/read-ahead, enable TCP BBR. Persist via tuned/sysctl.d/systemd, change one knob at a time, and roll back safely.
  • Posted on
    Featured Image
    AI/data workflows often choke on VPNs; this Linux-focused guide shows how to measure and fix them: benchmark latency, jitter and throughput; pick WireGuard or tuned OpenVPN ciphers matched to CPU; enable BBR+fq; set MTU/MSS; use RPS/offloads; and add a tiny AI-assisted script to auto-pick the best endpoint. Includes Bash-first commands, distro installs, and a 10-minute test plan to prove gains.
  • Posted on
    Featured Image
    This hands-on guide shows how to analyze and optimize AI API latency and throughput from the Linux shell—no APM needed. Using curl, jq, ab, GNU parallel, sysstat, iperf3, and time, it builds a repeatable harness to capture per-request timings, quantify p50/p95/p99, probe concurrency, watch CPU/GPU/I/O/network, sanity-check transport, and apply an optimization checklist, then codify performance baselines in CI.