embeddings

All posts tagged embeddings by Linux Bash
  • Posted on
    Featured Image
    Practical, shell-first guide to fixing flaky RAG pipelines: use curl, jq, ripgrep, sqlite3 FTS, strace, and GNU parallel to verify corpus coverage, prove retriever outputs, isolate latency, and validate prompt/context assembly; then guard quality with a tiny recall@k harness and gold queries in CI. Covers common pitfalls (stale indexes, embedding mismatch, bad chunking, filters, truncation) and reproducible bash smoke tests.
  • Posted on
    Featured Image
    Build practical, Unix-style Retrieval-Augmented Generation in the Linux terminal: a tiny Python+SQLite embeddings indexer chunks/searches your local text and pipes context to OpenAI or llama.cpp. The post ships steps, tooling, and four projects—man pages+/etc helper, log triage, repo/script navigator, offline ops handbook—for grounded, auditable, repeatable answers you control.
  • Posted on
    Featured Image
    Bring meaning to grep: this guide adds private, offline semantic search to Linux using a single-file Python CLI and SQLite. It indexes notes/code into 20-line chunks, creates fastembed vectors, and answers fuzzy queries with cosine similarity and TSV results you can pipe to fzf/$EDITOR. Includes distro-specific installs, indexing/query usage, cron updates, multiple DBs, model swaps, and scaling tips.
  • Posted on
    Featured Image
    Learn to build a private, terminal-first RAG assistant on Linux that answers questions from your own PDFs, notes, and wikis without the cloud. The guide installs prerequisites and Ollama, ingests docs to text via Bash, embeds with sentence-transformers, indexes with FAISS, and queries a local LLM. It includes scripts (ingest.sh, build_index.py, ask.py), tuning tips, real-world uses, and troubleshooting.
  • Posted on
    Featured Image
    Learn to build a fully local, private RAG pipeline on Linux using only Bash, curl, jq, and Ollama: install prerequisites, index your docs by chunking and embedding with nomic-embed-text, retrieve top chunks via cosine similarity in jq, and query a local LLM (e.g., llama3.1). Includes setup commands, example scripts, tips, and use cases—no Python, no cloud.
  • Posted on
    Featured Image
    Guide to fast, local, Bash-friendly vector databases on Linux: why to run them locally (performance, privacy, dev speed) and how to quickly spin up Qdrant, Weaviate, PostgreSQL+pgvector, and OpenSearch with Podman/Docker, curl/GraphQL examples, and volume persistence; includes when-to-choose advice, tuning tips (metrics, HNSW), a notes-search example, and a benchmark checklist to pick the right fit.
  • Posted on
    Featured Image
    Practical, Linux-first guide to Retrieval-Augmented Generation (“grep + summarize”): explains benefits (verifiable sources, private, Unix-composable) and walks you through a minimal Bash pipeline—index docs/logs with FAISS + sentence-transformers, query via Python, and generate with llama.cpp or an API—plus distro install commands, copy-paste scripts, real-world use cases, tuning tips, and troubleshooting.
  • Posted on
    Featured Image
    Struggling with grep/SQL for fuzzy queries? This guide demystifies vector databases for Linux users, showing how embeddings turn text into vectors for fast semantic search with Qdrant. Install via Docker/apt, create collections, upsert and query with curl, optionally generate embeddings in Python, then build semantic grep, log triage, and shell RAG workflows, with tuning tips and alternatives like Milvus, Weaviate, and pgvector.
  • Posted on
    Featured Image
    A hands-on guide to building a private, local RAG pipeline on Linux that answers questions about your docs with citations. It installs prerequisites, sets up Ollama for a local LLM, sentence-transformers + FAISS for embeddings and search, and LangChain orchestration, then provides two scripts to index and query. Includes examples, tuning tips (chunking, k, models), and next steps like automation and swapping vector DBs.
  • Posted on
    Featured Image
    A Bash-first, Linux-friendly guide to vector databases explaining why embeddings need ANN search, distance metrics, and metadata filters; how to choose PostgreSQL + pgvector, Qdrant, or Weaviate; and how to spin each up with apt/dnf/zypper/Podman and curl/jq, load sample vectors, and query by similarity—plus practical tips on cosine/L2/dot, normalization, HNSW/IVF tuning, filters, and batching for scalable RAG and semantic search.
  • Posted on
    Featured Image
    Build a fast, private RAG assistant on Linux using Ollama (local LLM), Chroma (vector store), and Sentence-Transformers (embeddings). The guide shows installing deps, indexing folders of txt/md/pdf with a minimal Python script, chunking and embedding, then querying from the shell with grounded, cited answers. It covers tuning, automation, GPU tips, and swapping models or stores.
  • Posted on
    Featured Image
    A bash-friendly guide to giving local LLMs long-term, private, offline memory with vector databases: explains embeddings and ANN, why they beat grep, and Linux setup via three paths—Chroma+FAISS (no server), Qdrant (container), or FAISS direct—plus critical tuning (dims/distances, HNSW/IVF, backups, recall tests) and mini use cases, so you can stand up reliable local RAG in minutes.
  • Posted on
    Featured Image
    Build a private, Linux-native RAG system that turns your local docs into a searchable AI: ingest txt/md/pdf, chunk, embed with fastembed (BAAI/bge-small-en), index in FAISS, and query via a local Ollama LLM with cited sources. The guide covers apt/dnf/zypper setup, two minimal Python scripts, examples, tuning tips, cron automation, scaling to vector DBs, and troubleshooting.