- Posted on
- Featured Image
Turn natural-language requests into deterministic desktop actions on Linux with Bash: an LLM planner orchestrates xdotool/wmctrl, OCR (Tesseract) and Unix tools to open apps, type, click on-screen text, and react to events. The post lists installs, gives 3-5 scripts (Firefox control, JSON-planned steps, OCR clicks, auto-OCR to clipboard), notes X11 vs Wayland, and safety (dry-runs, allowlists) to scale from quick wins to RPA.