Show HN: Gerbil – an open source desktop app for running LLMs locally

Meet Gerbil: a local AI pet that keeps your secrets while sparking a ‘LM Studio vs… why?’ debate

TLDR: Gerbil is a new app that runs AI on your own computer for privacy and plug‑and‑play setup. Commenters split between “why not LM Studio?” and “please add easy file access,” turning the launch into a showdown over convenience, control, and a few Windows installer gotchas.

Hacker News dropped a new pet on the desk: Gerbil, a cross‑platform app that runs AI models on your own machine for privacy and speed, no cloud creep. It plugs into fan favorites like SillyTavern (roleplay chats) and OpenWebUI (sleek browser chat), rides the KoboldCpp engine, auto‑updates itself, and even does images. The crowd? Loud. Curious. Slightly rodent‑obsessed.

The biggest chorus: “Is this better than LM Studio?” One user flexing a gaming tablet asked if Gerbil is actually worth switching to, igniting the classic new toy vs proven tool debate. Another camp begged for real‑world utility—“Let it touch files!”—dreaming of easy renaming and organizing without jumping through cloud hoops. Privacy die‑hards cheered the “everything stays local” promise, while skeptics side‑eyed the Chromium UI footprint and questioned whether yet another launcher is just “bloat with a mascot.”

Linux fans waved the AUR flag like it’s a VIP pass, and Windows users side‑glared at the portable installer caveat (Ctrl+C won’t save you). Meanwhile, meme‑makers went full pet store: “Hamster? No. It’s Gerbil.” Whether you want click‑and‑chat or CLI (command line) power moves, the vibe is clear: Gerbil’s trying to be the cozy local AI companion; the crowd is deciding if it’s a keeper or just a cute cage accessory. Check the releases and judge for yourself.

Key Points

  • Gerbil is an open-source desktop app for running LLMs locally, powered by KoboldCpp (a modified fork of llama.cpp).
  • It offers cross-platform support (Windows, macOS, Linux including Wayland), automatic updates, smart process management, and privacy-focused local operation.
  • Built-in image generation presets (Flux, Chroma) and integrations with SillyTavern (requires Node.js) and OpenWebUI (requires uv) are included.
  • Installation options include pre-built binaries via GitHub Releases and an Arch Linux AUR package that handles integration and updates.
  • Gerbil provides a CLI mode that proxies to KoboldCpp, supports advanced arguments, has lower resource usage than the GUI, and has a Windows-specific limitation with the portable .exe.

Hottest takes

“Is there a reason for me to choose Gerbil instead? Or something else entirely?” — throwaway81998
“A way to easily interact with the content of the local filesystem.” — WillAdams
Made with <3 by @siedrix and @shesho from CDMX. Powered by Forge&Hive.