Local AI Assistant Powered by Gemma 4: Your Privacy-First Chat Buddy

Remember that awkward moment when you ask ChatGPT about a weird rash and then see ads for ointments for a week? Developer flo1632 decided to end that paranoia and built a local AI assistant powered by the fresh Gemma 4.

Meet Reiseki — not just another API wrapper, but a full-fledged assistant that lives on your machine, requires no internet, and more importantly, doesn't send your data to who-knows-where. It runs on Gemma 4 with 132 billion parameters — yeah, that's a lot, roughly the number of unresolved tickets in your JIRA.

Under the Hood

• Local execution: everything runs on your hardware. If you don't own a NASA server, you might wait a bit, but privacy is top-notch.
• Gemma 4 132B: Google's model that can chat, help with code, write texts, and even analyze data.
• Interface: a simple chat, no bloat. No 47-column dashboard — just you and the neural net.

Of course, running 132 billion parameters locally isn't for the faint of heart. You'll need a GPU with plenty of VRAM (16 GB minimum) and patience. But if you're willing to trade speed for privacy, this is your jam.

Fun fact: the README honestly warns that the assistant might "hallucinate" — make up facts. So if it says the Earth is flat, don't rush to believe it. But for everyday tasks — writing an email, tweaking code, naming your pet project — it works just fine.

METABYTE studio's comment: We love local solutions too — especially when clients ask for "an AI, but data shouldn't fly to China." Gemma 4 is a solid candidate for such scenarios, just don't forget to buy more RAM.