Run Chrome’s tiny Gemma4 (aka Gemini Nano) directly on PC without GPU

r/LocalLLaMA
Generative AI AI Hardware Open Source AI AI Tools

Everyone remembers that sneaky download of Gemini Nano earlier this month? and if you talk to it, it will happily tell you it’s a Gemma. Since some friends were interested but don’t want to talk to it via de tools like talking to some poor house elf via a keyhole on a locked door, made a 5 minute vibe coded extension to run it. Nothing required just need Google chrome, 16gb RAM, and some disk space. No llama.cpp, no vllm etc. no tinkering (no fun I know). It’s quite fast and smooth, feels like ~20t/s+ on my laptop without gpu. I have no actual information on how fast though.