Shoutout to Gemma4 as a conversational assistant / agent
r/LocalLLaMA
•
Machine Learning
Generative AI
Computer Vision
AI Hardware
I'm seriously impressed by Gemma4 26B A4B. On my M5 Pro (so not much memory bandwidth by GPU standards), it's blazingly fast and it's a very good generalist / everyday local LLM. It has a little bit of personality to its responses, and seems to perform decently for everything: creative writing, debugging and coding, random chats, image recognition and classification, etc. If you want, give it a web search tool/API of your choice, and it really sings as an everyday local