mistral.rs support for Gemma 4 12B - multimodal, agentic, and MTP integration
r/LocalLLaMA
•
Generative AI
Open Source AI
Mistral․rs provides web search and safe, sandboxed code execution functionality to allow you to build powerful agentic apps with Gemma 4 12B. There's also full multimodal, so you can build with audio, image, and video. Installation is one-step: # Linux/Mac curl --proto '=https' --tlsv1.2 -sSf | sh # Windows irm | iex Then, just run: mistralrs run --agent -m google/gemma-4-12B-it --quant 4 This will launch an OpenAI and Anthropic-compatible HTTP server, with a built-in UI web chat at localhost:1234/ui.