Mutating Gemma 4 31B Dense in to a native Gemma 4 additive-MoE model
r/LocalLLaMA
•
Machine Learning
Open Source AI
I recently came across an interesting model on Hugginface from JDONE-Research/AIOne-Agent-52B-A36B-it. It is the first finetune I saw that is built on the Gemma 4 31B dense model but enables MoE for it