Upgrade path from 4x 3090s

r/LocalLLaMA
Open Source AI AI Research

Right now, I’m running 4x 3090s hosting Qwen 3.6 27B 128K in full precision. It's a great model, but I'm looking for a step up and trying to figure out the best "middle-tier" hardware path. I've seen people here mention running 8x 3090s (192GB VRAM total), but I'm not sure if there are actually better models that take advantage of that tier yet (maybe MiniMax M2.7 or DSv4 flash?). Correct me if I'm wrong but running DSv4 on Ampere will be a pain.