Server build for local inference. 128 gb 3200 or 256 gb 2133mhz RAM?
r/LocalLLaMA
•
Open Source AI
Hi, I am building a server so that my dual rtx 3090 setup runs at full speed. - asrock romed8 t2 revision 1.3 - epyc 7642 - ddr4 128 gb 3200 or 256 gb 2133 (256 gb is a bit cheaper) 8 channel - dual rtx 3090 - gigabyte psu 1600 w What do you think? Is using ram for moe models worth it? Something like qwen 3.5 397b? And should I go for the fastest ram or for ram? submitted by /u/PreparationTrue9138 [link] [comments]