Behold! Probably the most ghetto local AI server:
r/LocalLLaMA
•
AI Hardware
AKA: Jank Incarnate After months of pain, I finally got a working setup. There's a bunch of quirks about running a multi-Tesla setup. I was planning to write something about my experience after I get it running. Currently, the fans are plugged into the wall, speed is controlled with a knob. I still gotta wire up a PWM controller for them. EDIT: Specs: Intel Xeon CPU E5-2680 v4 @ 2.40GHz Asrocka x99 Extreme motherboard Cursed 16GB DDR4 of some laptop SODIMM in an adapter 3x Nvidia Tesla V100, 32GB - total 96GB of VRAM submitted by /u/MackThax [link] [comments.