Infrastructure efficiency might matter more than benchmark scores when picking a model
r/ChatGPT
•
AI Hardware
AI Research
Spent way too long comparing models on benchmarks and prompt tests. Then Zai put out a technical writeup about the network running GLM-5.1 inference and it changed how i look at pricing They swapped the GPU cluster network to something called ZCube. Same hardware, same model. Switch costs dropped a third, throughput went up 15%, first token latency came down 40%. No software changes Standard ROFT topology creates traffic jams when inference patterns are asymmetric, which is what happens with Prefill-Decode disaggregation.