Cosmos3-Super-Image2Video running locally on a single RTX PRO 6000 96GB

I got nvidia/Cosmos3-Super-Image2Video BF16 running locally on a single RTX PRO 6000 Blackwell 96GB. its hard to talk about quality results and gen speeds yeat as i tested whit SPDA attention and not SAGE, also prompting need work. Most important part in my test that it can be loaded in workstation system at home / office. Setup: Ubuntu 24.04 NVIDIA driver 580.126.09 / CUDA 13.0 RTX PRO 6000 Blackwell 96GB 128GB system RAM 128GB temporary swap Docker: vllm/vllm-omni:cosmos3 BF16 --enable-layerwise-offload BF16 loading died near the end of loading shards at first.