NVIDIA RTX 5090

The GPU in beast (Nima’s workstation: Ryzen 9 9950X3D, 128 GB system RAM, Linux).

• Memory size: 32 GB of GDDR7
• Memory bandwidth: 1,792 GB/s (512-bit bus × 28 Gbps)
• Compute capability: sm_120, a close cousin of the DGX Spark‘s sm_121, so Spark-oriented kernel libraries often apply here too.

In short, it’s very fast memory with not much of it. Fitting the model in 32 GB is the main limit, not speed.