SRAM · static random-access memory
Fast on-die memory used for caches and scratchpads, and the basis of HBM-free inference chips; it is also a distinct GPU failure mode that first appears as correctable-error storms.
Current numbers
GTC 2026 (reported)Groq 3 LPU chip (~500 MB SRAM, ~150 TB/s) → LPX rack (256 LPUs, ~128 GB aggregate SRAM) fills the disaggregated decode/FFN slot (no HBM); Rubin GPUs retain prefill + attention. Rubin CPX reportedly pulled at GTC 2026 (no official NVIDIA cancellation)