HBM3E
An enhanced generation of high-bandwidth memory shipping in 2024-2025 accelerators, faster and denser than HBM3.
Current numbers
216 GBHBM3E per Microsoft Maia 200 @ 7 TB/s; >10 PFLOPS FP4 / 5 PFLOPS FP8, 750W, +30% perf/$
2.52 PFLOPSper-chip Trainium3 MXFP8, 144 GB HBM3E; ~4x perf/watt vs Trn2 UltraServer
2.52 PFLOPSFP8 per Trainium3 chip; 144 GB HBM3E @ 4.9 TB/s; first 3nm AWS accelerator