FP32 · 32-bit floating point
Single-precision format, the top of the precision ladder; mixed-precision training keeps master weights and optimizer moments here even when the math runs lower.
Current numbers
~14 bytes/paramstated BF16 weights + FP32 master and two FP32 Adam moments; unique serialized state, before implementation metadata or replication