The Serving Stack

blackwell

1 post

QUANTIZATION · 012.7×DECODE VS BF1616 FP4 VALUES PER BLOCK, ONE SCALE EACH
quantizationnvfp4fp8

NVFP4 on Blackwell: Serving a 4-Bit Model End to End

What NVFP4 stores, how vLLM serves it on Blackwell, and what it changes in memory, speed, and quality.

by The Serving Stack