Post-Training Quantization: Rounding, Calibration, and the Outlier Problem
Why rounding each weight to the nearest value is not enough, what calibration data is for, and the two kinds of outliers in a real model's activations, measured on Qwen3-8B.
ptq
1 post