About Quantization

Quantization 

https://paperswithcode.com/task/quantization

Vector Quantization 

• https://ieeexplore.ieee.org/document/1162229
• GPTVQ
• Example: https://scikit-learn.org/stable/auto_examples/cluster/plot_face_compress.html

& Maarten Greentendorst

• A Visual Guide to Quantization
• Which Quantization Method is Right for You

- Quantization FP16 FP8, and INT8