Quick Review: ZeroQuant-FP
作者:XD / 发表: 2023年12月7日 00:32 / 科研学习/ 阅读量:211
ZeroQuant-FP: A Leap Forward in LLMs Post-Training W4A8 Quantization Using Floating-Point Formats
Paper: https://arxiv.org/abs/2307.09782
Code: https://github.com/microsoft/DeepSpeed
Organization: Microsoft