EADST

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

• Paper: AWQ on arXiv
• Code: AWQ on GitHub
• Organization: MIT

Highlight:

• Optimal Alpha Scaling: Focuses on determining the optimal alpha value for scaling weights prior to quantization.