Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs| 东毅居士

Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs

作者：XD / 发表： 2023年12月7日 00:45 / 更新： 2023年12月7日 00:57 / 科研学习 / 阅读量：2280

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Paper: SmoothQuant on arXiv
Code: SmoothQuant on GitHub
Organization: MIT

Highlight:

Hyper-parameter for Outliers: Implements a novel approach using a specific hyper-parameter to manage outliers effectively during the quantization process.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/229

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

下一篇
Setting Up v2rayNG with Tencent Cloud Silicon Valley Lighthouse

Category

标签云

tar Qwen2 Knowledge Vmess Plotly Distillation TSV 音频 Bert 报税 ChatGPT Plate Diagram FlashAttention 阿里云 LLAMA Freesound 域名 Mixtral WebCrawler WAN SPIE Streamlit Image2Text Tiktoken HaggingFace icon git Search CC VPN Jetson Agent 版权 GoogLeNet v2ray SQLite 顶会 NameSilo ONNX PyTorch VGG-16 Hilton LaTeX ModelScope TTS Firewall Heatmap logger Bin Use Paper Base64 PIP C++ Permission Augmentation Zip Input Random AI OpenAI DeepSeek InvalidArgumentError LLM Crawler SAM Hotel QWEN Color v0.dev TensorRT NLTK GGML Tracking FP32 Transformers PyCharm NLP CEIR Claude LeetCode FastAPI COCO Website uWSGI FP64 GPTQ PDB 腾讯云 Git TensorFlow BF16 MD5 CV Domain CUDA Anaconda Django Hungarian Llama Disk 签证 VSCode Pickle Data UNIX Nginx RL UI RGB EXCEL uwsgi Card 关于博主 HuggingFace Pillow Excel tqdm Review Datetime Password Quantization Bitcoin 公式 OpenCV Bipartite hf BTC Google CLAP ms-swift SVR 财报 Logo Land Miniforge Shortcut 云服务器 Food Tensor Docker FP16 Magnet 算法题 Video FP8 多进程 diffusers BeautifulSoup mmap Windows 论文速读 LoRA OCR 飞书 Michelin torchinfo Vim 继承 Linux Dataset Cloudreve Translation 多线程 PDF Pytorch 图形思考法 Safetensors CAM Github Attention API 净利润证件照 Numpy Pandas Ubuntu 强化学习 Clash printf Proxy GIT 第一性原理 Markdown Gemma scipy Interview Quantize Jupyter transformers Breakpoint CTC RAR Paddle CSV DeepStream Conda Animate Algorithm Qwen 递归学习法论文 XML YOLO Baidu ResNet-50 Statistics Ptyhon GPT4 JSON Math llama.cpp 图标 News Web Sklearn XGBoost 搞笑 Qwen2.5 Python git-lfs SQL Rebuttal Template IndexTTS2

站点统计

本站现有博文333篇,共被浏览914543次

本站已经建立2618天!

原 Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs

作者：XD / 发表： 2023年12月7日 00:45 / 更新： 2023年12月7日 00:57 / 科研学习 / 阅读量：2280

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Highlight:

Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs