Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs| 东毅居士

Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs

作者：XD / 发表： 2023年12月7日 00:45 / 更新： 2023年12月7日 00:57 / 科研学习 / 阅读量：2322

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Paper: SmoothQuant on arXiv
Code: SmoothQuant on GitHub
Organization: MIT

Highlight:

Hyper-parameter for Outliers: Implements a novel approach using a specific hyper-parameter to manage outliers effectively during the quantization process.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/229

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

下一篇
Setting Up v2rayNG with Tencent Cloud Silicon Valley Lighthouse

Category

标签云

Numpy InvalidArgumentError OCR SVR COCO Magnet Knowledge Clash Attention IndexTTS2 hf DeepStream Qwen v0.dev TSV XML Docker Translation BeautifulSoup 阿里云 OpenCV XGBoost Use Gemma 签证 LLAMA SAM Bin Google llama.cpp JSON 净利润 FlashAttention torchinfo VPN Base64 Animate RL Streamlit PIP LLM Nginx 公式 TTS Crawler Firewall CEIR 证件照 DeepSeek CLAP Excel Random 顶会 RGB 腾讯云第一性原理 Bitcoin Baidu Qwen2.5 uwsgi Claude CC Review LaTeX Permission 财报 FP64 Plotly Rebuttal 云服务器 Augmentation 音频 OpenAI PDB SQL Pytorch Miniforge Tensor 递归学习法 diffusers SQLite tqdm EXCEL 版权 Datetime Web Pillow Plate ResNet-50 VGG-16 v2ray PyCharm 强化学习 Template Zip BF16 PyTorch FP32 域名 UNIX LeetCode Paper logger Website Statistics Pickle 继承 scipy Interview Bert Qwen2 Vim GoogLeNet 图形思考法 transformers Quantization Algorithm FastAPI AI WebCrawler CSV CTC BTC ChatGPT Transformers GPTQ Image2Text Git Diagram Heatmap Jupyter Mixtral NLP 多线程 Logo Anaconda Distillation QWEN Linux Tiktoken HaggingFace Food Password Jetson 算法题 Search mmap YOLO Ptyhon PDF Conda git-lfs GGML Breakpoint Bipartite C++ Disk SPIE Vmess icon Land CUDA ModelScope VSCode Windows FP16 Card Data UI MD5 Hilton 多进程 Domain 论文速读 Paddle Michelin 报税 WAN API Ubuntu NLTK NameSilo Tracking Shortcut GPT4 Dataset Github tar Pandas ms-swift LoRA Quantize ONNX 关于博主 Markdown uWSGI Django 飞书图标 git Agent GIT Llama 搞笑 Sklearn Math Color Cloudreve Hungarian Freesound TensorFlow RAR CV Proxy Safetensors printf News 论文 Input Hotel FP8 Python HuggingFace TensorRT CAM Video

站点统计

本站现有博文334篇,共被浏览930804次

本站已经建立2639天!

原 Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs

作者：XD / 发表： 2023年12月7日 00:45 / 更新： 2023年12月7日 00:57 / 科研学习 / 阅读量：2322

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Highlight:

Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs