Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs| 东毅居士

Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs

作者：XD / 发表： 2023年12月7日 00:45 / 更新： 2023年12月7日 00:57 / 科研学习 / 阅读量：2383

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Paper: SmoothQuant on arXiv
Code: SmoothQuant on GitHub
Organization: MIT

Highlight:

Hyper-parameter for Outliers: Implements a novel approach using a specific hyper-parameter to manage outliers effectively during the quantization process.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/229

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

下一篇
Setting Up v2rayNG with Tencent Cloud Silicon Valley Lighthouse

Category

标签云

Docker llama.cpp SPIE Tiktoken v0.dev Streamlit ResNet-50 WAN Color COCO Transformers 论文速读 scipy logger Video 音频腾讯云 XML Qwen2.5 Shortcut EXCEL Crawler PyTorch RAR Datetime Quantize Nginx 算法题 LoRA 搞笑 RGB Numpy CUDA Heatmap Animate API网关继承 Agent Breakpoint Gemma CTC Freesound Vim FlashAttention VGG-16 LaTeX Mixtral Magnet Translation Git hf Excel Math 关于博主 Jev MD5 LLAMA Template 多进程 Sklearn Password git tqdm Bin v2ray Image2Text Logo Jupyter FP32 OpenCV 强化学习 Plate Miniforge 净利润 ms-swift News QWEN IndexTTS2 Clash Tracking Qwen2 Google Card ModelScope ONNX BeautifulSoup UI Data 递归学习法 Pandas Baidu TTS Conda TSV Zip LLM tar Bert Quantization Bipartite GPT4 Markdown PDF uwsgi VSCode 图形思考法 NLTK SQLite Paper XGBoost API Hilton Windows 财报 Jetson BF16 GGML FP16 SAM Python PyCharm BTC GPTQ Github DeepStream VPN transformers Vmess HuggingFace Plotly Pytorch Random Distillation Attention icon Web Pickle JSON CEIR diffusers CAM RL torchinfo Tensor Search GIT Qwen 顶会 Proxy 飞书 FP64 Paddle 公式 Domain SVR PDB uWSGI 论文 Permission printf GoogLeNet CSV git-lfs Diagram mmap OpenAI CLAP Safetensors 证件照 Cloudreve NLP CV Algorithm Claude NameSilo OCR Hotel 域名 WebCrawler Base64 Michelin Review HaggingFace Llama Hungarian UNIX Interview Pillow SQL 签证 ChatGPT Bitcoin DeepSeek AI Ptyhon 云服务器 Ubuntu 多线程 Food Use Rebuttal 第一性原理 Linux Augmentation Disk Django C++ FP8 阿里云图标 YOLO LeetCode TensorRT Input FastAPI Statistics TensorFlow Firewall Land Harness Knowledge Anaconda PIP Website 报税版权 Dataset InvalidArgumentError CC

站点统计

本站现有博文337篇,共被浏览955753次

本站已经建立2666天!

原 Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs

作者：XD / 发表： 2023年12月7日 00:45 / 更新： 2023年12月7日 00:57 / 科研学习 / 阅读量：2383

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Highlight:

Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs