Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs| 东毅居士

Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs

作者：XD / 发表： 2023年12月7日 00:45 / 更新： 2023年12月7日 00:57 / 科研学习 / 阅读量：2214

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Paper: SmoothQuant on arXiv
Code: SmoothQuant on GitHub
Organization: MIT

Highlight:

Hyper-parameter for Outliers: Implements a novel approach using a specific hyper-parameter to manage outliers effectively during the quantization process.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/229

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

下一篇
Setting Up v2rayNG with Tencent Cloud Silicon Valley Lighthouse

Category

标签云

Linux CSV Llama CV GPTQ Crawler VPN Hilton Mixtral Search 签证报税 Streamlit GPT4 Clash ONNX EXCEL QWEN Windows 飞书 Distillation Git Anaconda Algorithm Bin YOLO Heatmap 域名 RL Card Plotly 云服务器 Input Sklearn 多进程 Nginx Base64 Pillow Numpy Knowledge Docker XGBoost 公式阿里云 LoRA 证件照 Pickle UNIX BeautifulSoup BTC Statistics RGB Michelin Domain Python CAM CTC tqdm CEIR Magnet Jetson XML Paper Bert 财报 Land PDB MD5 SQL Gemma Markdown 顶会 Vmess RAR Excel hf Augmentation FP32 Use Safetensors Proxy Logo git-lfs Qwen GoogLeNet UI LeetCode API SPIE LaTeX WAN llama.cpp TTS Transformers Miniforge Pytorch 继承 NameSilo OpenAI v0.dev Color CUDA Ubuntu Ptyhon TSV Website Random 第一性原理 OpenCV Disk 关于博主 Hotel Tiktoken DeepSeek 算法题 Attention 强化学习 Translation Password PIP LLM NLP uwsgi FP64 Conda News Freesound Baidu Paddle DeepStream ModelScope PDF 图形思考法 FP16 WebCrawler uWSGI AI CLAP HaggingFace C++ Tracking Cloudreve Qwen2.5 Bitcoin 论文速读 OCR Breakpoint SAM CC Food Hungarian Qwen2 TensorRT Math SVR Quantization transformers Dataset FastAPI Rebuttal PyCharm Plate 版权多线程 Datetime Permission Tensor Animate Jupyter Interview FlashAttention Bipartite icon 腾讯云 tar HuggingFace Template Review NLTK Image2Text 图标 BF16 Diagram scipy Web Claude GIT diffusers InvalidArgumentError GGML ResNet-50 Quantize v2ray 净利润 VGG-16 搞笑 Video Data printf FP8 VSCode Zip ChatGPT Vim git JSON 论文 Github Firewall LLAMA mmap PyTorch 音频 ms-swift Agent 递归学习法 TensorFlow Google COCO Pandas IndexTTS2 SQLite torchinfo Django logger Shortcut

站点统计

本站现有博文332篇,共被浏览887736次

本站已经建立2591天!

原 Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs

作者：XD / 发表： 2023年12月7日 00:45 / 更新： 2023年12月7日 00:57 / 科研学习 / 阅读量：2214

SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

Highlight:

Quick Review: SmoothQuant: Accurate and Efficient Post-Training Quantization for LLMs