EADST

Quick Review: SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

作者：XD / 发表： 2023年12月6日 23:57 / 更新： 2023年12月6日 23:57 / 科研学习 / 阅读量：2011

SpQR: A Sparse-Quantized Representation for Near-Lossless Large Language Model Weight Compression

Core Approach:

  • GPTQ without Outliers: Focuses on eliminating outliers during the GPTQ process, enabling more efficient and accurate weight compression for large language models.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/225

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
下一篇
Quick Review: QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
OpenAI Diagram uWSGI tar hf EXCEL Template Zip TSV TTS 财报 PDB Review VGG-16 Rebuttal Crawler mmap WAN FP32 RGB Cloudreve 顶会 PyCharm NLTK Animate OpenCV Distillation 多线程 Breakpoint Michelin 继承 News Plate Datetime FP8 tqdm CTC Shortcut LoRA GPT4 Hotel VSCode icon Color 关于博主 InvalidArgumentError Magnet SAM FlashAttention Windows Pillow Domain 报税 git Pandas XML 第一性原理 DeepStream scipy torchinfo PIP 版权 RAR FP16 签证 Paper AI Disk Password Docker Card Jupyter Qwen2 搞笑 Input Hungarian ResNet-50 Baidu API CC Ubuntu Base64 阿里云 ModelScope 强化学习 OCR 域名 NameSilo BTC Nginx uwsgi Hilton BF16 Search UI LLM Google 公式 YOLO SQL 图形思考法 Sklearn Jetson Ptyhon TensorRT CV 多进程 MD5 CUDA Web llama.cpp Logo Food Pytorch UNIX Miniforge LLAMA C++ Firewall Markdown Permission GoogLeNet Image2Text Dataset diffusers LeetCode Bin FP64 净利润 递归学习法 Conda SPIE Video JSON git-lfs Anaconda Heatmap 腾讯云 Random Excel ONNX Numpy Paddle Gemma 音频 Github WebCrawler Statistics Safetensors Linux DeepSeek Tiktoken 飞书 Clash CLAP Pickle logger Claude SQLite Llama COCO Algorithm Git HaggingFace Freesound Land GGML Tensor Transformers QWEN Django Bert HuggingFace FastAPI ChatGPT Use CAM GIT SVR Quantize Python XGBoost Plotly Website Data Agent v0.dev NLP 论文 论文速读 Tracking Math Vmess Translation transformers TensorFlow Augmentation Bipartite PDF IndexTTS2 CSV Qwen2.5 证件照 Vim Quantization Knowledge Bitcoin 算法题 printf v2ray Qwen BeautifulSoup VPN 图标 LaTeX Streamlit Proxy Interview PyTorch CEIR GPTQ 云服务器 Mixtral Attention
站点统计

本站现有博文328篇,共被浏览858248次

本站已经建立2566天!

热门文章
文章归档
回到顶部