EADST

Quick Review: SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

作者：XD / 发表： 2023年12月6日 23:57 / 更新： 2023年12月6日 23:57 / 科研学习 / 阅读量：2232

SpQR: A Sparse-Quantized Representation for Near-Lossless Large Language Model Weight Compression

Core Approach:

  • GPTQ without Outliers: Focuses on eliminating outliers during the GPTQ process, enabling more efficient and accurate weight compression for large language models.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/225

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
下一篇
Quick Review: QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
HuggingFace tqdm MD5 Transformers Pickle Quantize Heatmap 搞笑 FP64 Git 图标 Pillow v2ray News Streamlit Michelin Website FP16 Algorithm LeetCode Agent Linux Qwen2.5 版权 JSON InvalidArgumentError QWEN Gemma Bert BF16 域名 TensorFlow SQLite Markdown FP8 Plate NLTK ms-swift icon Tracking Django XGBoost Random 证件照 Diagram Statistics CEIR IndexTTS2 Search llama.cpp Plotly Windows Firewall Animate Conda TTS Mixtral Breakpoint git Zip RAR Web ChatGPT Nginx Attention 算法题 PyTorch Vim Bin FlashAttention Miniforge Template Image2Text Github Password Google Augmentation SVR NameSilo OCR Excel Logo 多进程 VGG-16 DeepStream Math Jetson XML Shortcut Land 递归学习法 BeautifulSoup Datetime 公式 mmap LLAMA Bipartite v0.dev ONNX PyCharm Color 图形思考法 GoogLeNet Proxy 论文 强化学习 Ptyhon Paper LaTeX GIT WebCrawler Python printf GGML Hotel 论文速读 torchinfo HaggingFace Anaconda Qwen Numpy 关于博主 uwsgi Hungarian Crawler Harness C++ CC TensorRT Distillation 财报 VPN LLM Food Quantization SAM Vmess CV 净利润 云服务器 音频 API CTC SPIE Hilton RGB Interview PDF Docker Review Llama Ubuntu Translation Safetensors Knowledge GPT4 Magnet YOLO Clash CAM Freesound Permission API网关 scipy Qwen2 VSCode PIP 顶会 Bitcoin uWSGI RL 继承 CLAP 飞书 签证 ResNet-50 Card Tiktoken BTC tar transformers 报税 TSV AI GPTQ OpenAI Data FP32 多线程 Use Pandas Cloudreve ModelScope CUDA LoRA NLP hf 阿里云 Base64 Disk UI Rebuttal Baidu Video UNIX PDB COCO CSV OpenCV WAN DeepSeek Tensor diffusers FastAPI Sklearn Domain git-lfs Claude Dataset Jupyter Pytorch 第一性原理 logger Paddle Input EXCEL 腾讯云 SQL
站点统计

本站现有博文336篇,共被浏览947986次

本站已经建立2658天!

热门文章
文章归档
回到顶部