EADST

Quick Review: SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

作者：XD / 发表： 2023年12月6日 23:57 / 更新： 2023年12月6日 23:57 / 科研学习 / 阅读量：2131

SpQR: A Sparse-Quantized Representation for Near-Lossless Large Language Model Weight Compression

Core Approach:

  • GPTQ without Outliers: Focuses on eliminating outliers during the GPTQ process, enabling more efficient and accurate weight compression for large language models.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/225

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
下一篇
Quick Review: QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
Zip Rebuttal llama.cpp 云服务器 多进程 阿里云 Michelin Augmentation Streamlit Gemma Qwen Domain 图形思考法 PIP AI CLAP Password CC GIT TensorRT FP32 Template BTC Clash CTC XGBoost Breakpoint FlashAttention SPIE 证件照 Conda Excel Algorithm 继承 Docker 域名 DeepStream Paper NameSilo 版权 Math Cloudreve RL Image2Text Bipartite mmap Translation CV Jetson Mixtral 多线程 Use 第一性原理 UNIX Qwen2.5 Interview Bin Tiktoken 公式 tar Google OpenCV LLM Heatmap VSCode Permission PDF Card Miniforge Knowledge XML FP8 FP64 SVR LLAMA Hungarian v2ray EXCEL Website LoRA uWSGI CEIR Attention Tensor 腾讯云 关于博主 LaTeX Django Random Nginx TSV SQL Linux LeetCode GGML VPN 净利润 logger Bitcoin Shortcut v0.dev PyCharm Github 顶会 Freesound 签证 Magnet Quantize ModelScope Video Numpy Plotly Agent ONNX Bert 论文速读 Animate ChatGPT VGG-16 ResNet-50 Python CAM Input DeepSeek Vim Markdown tqdm Data scipy Proxy git-lfs 财报 PyTorch Hilton Hotel Distillation GPT4 Git Pandas UI ms-swift GoogLeNet 论文 NLP Sklearn Statistics Vmess 图标 FastAPI Search API Food BF16 Transformers SQLite Land BeautifulSoup Ptyhon C++ icon Quantization Firewall 强化学习 transformers COCO Paddle Jupyter 递归学习法 飞书 git YOLO MD5 Base64 OpenAI Crawler Dataset SAM InvalidArgumentError RGB Pillow GPTQ Llama Review 报税 HaggingFace FP16 HuggingFace CUDA Logo uwsgi Pickle Plate TTS Disk RAR Safetensors Claude WebCrawler Diagram torchinfo PDB Qwen2 printf 算法题 Anaconda IndexTTS2 NLTK Tracking Color Windows Pytorch Baidu 搞笑 News diffusers CSV TensorFlow JSON Web WAN QWEN Ubuntu Datetime 音频 hf OCR
站点统计

本站现有博文333篇,共被浏览906073次

本站已经建立2609天!

热门文章
文章归档
回到顶部