EADST

Quick Review: SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

作者：XD / 发表： 2023年12月6日 23:57 / 更新： 2023年12月6日 23:57 / 科研学习 / 阅读量：1787

SpQR: A Sparse-Quantized Representation for Near-Lossless Large Language Model Weight Compression

Core Approach:

  • GPTQ without Outliers: Focuses on eliminating outliers during the GPTQ process, enabling more efficient and accurate weight compression for large language models.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/225

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
下一篇
Quick Review: QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
Video FlashAttention SQL Math 继承 Linux Hotel NameSilo VGG-16 Bitcoin 签证 Permission Bin FP32 Review Freesound Disk Pytorch Algorithm GoogLeNet WebCrawler Data CTC 算法题 transformers GPT4 Clash uWSGI Quantization Card Heatmap RAR InvalidArgumentError Paddle Template OCR Color Baidu tar git-lfs Tracking Proxy Random Ubuntu PyTorch Qwen PIP Jupyter 关于博主 FP16 WAN Llama PDB Qwen2 HuggingFace Tiktoken Github Tensor CEIR Statistics 顶会 mmap 搞笑 CAM Pillow PDF SPIE LoRA 图形思考法 Logo 多线程 证件照 Plotly Knowledge SAM BTC printf LaTeX FastAPI Distillation Paper RGB llama.cpp Docker Quantize Bipartite MD5 净利润 UNIX FP64 DeepStream UI BF16 Vim Datetime Use YOLO Firewall DeepSeek Food JSON Ptyhon Magnet Nginx 财报 Land 阿里云 Interview API AI Translation Pickle Markdown Diagram v2ray CV hf TensorRT Mixtral Hilton VPN OpenCV ModelScope IndexTTS2 PyCharm VSCode Agent Claude Streamlit TTS Domain LLAMA ResNet-50 uwsgi logger Pandas Conda Sklearn Attention Crawler BeautifulSoup Shortcut ChatGPT Search Image2Text LeetCode Breakpoint 飞书 Vmess CC Transformers ONNX Jetson Animate Cloudreve Python v0.dev Web COCO git Michelin TSV Dataset 第一性原理 torchinfo 多进程 QWEN CUDA GGML Git 域名 Augmentation XML HaggingFace OpenAI LLM GIT Gemma 公式 NLP Hungarian Miniforge FP8 Google Zip 强化学习 TensorFlow C++ CSV 腾讯云 Qwen2.5 XGBoost SQLite EXCEL Numpy diffusers Password tqdm Django Safetensors Excel SVR Bert CLAP 音频 递归学习法 版权 Plate Windows NLTK scipy Base64 报税 Input Anaconda GPTQ Website
站点统计

本站现有博文319篇,共被浏览753469次

本站已经建立2411天!

热门文章
文章归档
回到顶部