EADST

Quick Review: SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

作者：XD / 发表： 2023年12月6日 23:57 / 更新： 2023年12月6日 23:57 / 科研学习 / 阅读量：1755

SpQR: A Sparse-Quantized Representation for Near-Lossless Large Language Model Weight Compression

Core Approach:

  • GPTQ without Outliers: Focuses on eliminating outliers during the GPTQ process, enabling more efficient and accurate weight compression for large language models.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/225

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
下一篇
Quick Review: QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
Qwen2.5 Disk Website Distillation Color LLM Jupyter FlashAttention Anaconda Web 版权 PDF Interview Crawler Proxy VSCode Excel ONNX BTC Streamlit C++ Image2Text Use PIP Tracking Plotly YOLO HaggingFace Pandas Food PDB Hungarian RAR Mixtral Pytorch Zip tqdm Michelin printf 阿里云 Video GGML CTC 多线程 Hotel CV Input mmap git LLAMA COCO SPIE NLTK 算法题 WebCrawler Pillow Git Jetson Vmess Bitcoin uwsgi Review ModelScope FP8 Github FP64 VPN PyTorch Password PyCharm 域名 CLAP Diagram CSV Breakpoint Translation Claude Tensor scipy Logo Transformers Pickle API GIT 净利润 证件照 hf InvalidArgumentError Ptyhon diffusers GPT4 Google Domain Statistics Template NLP Windows TSV OCR Quantize GoogLeNet SQLite Python Animate TensorRT Gemma AI 飞书 Knowledge Hilton WAN Augmentation torchinfo Math Miniforge 报税 Data QWEN FP16 视频信息 Llama JSON Markdown FP32 VGG-16 Baidu EXCEL Land CUDA Datetime Qwen2 RGB Bert Quantization LaTeX 公式 DeepSeek XGBoost tar Attention v2ray uWSGI 腾讯云 logger transformers Magnet Shortcut Firewall 继承 BF16 SVR SAM Conda Paper LoRA Nginx Bin 搞笑 SQL FastAPI Clash Tiktoken Freesound MD5 Cloudreve GPTQ Card UI UNIX Qwen Docker Paddle 音频 CAM XML DeepStream TTS 签证 财报 Permission Plate Algorithm v0.dev IndexTTS2 Django 关于博主 OpenAI Linux Dataset Random Bipartite Safetensors NameSilo TensorFlow Sklearn CC Numpy git-lfs llama.cpp BeautifulSoup Ubuntu LeetCode ResNet-50 Base64 ChatGPT OpenCV Vim 多进程 HuggingFace Heatmap CEIR
站点统计

本站现有博文311篇,共被浏览740160次

本站已经建立2377天!

热门文章
文章归档
回到顶部