EADST

Quick Review: SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

作者：XD / 发表： 2023年12月6日 23:57 / 更新： 2023年12月6日 23:57 / 科研学习 / 阅读量：1770

SpQR: A Sparse-Quantized Representation for Near-Lossless Large Language Model Weight Compression

Core Approach:

  • GPTQ without Outliers: Focuses on eliminating outliers during the GPTQ process, enabling more efficient and accurate weight compression for large language models.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/225

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
下一篇
Quick Review: QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
FastAPI C++ diffusers BTC Jetson BeautifulSoup Permission 腾讯云 Augmentation Transformers printf Interview TensorFlow LaTeX HuggingFace Excel PDF Distillation UNIX GoogLeNet CC TTS Vim Bitcoin Jupyter Input Pandas CV transformers 报税 Linux XGBoost Disk YOLO BF16 mmap Pillow LoRA 多线程 Shortcut Tiktoken hf Clash Docker TensorRT Cloudreve ChatGPT NLP PIP OpenAI DeepStream CUDA SQL LLM RAR Michelin GPTQ InvalidArgumentError Safetensors Base64 FP8 Qwen Diagram Hilton Ptyhon 公式 音频 Hotel EXCEL scipy UI CLAP SQLite Review Knowledge 阿里云 Github WAN uWSGI Logo llama.cpp Plotly git-lfs FP32 Pytorch GIT 多进程 CSV 关于博主 Algorithm Qwen2.5 Paper Quantize MD5 Django VGG-16 HaggingFace SPIE 域名 Land CEIR Quantization Git Llama Animate Miniforge CTC Crawler Proxy Sklearn Website Datetime Color Bin tqdm Breakpoint Food Statistics 算法题 git ModelScope Claude 飞书 VPN torchinfo WebCrawler 净利润 QWEN Magnet Plate tar COCO Use logger Anaconda Tracking Math Data Streamlit Conda XML Web Password SAM 搞笑 Mixtral Qwen2 Card Markdown 签证 FP64 Python VSCode PyTorch Freesound TSV FlashAttention GGML NLTK CAM IndexTTS2 LLAMA OCR Video GPT4 Google AI SVR ResNet-50 继承 PDB 版权 LeetCode FP16 Attention Firewall Tensor Vmess Dataset Paddle 财报 证件照 Hungarian Domain Bipartite API Pickle NameSilo uwsgi OpenCV Image2Text v0.dev ONNX Translation Baidu Ubuntu Random Numpy Heatmap Bert JSON Windows Template RGB Zip Agent Gemma v2ray Nginx DeepSeek PyCharm
站点统计

本站现有博文312篇,共被浏览744687次

本站已经建立2388天!

热门文章
文章归档
回到顶部