EADST

Quick Review: SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

作者：XD / 发表： 2023年12月6日 23:57 / 更新： 2023年12月6日 23:57 / 科研学习 / 阅读量：2172

SpQR: A Sparse-Quantized Representation for Near-Lossless Large Language Model Weight Compression

Core Approach:

  • GPTQ without Outliers: Focuses on eliminating outliers during the GPTQ process, enabling more efficient and accurate weight compression for large language models.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/225

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
下一篇
Quick Review: QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
强化学习 Random BF16 图形思考法 TSV hf Video Ptyhon tar CTC Hilton 签证 IndexTTS2 Animate Mixtral Datetime Ubuntu GIT 算法题 Gemma PyTorch Qwen2.5 继承 Attention v0.dev Miniforge 飞书 Image2Text 阿里云 Math NLP mmap Hotel Excel PyCharm SAM WebCrawler Github 腾讯云 CEIR 音频 Transformers torchinfo Safetensors 论文速读 Jupyter CSV ModelScope Proxy Web QWEN Card NameSilo EXCEL OpenAI Pickle Bert Diagram LeetCode API 第一性原理 Search LLM CUDA PDB Food C++ Python Distillation VSCode 域名 Rebuttal Use Crawler 论文 Google 多进程 TTS Magnet tqdm Translation Shortcut Bipartite transformers Algorithm diffusers Llama CLAP Bin GoogLeNet Qwen2 Input Quantize Michelin 关于博主 Tensor 多线程 git Password RGB Windows RL NLTK git-lfs Paddle Color Streamlit Tiktoken Base64 Augmentation RAR Tracking SVR SQL ms-swift FastAPI Plate Paper AI Disk Sklearn PDF DeepSeek Anaconda Claude Zip LaTeX logger BTC VGG-16 COCO 公式 Domain FP16 Pillow XML Logo llama.cpp Bitcoin ONNX SQLite 证件照 uwsgi MD5 Website 版权 Qwen TensorRT LoRA Nginx icon XGBoost FlashAttention Data DeepStream GPTQ ChatGPT JSON 云服务器 OCR Vim Docker Agent Breakpoint Hungarian CAM UI Land 递归学习法 Plotly Git Conda HuggingFace 财报 Statistics 图标 FP32 Clash Baidu uWSGI Markdown Permission PIP 搞笑 报税 CC GGML Django 顶会 FP64 scipy LLAMA OpenCV Interview Cloudreve 净利润 Vmess YOLO ResNet-50 Dataset News TensorFlow CV WAN GPT4 VPN HaggingFace Pandas FP8 printf Numpy SPIE Template UNIX Knowledge BeautifulSoup Freesound InvalidArgumentError Pytorch Firewall Heatmap Linux Review v2ray Jetson Quantization
站点统计

本站现有博文333篇,共被浏览923217次

本站已经建立2629天!

热门文章
文章归档
回到顶部