EADST

Quick Review: SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

作者：XD / 发表： 2023年12月6日 23:57 / 更新： 2023年12月6日 23:57 / 科研学习 / 阅读量：1951

SpQR: A Sparse-Quantized Representation for Near-Lossless Large Language Model Weight Compression

Core Approach:

  • GPTQ without Outliers: Focuses on eliminating outliers during the GPTQ process, enabling more efficient and accurate weight compression for large language models.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/225

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
下一篇
Quick Review: QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
uWSGI HuggingFace Crawler VPN GPTQ SPIE Clash XML 腾讯云 SQLite 关于博主 公式 JSON Docker LeetCode LaTeX CTC GPT4 git-lfs Ptyhon Disk Git Heatmap Paper FP16 Attention OCR 图标 Agent git BeautifulSoup YOLO Quantization PDB TTS 净利润 RAR VGG-16 Hotel XGBoost Statistics Tiktoken Translation Linux 搞笑 Logo Animate 多进程 diffusers transformers 顶会 CLAP Data NLTK VSCode MD5 LLM tar Cloudreve Firewall CAM LLAMA llama.cpp FP64 Qwen2.5 PyCharm Algorithm Augmentation printf Qwen2 Datetime HaggingFace Github 阿里云 强化学习 Math Markdown Streamlit Image2Text Pillow Shortcut 多线程 Diagram Nginx Bipartite SAM 算法题 DeepSeek RGB Bitcoin Anaconda Sklearn Paddle Vmess Baidu GGML uwsgi SVR EXCEL COCO GoogLeNet Hungarian WAN Proxy Dataset Interview Domain CV NLP Vim Template Quantize Magnet Jetson hf Claude OpenCV Land AI Plate FastAPI 论文 BTC BF16 继承 Miniforge v2ray CC GIT mmap Django UNIX Website Web CSV API ModelScope TSV LoRA 版权 Tensor Transformers Google IndexTTS2 Card Color ONNX InvalidArgumentError Bert 论文速读 CEIR 财报 Pytorch Knowledge torchinfo Search Python 音频 WebCrawler Input Tracking Video DeepStream Review Conda Distillation PDF FlashAttention Windows icon Excel 递归学习法 Llama C++ NameSilo Numpy 域名 Ubuntu tqdm Breakpoint logger CUDA Base64 图形思考法 FP32 News TensorRT Qwen Pickle 签证 Zip 证件照 Michelin FP8 ChatGPT QWEN Password Food Rebuttal Permission 云服务器 Freesound PyTorch Hilton Bin Mixtral Pandas 第一性原理 Use Random 报税 Safetensors Gemma PIP OpenAI v0.dev Plotly scipy Jupyter TensorFlow UI 飞书 SQL ResNet-50
站点统计

本站现有博文327篇,共被浏览834080次

本站已经建立2539天!

热门文章
文章归档
回到顶部