EADST

Quick Review: SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

作者：XD / 发表： 2023年12月6日 23:57 / 更新： 2023年12月6日 23:57 / 科研学习 / 阅读量：1804

SpQR: A Sparse-Quantized Representation for Near-Lossless Large Language Model Weight Compression

Core Approach:

  • GPTQ without Outliers: Focuses on eliminating outliers during the GPTQ process, enabling more efficient and accurate weight compression for large language models.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/225

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
下一篇
Quick Review: QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
Quantize DeepSeek GGML Pillow 搞笑 ONNX LLAMA Permission Conda Attention Bin Diagram BTC 域名 Pytorch Baidu Excel torchinfo Zip Search 递归学习法 InvalidArgumentError News TTS Proxy uWSGI PDB Review GPT4 Data C++ diffusers 音频 Video OCR FP64 Animate Plate Clash OpenAI Windows Vmess uwsgi Pandas printf v0.dev Gemma Paper TSV IndexTTS2 Dataset logger tar 多进程 Math Michelin FP32 FP8 图形思考法 GIT Linux Miniforge 报税 CLAP CTC 公式 ChatGPT Tiktoken SQL CAM Llama SAM CV Plotly Crawler 飞书 Mixtral Vim scipy Qwen2.5 MD5 Firewall FlashAttention v2ray Bitcoin CSV WebCrawler AI Hotel Numpy Interview SVR Django LLM SPIE VGG-16 NLP Distillation BeautifulSoup API PIP Tensor hf Claude NameSilo Anaconda Statistics FP16 RAR TensorFlow Color COCO Python XML 腾讯云 阿里云 llama.cpp Food NLTK Image2Text tqdm Jetson Password Ubuntu DeepStream Input Cloudreve 算法题 Domain Card Shortcut Google git-lfs Heatmap LoRA Base64 Translation UNIX Git Docker 签证 BF16 Github Augmentation SQLite Magnet Logo ResNet-50 Knowledge Land GPTQ PyCharm Nginx Web 云服务器 TensorRT Pickle 第一性原理 Quantization RGB Markdown HuggingFace Qwen 多线程 继承 HaggingFace LeetCode JSON CEIR YOLO 关于博主 Freesound OpenCV VSCode Paddle Streamlit UI Algorithm 财报 Transformers transformers Random Hilton Disk Bert Agent 证件照 CUDA Sklearn Website Breakpoint PyTorch Use Bipartite CC Ptyhon Jupyter Datetime git Hungarian 强化学习 mmap VPN 版权 Template PDF 净利润 XGBoost ModelScope LaTeX 顶会 QWEN Safetensors WAN Tracking EXCEL Qwen2 GoogLeNet FastAPI
站点统计

本站现有博文321篇,共被浏览763911次

本站已经建立2439天!

热门文章
文章归档
回到顶部