EADST

Quick Review: SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

作者：XD / 发表： 2023年12月6日 23:57 / 更新： 2023年12月6日 23:57 / 科研学习 / 阅读量：1828

SpQR: A Sparse-Quantized Representation for Near-Lossless Large Language Model Weight Compression

Core Approach:

  • GPTQ without Outliers: Focuses on eliminating outliers during the GPTQ process, enabling more efficient and accurate weight compression for large language models.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/225

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
下一篇
Quick Review: QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
Breakpoint LLM Bert Quantize Card 域名 Attention GoogLeNet Excel Crawler mmap Base64 Jetson InvalidArgumentError 搞笑 ResNet-50 Tiktoken Google transformers Land Pillow Image2Text OCR tqdm Cloudreve VPN AI Magnet JSON Proxy Plotly OpenAI git-lfs VSCode Linux CLAP Animate CC UNIX 净利润 Anaconda Mixtral VGG-16 Web Firewall Search Dataset v0.dev Qwen2 Diagram Vim FlashAttention GPT4 SAM PIP FP32 FP16 Docker Tracking Sklearn TSV scipy HaggingFace XML GIT Pytorch Git Clash CTC Qwen2.5 阿里云 GGML Input PDB Ptyhon COCO Knowledge Python EXCEL Conda 证件照 NameSilo Plate Tensor Freesound Safetensors Permission llama.cpp Disk Bin Numpy BTC 多线程 Jupyter 顶会 Bitcoin 算法题 关于博主 第一性原理 Github FastAPI Website NLP WebCrawler Data PDF git Quantization Pickle Zip Color Baidu 递归学习法 Hungarian torchinfo Django Miniforge PyTorch Video SPIE Nginx Streamlit 财报 ModelScope GPTQ Ubuntu LLAMA CEIR Heatmap Paper CV Logo 继承 Hotel 音频 Qwen SQL Shortcut TensorFlow NLTK CAM OpenCV RAR 版权 Windows Algorithm MD5 XGBoost News UI LaTeX LoRA hf TensorRT HuggingFace 报税 CUDA Distillation Bipartite Gemma Datetime uwsgi 飞书 IndexTTS2 Domain SVR PyCharm Paddle diffusers Augmentation 签证 DeepSeek Random Use WAN QWEN ChatGPT printf SQLite Statistics Password 多进程 RGB FP64 Michelin Vmess BF16 Template Llama 公式 Review 强化学习 ONNX Pandas LeetCode Markdown Agent 腾讯云 YOLO Hilton TTS 云服务器 BeautifulSoup Translation logger 图形思考法 DeepStream Claude C++ Transformers Math uWSGI API v2ray FP8 tar Interview CSV Food
站点统计

本站现有博文321篇,共被浏览773803次

本站已经建立2463天!

热门文章
文章归档
回到顶部