EADST

Quick Review: SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression

作者：XD / 发表： 2023年12月6日 23:57 / 更新： 2023年12月6日 23:57 / 科研学习 / 阅读量：2074

SpQR: A Sparse-Quantized Representation for Near-Lossless Large Language Model Weight Compression

Core Approach:

  • GPTQ without Outliers: Focuses on eliminating outliers during the GPTQ process, enabling more efficient and accurate weight compression for large language models.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/225

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
下一篇
Quick Review: QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
llama.cpp Video Base64 ChatGPT 签证 Freesound Claude 顶会 NLP 财报 Zip PDB Animate 飞书 JSON SPIE ModelScope Review GIT Distillation Bin CUDA Numpy SQLite Qwen2.5 Anaconda Use FP16 Miniforge Input Windows Jupyter Hungarian 第一性原理 AI RGB SAM HaggingFace Django News OpenAI mmap v2ray Plotly 公式 Jetson icon PIP Linux 腾讯云 LaTeX Tiktoken Data git Hotel Paddle Conda FP8 ResNet-50 C++ Sklearn TensorFlow Math EXCEL Ptyhon Tracking CAM TTS FlashAttention Quantize Password Plate 递归学习法 Streamlit COCO DeepStream Llama Translation NameSilo 云服务器 Color Attention 图标 Docker ms-swift scipy Crawler 论文速读 Domain 多线程 BF16 OpenCV Tensor LLM 关于博主 WAN SVR DeepSeek BeautifulSoup LLAMA VGG-16 GPTQ Safetensors CC PyCharm CV LeetCode MD5 Dataset uwsgi 证件照 v0.dev tqdm BTC Qwen Google Land tar Excel GoogLeNet 阿里云 图形思考法 FP32 WebCrawler torchinfo Augmentation FP64 GPT4 Diagram Cloudreve InvalidArgumentError Github Baidu 论文 RAR Proxy Pandas hf Permission Pytorch PDF Git Web YOLO Magnet UNIX Datetime Card Algorithm 多进程 Statistics Logo Disk CSV Hilton CEIR VPN Markdown 净利润 Python Website IndexTTS2 Template Bert ONNX RL Rebuttal Interview 报税 Search Michelin printf Pickle LoRA FastAPI Qwen2 Quantization Shortcut Gemma logger Nginx 继承 TensorRT Agent SQL TSV 域名 UI QWEN XGBoost GGML uWSGI 算法题 Vim Bipartite HuggingFace Paper Bitcoin Random transformers PyTorch Pillow Ubuntu diffusers 强化学习 API Vmess NLTK git-lfs Transformers Food Clash Mixtral XML 音频 VSCode Knowledge OCR CTC 搞笑 Breakpoint Image2Text 版权 Firewall CLAP Heatmap
站点统计

本站现有博文332篇,共被浏览882642次

本站已经建立2587天!

热门文章
文章归档
回到顶部