EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：1964

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
XGBoost SPIE YOLO git-lfs SAM 顶会 hf Video CLAP Base64 ChatGPT Django Python mmap GIT Animate PDF GoogLeNet Diagram Augmentation Pillow Linux Windows 算法题 InvalidArgumentError CSV CC Markdown C++ 第一性原理 NLP 域名 Excel Knowledge SQLite Pickle Color OpenCV transformers Attention 腾讯云 Claude RGB Jetson DeepSeek Clash 报税 LoRA Land Freesound ModelScope tqdm Google Website tar Paper Firewall Safetensors Domain GPTQ Llama WAN PDB Food PyCharm 继承 Vmess logger UI Mixtral 财报 TSV uWSGI PyTorch 图标 Algorithm MD5 diffusers Pytorch printf CTC 多线程 Hotel Hungarian DeepStream Crawler XML Permission Dataset 净利润 OCR BeautifulSoup Heatmap TensorRT VSCode v0.dev Use Data OpenAI Git Zip GPT4 Magnet CAM v2ray FP32 LeetCode Ptyhon llama.cpp FP8 HaggingFace Transformers COCO NLTK 音频 EXCEL Math API Numpy 证件照 PIP Qwen2 Cloudreve Statistics Ubuntu 阿里云 Bipartite Proxy FP64 torchinfo Input uwsgi Baidu Disk Random Vim Jupyter Sklearn Quantization WebCrawler scipy Template Breakpoint Conda Web HuggingFace Docker VGG-16 云服务器 FlashAttention Shortcut 版权 Logo LaTeX Card Plotly ResNet-50 Image2Text 递归学习法 Datetime Translation NameSilo Github FastAPI QWEN Tracking Plate Rebuttal Distillation UNIX Anaconda Pandas AI Bert Paddle Bin Qwen2.5 icon FP16 Quantize 飞书 Gemma IndexTTS2 Nginx 公式 Miniforge SVR BTC Interview BF16 Review Streamlit Search JSON LLAMA 关于博主 签证 git TTS ONNX 搞笑 GGML Hilton Tensor 图形思考法 CEIR Michelin CUDA VPN 论文速读 Password SQL Qwen 多进程 Tiktoken TensorFlow Bitcoin 强化学习 Agent LLM News CV RAR
站点统计

本站现有博文326篇,共被浏览823830次

本站已经建立2529天!

热门文章
文章归档
回到顶部