EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：2217

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
Shortcut CSV 顶会 CUDA Permission Baidu Python Safetensors AI Algorithm TSV Use Crawler 多线程 Pickle Qwen2 Input FP32 tqdm FP8 Data Streamlit Michelin transformers OCR Pandas Mixtral logger Paddle LeetCode SVR LoRA MD5 音频 Datetime Base64 Sklearn Windows 论文 Vmess News torchinfo Video Docker GoogLeNet Review Quantize Knowledge LLAMA Vim Interview XGBoost 云服务器 Qwen2.5 Domain tar Bipartite Food Breakpoint LaTeX TensorFlow 论文速读 Proxy HuggingFace Dataset NLTK Git 搞笑 uWSGI Conda ResNet-50 CV CTC Template Hotel Google C++ Hilton API BTC Gemma ModelScope uwsgi scipy Linux NameSilo OpenCV GIT Claude Statistics Qwen Numpy hf Plotly Cloudreve ms-swift RGB Bitcoin Heatmap 算法题 FP64 Math SPIE CEIR Tiktoken Django Hungarian Animate Distillation 域名 git-lfs Land Pillow ChatGPT Miniforge 腾讯云 llama.cpp Attention Zip ONNX UNIX Color 净利润 Translation VSCode NLP GPTQ TensorRT PDF diffusers Tensor Github PIP LLM Tracking TTS Quantization PyCharm FP16 v0.dev Image2Text Card FastAPI GGML Transformers Bert HaggingFace VGG-16 DeepStream Freesound BeautifulSoup WebCrawler Plate EXCEL Agent COCO Paper SQLite git v2ray 强化学习 Jetson 继承 Jupyter Pytorch Ptyhon JSON 证件照 WAN Augmentation Markdown Bin Website Rebuttal Ubuntu SQL 第一性原理 CAM SAM GPT4 VPN PyTorch Random Password UI Diagram 递归学习法 mmap Disk icon QWEN PDB Web 图标 公式 关于博主 Search 签证 图形思考法 Nginx OpenAI 飞书 DeepSeek IndexTTS2 Excel printf Anaconda Magnet CLAP Logo Clash CC 报税 Firewall Llama FlashAttention RAR 版权 BF16 RL 多进程 财报 阿里云 YOLO XML InvalidArgumentError
站点统计

本站现有博文333篇,共被浏览927563次

本站已经建立2635天!

热门文章
文章归档
回到顶部