EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：2113

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
PyCharm ChatGPT Docker mmap ResNet-50 LoRA CEIR 图标 NameSilo Google Windows Clash HaggingFace SQLite Linux Freesound Baidu 递归学习法 财报 Tiktoken XGBoost Ubuntu Bin Vim llama.cpp 报税 Pytorch 域名 Domain Base64 Vmess Qwen2.5 GPT4 Git 顶会 RL RAR YOLO 飞书 IndexTTS2 hf Use OCR Shortcut Cloudreve BTC icon Tracking XML 搞笑 AI Template CUDA HuggingFace LeetCode Transformers Qwen Heatmap Python Augmentation GGML Jetson GoogLeNet Hilton Streamlit Numpy Conda Quantization Translation Bipartite FP64 WebCrawler LLM tqdm COCO Hungarian torchinfo Statistics 公式 腾讯云 InvalidArgumentError GPTQ Quantize FP32 Random uWSGI 论文 TTS 继承 Hotel UI LaTeX Pickle Mixtral JSON Breakpoint Pandas Safetensors SQL Datetime Rebuttal Bitcoin Knowledge Interview DeepSeek Data Distillation 强化学习 Color VPN NLTK SAM RGB Disk v0.dev UNIX PDF Plate Agent Paddle Markdown Claude logger Food Proxy DeepStream FlashAttention Qwen2 Permission CLAP 阿里云 uwsgi BeautifulSoup Crawler tar Bert 论文速读 Gemma printf WAN Anaconda 版权 图形思考法 Web Algorithm Zip SVR 签证 Magnet Password C++ FP16 git-lfs Plotly CSV scipy Tensor TensorFlow Django 净利润 Sklearn GIT Paper Dataset CC FP8 CAM Video PIP Land Attention v2ray EXCEL MD5 多线程 Pillow 音频 CTC 第一性原理 云服务器 关于博主 CV Card QWEN LLAMA VSCode NLP git Github OpenAI Diagram VGG-16 Website ModelScope TSV Miniforge ms-swift PyTorch Animate TensorRT Search 多进程 ONNX Logo transformers 算法题 BF16 FastAPI API Review Math 证件照 Ptyhon Jupyter Excel Nginx diffusers Image2Text Michelin Firewall News PDB OpenCV Input SPIE Llama
站点统计

本站现有博文332篇,共被浏览882273次

本站已经建立2587天!

热门文章
文章归档
回到顶部