EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：2164

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
图标 论文 多线程 Website Qwen Zip Tracking Video LLM 顶会 Google uwsgi Search Pandas Anaconda PDF FP16 ResNet-50 UI DeepStream 图形思考法 SQLite Python COCO Qwen2 搞笑 财报 Algorithm Paper FP32 PIP GPTQ CUDA 强化学习 版权 ModelScope GPT4 Translation Web Conda Dataset C++ Permission VPN SAM v2ray CLAP PyTorch transformers API Linux FastAPI Mixtral Agent Quantization 公式 uWSGI Review BeautifulSoup FP64 Hotel Disk 云服务器 JSON 飞书 Augmentation 第一性原理 Jetson XGBoost TTS BTC GoogLeNet 签证 Transformers BF16 Claude Shortcut Math Llama CEIR Logo Image2Text Miniforge Excel CV 腾讯云 News Data 关于博主 DeepSeek GIT Card Hungarian InvalidArgumentError FlashAttention Use LoRA LeetCode llama.cpp Qwen2.5 NLP Diagram TSV Crawler icon XML Jupyter TensorRT Plate torchinfo git Color EXCEL ms-swift Sklearn Paddle Michelin Git 算法题 ChatGPT Vmess Django Heatmap Github Bipartite NameSilo Rebuttal NLTK Tensor MD5 Food Baidu Clash v0.dev Animate CSV Interview SQL tqdm PyCharm scipy hf LLAMA WebCrawler Random HaggingFace VGG-16 FP8 Vim UNIX IndexTTS2 mmap LaTeX Distillation Magnet YOLO Streamlit GGML Land Firewall Numpy Datetime 阿里云 净利润 Knowledge HuggingFace Gemma Pytorch RAR Plotly Pickle 递归学习法 OpenCV VSCode WAN Statistics QWEN Breakpoint AI OpenAI CC printf 证件照 CTC Nginx Pillow 多进程 继承 报税 Quantize Ptyhon 域名 Tiktoken RGB Base64 Bin diffusers Bitcoin Password tar CAM 音频 Windows SVR Hilton Template 论文速读 Proxy git-lfs Bert Freesound Attention Docker ONNX PDB OCR Input SPIE Domain Ubuntu Markdown Safetensors Cloudreve logger RL TensorFlow
站点统计

本站现有博文333篇,共被浏览906013次

本站已经建立2608天!

热门文章
文章归档
回到顶部