EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：1800

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
FP8 NLTK LaTeX Ptyhon 算法题 ChatGPT Numpy OpenCV RGB API BF16 Knowledge Miniforge 多进程 CSV Mixtral Docker LLAMA FP32 继承 公式 XML Pandas Domain Agent transformers Review 证件照 hf SAM Streamlit Template 多线程 scipy torchinfo CEIR Diagram Proxy UI BTC Claude TSV Transformers ResNet-50 Qwen Clash Augmentation Permission Jetson WebCrawler Random SPIE 域名 Tensor GPTQ Nginx 签证 CLAP diffusers Quantize printf 音频 Image2Text 报税 JSON 强化学习 Paper git-lfs tqdm GGML 阿里云 CAM 顶会 Paddle Color Attention GPT4 BeautifulSoup CTC Baidu PDF ONNX Jupyter Cloudreve Use DeepStream Llama FP64 LLM Statistics Qwen2 v0.dev Vmess FP16 InvalidArgumentError Heatmap Video Michelin HaggingFace AI Crawler 第一性原理 Datetime Vim Freesound Land YOLO Qwen2.5 Google Hotel Markdown CUDA NLP OCR Search Plotly GIT Base64 腾讯云 HuggingFace SQL C++ COCO Card UNIX Zip CV Pytorch git IndexTTS2 财报 tar NameSilo 净利润 Hilton Animate CC XGBoost Food mmap Sklearn OpenAI Translation Shortcut Ubuntu Safetensors Linux Bin Tiktoken TTS llama.cpp Algorithm PyTorch 图形思考法 Distillation SVR Anaconda Github Pickle uwsgi Excel PDB VSCode Bitcoin Magnet Hungarian Disk SQLite Firewall Gemma MD5 Windows RAR 飞书 logger LoRA GoogLeNet Quantization DeepSeek Plate 版权 Password Python uWSGI TensorRT Website Web QWEN FastAPI PyCharm Data 搞笑 v2ray LeetCode Django 递归学习法 Tracking EXCEL TensorFlow Pillow Input VPN Logo Interview Bert ModelScope WAN Math Conda Breakpoint PIP 关于博主 Bipartite VGG-16 Dataset News FlashAttention Git
站点统计

本站现有博文320篇,共被浏览759189次

本站已经建立2427天!

热门文章
文章归档
回到顶部