EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：1818

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
域名 Anaconda DeepStream Heatmap VSCode SQLite uWSGI Safetensors Tracking FP8 Bitcoin Translation 算法题 Plate WAN HaggingFace COCO Base64 VGG-16 Paper Proxy Food Nginx Logo Permission OCR Tensor CAM Breakpoint Website Search TSV v0.dev Use torchinfo GIT Sklearn Streamlit Llama Card News C++ logger CLAP FP16 阿里云 Bin BeautifulSoup Math Password 递归学习法 Paddle Zip Pickle WebCrawler LeetCode Django SAM OpenAI Cloudreve Linux GGML PDB Statistics JSON Web 第一性原理 InvalidArgumentError Random Firewall XGBoost Gemma Conda NLP SQL Distillation FastAPI Windows 证件照 报税 Tiktoken git GPT4 MD5 TensorRT ModelScope Google Algorithm Pytorch Jupyter ResNet-50 Interview printf hf Jetson Animate BF16 diffusers NameSilo LoRA Crawler RGB Image2Text 飞书 强化学习 Land 版权 mmap Python Template Hotel Augmentation ONNX PyTorch Diagram YOLO tqdm 净利润 Hilton 顶会 GoogLeNet FP64 公式 CV git-lfs Vim Docker Miniforge Excel CTC FlashAttention Bert XML EXCEL SVR v2ray Numpy Qwen 云服务器 多线程 GPTQ 关于博主 LaTeX uwsgi BTC tar Attention Qwen2 PyCharm 继承 Baidu IndexTTS2 Claude Freesound 图形思考法 ChatGPT Michelin PDF llama.cpp Vmess Github PIP Shortcut Ptyhon scipy 腾讯云 UI LLAMA QWEN Input Quantize LLM 财报 VPN CC 音频 Transformers Ubuntu TTS transformers Color Disk Magnet HuggingFace Qwen2.5 CEIR AI FP32 Datetime Video Plotly Pandas Hungarian Mixtral 多进程 Domain NLTK Clash Dataset Quantization 搞笑 SPIE API Data Git Knowledge Agent TensorFlow Bipartite UNIX Markdown CUDA Review CSV DeepSeek RAR Pillow OpenCV 签证
站点统计

本站现有博文321篇,共被浏览767786次

本站已经建立2451天!

热门文章
文章归档
回到顶部