EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：2209

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
Crawler Domain Windows FP16 Hotel 第一性原理 COCO Vim XML C++ Sklearn Mixtral 多进程 Tensor Linux icon 图形思考法 EXCEL Paper YOLO Tiktoken Input Bert Datetime FP32 Django SQLite XGBoost Heatmap 继承 TTS Algorithm Proxy scipy NLTK SVR Pickle hf Vmess BTC Random Pytorch PDB PyTorch CTC Video PIP CUDA ChatGPT Shortcut 关于博主 GGML v2ray Cloudreve Pandas 净利润 多线程 Permission mmap Image2Text UNIX git-lfs Breakpoint diffusers OCR Jupyter llama.cpp Hilton 论文速读 torchinfo 递归学习法 News Data LaTeX Magnet 报税 JSON Qwen2.5 Streamlit 强化学习 Card Firewall Rebuttal ResNet-50 QWEN Conda BF16 论文 Github ms-swift LoRA FastAPI Dataset Ubuntu Plotly uwsgi DeepSeek Google Michelin Hungarian Nginx Qwen2 Bin WebCrawler tar git RGB printf ONNX BeautifulSoup RL Excel LLAMA TSV CC RAR SAM CAM GPT4 Safetensors TensorRT 搞笑 CEIR PyCharm GPTQ 阿里云 签证 Tracking Claude VPN Zip 证件照 CSV Paddle Numpy CV FP64 公式 Land Search FP8 Website SQL Gemma Qwen MD5 Pillow Bipartite NLP Translation Python 云服务器 IndexTTS2 Statistics Diagram UI 算法题 GIT SPIE Attention LeetCode transformers Logo 飞书 VGG-16 Food VSCode DeepStream Bitcoin Ptyhon 音频 Augmentation Distillation 版权 NameSilo WAN OpenAI Animate Clash PDF Agent tqdm Miniforge Disk 腾讯云 Review Color HuggingFace Plate Git Anaconda 图标 Freesound Transformers Baidu Use ModelScope OpenCV 顶会 TensorFlow 财报 CLAP v0.dev Quantization HaggingFace GoogLeNet AI Math 域名 Markdown Knowledge Llama API Password Jetson FlashAttention Interview Base64 Template uWSGI Web logger Docker LLM Quantize InvalidArgumentError
站点统计

本站现有博文333篇,共被浏览923291次

本站已经建立2629天!

热门文章
文章归档
回到顶部