EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：2259

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
Transformers 签证 Animate Dataset Django Numpy 阿里云 BF16 UI AI 多线程 Python Vmess VPN 图标 git-lfs Safetensors LoRA Harness NLTK Data NLP SAM tqdm Google diffusers 云服务器 JSON 搞笑 Diagram CTC PDF Bin VGG-16 Proxy Mixtral GGML VSCode transformers llama.cpp LLM Pillow Docker UNIX Search XML Web Plotly git RAR FastAPI Markdown Paddle Hotel 财报 Color ms-swift Food DeepSeek Interview Jetson torchinfo Clash 强化学习 Pandas Hungarian WAN ChatGPT TSV 顶会 RL InvalidArgumentError ModelScope Bitcoin EXCEL API网关 Excel Statistics Augmentation Translation Distillation Password Windows FP64 继承 HuggingFace TensorFlow FP16 Nginx Heatmap CC Github 算法题 Template Tiktoken Anaconda 图形思考法 Baidu Llama MD5 Magnet OpenAI Attention tar Video Base64 OCR WebCrawler RGB 递归学习法 CAM LLAMA Agent Git Rebuttal Breakpoint TensorRT SVR CV Linux Logo Math SQLite PIP 第一性原理 FP32 NameSilo QWEN 论文 Disk Pytorch 净利润 Random Quantization XGBoost Pickle DeepStream Plate Bert Use GIT TTS Quantize Datetime Miniforge Conda 版权 Zip Card mmap 飞书 Ubuntu SPIE 域名 CEIR Streamlit LeetCode FlashAttention C++ Tensor CUDA 公式 Ptyhon v2ray Qwen2.5 GPTQ IndexTTS2 Qwen Sklearn 论文速读 scipy Gemma OpenCV FP8 CLAP COCO 证件照 Review Image2Text Permission uwsgi 多进程 YOLO Jupyter Land CSV Domain GPT4 Firewall LaTeX PDB ResNet-50 Crawler BeautifulSoup Tracking Algorithm Hilton ONNX Freesound hf Vim Website printf Qwen2 logger 关于博主 PyTorch SQL BTC GoogLeNet icon Michelin API 报税 News Knowledge v0.dev Cloudreve 音频 Claude Input Bipartite HaggingFace PyCharm 腾讯云 Shortcut uWSGI Paper
站点统计

本站现有博文336篇,共被浏览947898次

本站已经建立2658天!

热门文章
文章归档
回到顶部