EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：1752

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
Streamlit FlashAttention logger Vmess Pillow TensorFlow Clash GPTQ InvalidArgumentError uWSGI LoRA mmap llama.cpp Animate Numpy Plotly Qwen Input FP64 tar v2ray Google C++ QWEN Tracking Miniforge Crawler GoogLeNet Datetime JSON GPT4 NLTK NameSilo 版权 GIT Website Paper 腾讯云 VGG-16 Quantize 算法题 PyTorch Land CSV Github Hilton CLAP OpenCV LLAMA Diagram LLM HuggingFace Pickle 公式 Food Proxy Markdown Tensor VSCode CTC Data Password TensorRT FP16 OpenAI DeepStream transformers 多进程 Freesound Cloudreve BF16 CUDA RGB 阿里云 MD5 Paddle IndexTTS2 Review Ubuntu Windows torchinfo BeautifulSoup WebCrawler Color ChatGPT XGBoost Random Bin scipy NLP Web Git YOLO Breakpoint BTC RAR Domain Sklearn tqdm Use Conda TSV Disk diffusers Docker 证件照 LaTeX AI Qwen2.5 Statistics SAM Mixtral FastAPI CEIR Translation Safetensors Video SQLite ModelScope 搞笑 Michelin printf Heatmap CV Django 继承 Bert CAM Bitcoin 多线程 PyCharm Gemma Math EXCEL git-lfs GGML CC COCO 财报 Algorithm 报税 PIP 净利润 PDF Pandas Base64 Python Logo Plate OCR uwsgi SVR Attention Transformers Interview Dataset 音频 git Anaconda 关于博主 域名 Ptyhon Qwen2 Claude 飞书 VPN 签证 Knowledge UI Jetson 视频信息 Linux Hungarian SQL Vim HaggingFace Zip UNIX WAN Hotel Bipartite SPIE FP32 PDB ONNX Baidu ResNet-50 Augmentation API Distillation FP8 LeetCode Nginx DeepSeek Permission Firewall TTS Jupyter Pytorch Magnet Excel Shortcut Image2Text v0.dev XML Template Quantization Tiktoken hf Llama Card
站点统计

本站现有博文311篇,共被浏览740102次

本站已经建立2377天!

热门文章
文章归档
回到顶部