EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：1998

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
Search Tiktoken JSON YOLO 报税 Rebuttal LeetCode CLAP Pytorch CTC Firewall Ptyhon 证件照 Land Excel C++ Color Ubuntu Transformers Numpy 递归学习法 搞笑 BF16 TSV Miniforge Statistics Animate Augmentation git-lfs llama.cpp 云服务器 Distillation UI TensorFlow Heatmap 关于博主 Plate Qwen FP16 Website Crawler Card transformers SPIE CV NameSilo OpenAI Diagram XML uwsgi COCO 财报 Michelin ResNet-50 Template WAN HuggingFace Pickle 第一性原理 Food Use Dataset Git Conda Password UNIX DeepSeek RGB Bin Plotly CAM CC FP64 图形思考法 Domain tqdm Random icon Proxy 公式 Cloudreve PyTorch diffusers Translation Attention PDB Knowledge Disk GIT API Pandas Anaconda v0.dev SQLite BTC GPTQ TensorRT 飞书 域名 TTS Breakpoint Sklearn Input DeepStream FlashAttention Review SQL PyCharm Vmess EXCEL BeautifulSoup Django QWEN 多线程 ChatGPT 净利润 Image2Text SAM PDF Base64 IndexTTS2 CUDA uWSGI 继承 v2ray Quantize InvalidArgumentError Pillow FP8 git Freesound Math GGML MD5 Github Zip torchinfo HaggingFace 多进程 Logo Magnet Video hf 论文速读 Linux Llama 签证 Claude Gemma Bitcoin LLM XGBoost Paper Safetensors RAR Quantization GPT4 强化学习 Baidu WebCrawler Agent CSV printf Hilton Nginx News OpenCV Clash Algorithm Bipartite ONNX 顶会 Python Vim Permission VSCode 音频 tar SVR Tensor PIP scipy VPN Windows Jetson Bert logger Data 图标 算法题 FastAPI Interview NLTK NLP LaTeX Datetime Markdown Docker Qwen2.5 ModelScope Shortcut Web Tracking Jupyter Hungarian Google Mixtral 论文 Paddle 阿里云 AI Hotel VGG-16 腾讯云 LoRA mmap Qwen2 GoogLeNet CEIR Streamlit LLAMA FP32 OCR 版权
站点统计

本站现有博文328篇,共被浏览840294次

本站已经建立2545天!

热门文章
文章归档
回到顶部