EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：2349

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
签证 SVR Interview UNIX BeautifulSoup Python Tiktoken Animate hf CC Tracking SQL CAM 证件照 Jev FlashAttention 算法题 BF16 GPT4 FP16 Distillation TSV Paper FP64 飞书 Pillow VPN DeepStream Review Docker SQLite Color XML Disk ModelScope LLAMA HaggingFace CSV Search Git Input Freesound logger GGML TensorFlow 云服务器 PyCharm icon RL CUDA COCO Nginx Miniforge NLTK Windows Qwen 财报 Qwen2 RGB Video 递归学习法 Knowledge Transformers Math 多线程 GPTQ Statistics Translation Bitcoin Website Quantize PyTorch LaTeX Vmess VGG-16 AI Quantization PDB Firewall 第一性原理 腾讯云 ms-swift Agent Sklearn FastAPI diffusers tqdm Bert Hungarian 论文 uWSGI Land Pytorch Heatmap NLP 关于博主 SPIE 净利润 Pickle Gemma GIT Llama Plotly Qwen2.5 Ptyhon printf FP32 OpenAI TensorRT Zip FP8 DeepSeek Tensor Template LeetCode 强化学习 ChatGPT VSCode C++ Use 继承 git Augmentation Google Card EXCEL Claude 搞笑 音频 QWEN Datetime 论文速读 Django ONNX BTC Crawler Vim Shortcut Algorithm 顶会 GoogLeNet Food Bin Markdown Paddle Random UI scipy WebCrawler llama.cpp mmap News NameSilo Numpy Pandas OpenCV Data Diagram Image2Text Streamlit Baidu Domain Breakpoint Hilton API v2ray RAR Conda 图标 XGBoost Dataset Safetensors IndexTTS2 Michelin TTS Bipartite git-lfs Harness Proxy v0.dev JSON InvalidArgumentError Linux 版权 ResNet-50 Cloudreve LoRA Permission Jupyter MD5 LLM 阿里云 Jetson 报税 Rebuttal torchinfo Ubuntu 域名 HuggingFace transformers API网关 公式 Password CV Excel Attention Anaconda Base64 CEIR YOLO Magnet Github 图形思考法 多进程 WAN SAM CLAP tar Web uwsgi PDF Clash Plate Logo PIP Hotel CTC Mixtral OCR
站点统计

本站现有博文338篇,共被浏览987924次

本站已经建立2700天!

热门文章
文章归档
回到顶部