EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：2296

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
Git Nginx Python UNIX v2ray Search OpenAI 腾讯云 Claude llama.cpp Augmentation CV Windows GPTQ XGBoost scipy tar WAN Qwen2 Interview Bipartite PIP VSCode OCR 图标 Anaconda Website torchinfo IndexTTS2 Distillation 算法题 DeepSeek CC Input NLTK 证件照 Freesound Diagram Review ONNX ResNet-50 RGB icon Hotel GPT4 Pytorch LoRA Mixtral XML hf API网关 InvalidArgumentError Firewall Transformers Crawler Breakpoint Qwen2.5 Logo Tracking 第一性原理 Ptyhon 继承 SAM LaTeX PyCharm Jev Rebuttal logger Cloudreve Vmess Shortcut BF16 Data SQLite Template Ubuntu Michelin TensorFlow RL News Clash Algorithm 多进程 净利润 TensorRT Miniforge Sklearn PDF Paddle Translation Image2Text Knowledge Attention ms-swift Django 云服务器 Streamlit AI Jupyter OpenCV Bin Hilton Food EXCEL Web Plotly UI Gemma Color MD5 FP8 Jetson Math transformers Random SVR YOLO 飞书 FastAPI 音频 Pickle Zip Docker Quantize 公式 FP32 Land CUDA C++ 阿里云 Magnet Video Datetime tqdm 多线程 Plate GIT COCO Statistics Disk Qwen 关于博主 CAM GoogLeNet printf Bitcoin CLAP Quantization 报税 Conda Github API Use Llama Animate Domain 强化学习 PyTorch HuggingFace DeepStream TTS Password FP64 GGML VGG-16 mmap Tensor Bert v0.dev SQL Google BeautifulSoup CEIR Baidu FlashAttention QWEN diffusers 顶会 CSV Heatmap 图形思考法 Hungarian Proxy PDB Harness Vim HaggingFace VPN LLM 论文 BTC TSV git 签证 uwsgi git-lfs Safetensors ChatGPT Numpy CTC Dataset Pandas Paper Excel Card RAR SPIE JSON 递归学习法 搞笑 财报 LeetCode Agent ModelScope Markdown Pillow NameSilo Tiktoken 论文速读 NLP 版权 域名 uWSGI WebCrawler FP16 Permission LLAMA Base64 Linux
站点统计

本站现有博文338篇,共被浏览966534次

本站已经建立2679天!

热门文章
文章归档
回到顶部