EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：2041

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
tqdm Quantization AI Search SVR News diffusers Use FastAPI LaTeX Algorithm Tensor Streamlit 域名 InvalidArgumentError Miniforge Bipartite uwsgi PDF Color TSV Land Qwen GoogLeNet v2ray 多线程 OCR Hotel LeetCode Math Nginx OpenAI COCO 飞书 Transformers scipy Base64 Paddle Ptyhon llama.cpp Llama ResNet-50 Vim Template Conda Hungarian Baidu Magnet ChatGPT FP16 净利润 NLP 递归学习法 Vmess 财报 uWSGI CEIR mmap Heatmap Cloudreve Ubuntu Input TensorRT 公式 Mixtral OpenCV Git EXCEL Excel icon HuggingFace Permission CV TTS Paper FP8 RGB 第一性原理 v0.dev Freesound VSCode 音频 Pytorch Review QWEN Plotly Password SQLite Attention Gemma Knowledge Firewall WebCrawler 强化学习 CSV GPTQ Video printf SQL git-lfs Crawler CUDA Pandas BeautifulSoup Numpy 版权 图标 Web GGML Bert Qwen2.5 Sklearn Michelin Anaconda Rebuttal Distillation UI FP32 Docker HaggingFace Augmentation Card Shortcut BF16 多进程 论文 腾讯云 Diagram ModelScope Hilton NLTK XGBoost GPT4 Django ONNX Zip 证件照 继承 Breakpoint Logo Jetson PyCharm Translation Random C++ Safetensors BTC Bin PIP TensorFlow SAM UNIX Image2Text PyTorch GIT CTC Domain CC CLAP Clash XML Proxy FP64 Pillow 顶会 Data Bitcoin 关于博主 图形思考法 论文速读 Website SPIE Tiktoken VGG-16 IndexTTS2 Python 算法题 NameSilo API FlashAttention PDB WAN Google 阿里云 Interview 签证 DeepStream 报税 Windows torchinfo CAM Statistics Agent Tracking Animate Food DeepSeek transformers RAR Claude tar Dataset Plate Qwen2 搞笑 LoRA Markdown Disk Pickle VPN hf Datetime logger LLM YOLO Quantize Jupyter 云服务器 Github LLAMA git JSON MD5 Linux
站点统计

本站现有博文328篇,共被浏览858187次

本站已经建立2566天!

热门文章
文章归档
回到顶部