EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：1882

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
SQL GIT Plate WebCrawler CV QWEN Disk ONNX Safetensors 算法题 Card 净利润 RGB Datetime git uwsgi API ResNet-50 SVR Hungarian RAR Plotly Git Firewall transformers icon logger Statistics CLAP FP8 Hotel Paper NLP FP64 图形思考法 News GoogLeNet Tensor Password SPIE Python Heatmap MD5 XGBoost git-lfs Nginx Pytorch tar Anaconda Agent Domain DeepSeek C++ Tracking LoRA LeetCode Windows 多线程 Vmess FP16 Random Quantize Numpy ChatGPT Distillation 证件照 VPN 继承 Bin PDF 音频 Django YOLO NameSilo CC Use Ubuntu Diagram Search SQLite Pandas Conda Docker CAM 域名 tqdm Base64 Data EXCEL Crawler Jupyter 阿里云 FlashAttention v2ray Permission Transformers Sklearn Streamlit UNIX Color Knowledge Bipartite printf CSV FP32 ModelScope Magnet diffusers Vim XML OpenCV 第一性原理 Breakpoint Template GGML VGG-16 LLAMA Math 强化学习 AI torchinfo TTS BF16 Quantization PDB Google Linux Bitcoin GPTQ Jetson TensorRT Github hf InvalidArgumentError 签证 Miniforge Llama Baidu 搞笑 Paddle Review CEIR Website WAN PyCharm 飞书 OCR HuggingFace IndexTTS2 Logo FastAPI BeautifulSoup TensorFlow v0.dev Translation mmap PyTorch Input OpenAI Dataset LaTeX HaggingFace Zip SAM Tiktoken 腾讯云 JSON scipy Proxy 顶会 CUDA Algorithm Attention PIP CTC Video 版权 Bert Animate Web Cloudreve 公式 报税 Pickle 图标 UI Markdown DeepStream Gemma Hilton uWSGI Mixtral Land NLTK Qwen Michelin Qwen2.5 Shortcut Augmentation Ptyhon 云服务器 Pillow Freesound llama.cpp GPT4 LLM Claude Food TSV 多进程 Image2Text VSCode BTC 财报 Interview 关于博主 Clash 递归学习法 COCO Qwen2 Excel
站点统计

本站现有博文322篇,共被浏览789582次

本站已经建立2485天!

热门文章
文章归档
回到顶部