EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：1772

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
Food 腾讯云 Proxy llama.cpp CSV 算法题 Bin Magnet XML Vmess HuggingFace UNIX Permission Bipartite VGG-16 Zip CLAP GGML Crawler Image2Text Excel SVR 阿里云 hf PyTorch VPN JSON LeetCode Windows LLM LaTeX mmap 多线程 递归学习法 TTS PDB OpenCV Land PyCharm Ubuntu Animate Datetime FP64 Pytorch Llama git 飞书 v2ray Website Knowledge Django Logo Random CUDA RGB FlashAttention Baidu Disk HaggingFace Jetson uWSGI Use CC PDF NameSilo Clash Algorithm ResNet-50 搞笑 torchinfo tqdm Anaconda Nginx LLAMA Python GoogLeNet 多进程 FP8 logger PIP BTC InvalidArgumentError Plotly Google CAM Hungarian 关于博主 printf BF16 证件照 NLTK Pandas Github 版权 Markdown FP32 Math WAN v0.dev Plate Distillation Tiktoken TSV Qwen2.5 FP16 Statistics 图形思考法 Paddle Git Tracking Heatmap Web RAR Streamlit Breakpoint Hilton MD5 Linux TensorFlow Quantization uwsgi 公式 Tensor Michelin 签证 Color Conda FastAPI XGBoost SPIE YOLO SAM 继承 Template ModelScope BeautifulSoup 报税 C++ LoRA API Claude WebCrawler Pickle Ptyhon SQLite CV 净利润 Agent Qwen GIT CEIR TensorRT ChatGPT UI diffusers AI Dataset Transformers Cloudreve Docker Numpy Diagram scipy Interview Bert Vim QWEN Quantize DeepStream Augmentation Mixtral Attention Card Translation ONNX GPTQ Miniforge Review Freesound EXCEL IndexTTS2 Hotel Base64 GPT4 DeepSeek Qwen2 Gemma 财报 COCO transformers Shortcut 第一性原理 域名 Password Sklearn Firewall Safetensors Data OpenAI Domain CTC NLP Pillow OCR 音频 VSCode tar SQL Input Video git-lfs Paper Bitcoin Jupyter
站点统计

本站现有博文316篇,共被浏览746988次

本站已经建立2395天!

热门文章
文章归档
回到顶部