EADST

Quick Review: Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

作者：XD / 发表： 2023年12月6日 23:44 / 更新： 2023年12月6日 23:52 / 科研学习 / 阅读量：1841

Norm Tweaking: High-performance Low-bit Quantization of Large Language Models

Steps for Implementation:

  1. Generate Data: Prepare and preprocess the dataset suitable for training the model.
  2. GPTQ: Apply GPTQ method for optimizing the quantization precision of model parameters.
  3. Train LayerNorm Only: Focus on training the Layer Normalization component of the model for fine-tuning and optimization.

本文作者：XD 转载请标明出处：http://www.eadst.com/blog/223

本站采用知识共享署名-非商业性使用-相同方式共享 4.0 国际许可协议进行许可。

上一篇
Review: H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
下一篇
Quick Review: Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs
相关标签
LLM Quantization
About Me
XD
Goals determine what you are going to be.
Category
标签云
llama.cpp Shortcut LLAMA SVR CSV 图形思考法 NLP Bert UNIX Dataset LLM Proxy API Plate scipy 财报 GPTQ 多线程 Google git-lfs FP64 CTC Freesound uwsgi Windows torchinfo 版权 Llama Datetime 腾讯云 DeepStream Template FP32 EXCEL FP16 Distillation OCR Hungarian Heatmap tqdm Food CUDA Vmess GPT4 Logo ModelScope Conda Tiktoken 继承 Michelin 强化学习 LeetCode Safetensors Pillow Quantize Qwen2.5 uWSGI VGG-16 Pickle NLTK Algorithm Ptyhon 域名 git Agent Card Vim BTC Zip 音频 多进程 Miniforge Quantization Translation Base64 Sklearn printf 顶会 CEIR SAM Linux Attention COCO Breakpoint GoogLeNet Jupyter ONNX PyCharm BeautifulSoup TensorFlow PyTorch LoRA Use Transformers Bin Excel logger Mixtral Password Disk Crawler 公式 Hilton Tracking RAR 算法题 FP8 ResNet-50 PDB 飞书 CLAP News TTS Input Gemma JSON Magnet TensorRT transformers 第一性原理 CAM Hotel Baidu WAN Data v0.dev Diagram v2ray QWEN 净利润 签证 CV Bipartite C++ Animate Jetson Website Tensor hf Python Random Cloudreve WebCrawler NameSilo Web CC ChatGPT Firewall Image2Text LaTeX PIP diffusers Django 云服务器 Github Clash PDF 递归学习法 Streamlit 证件照 Ubuntu HuggingFace DeepSeek FastAPI XGBoost Land Docker Augmentation Permission Review XML Markdown 报税 Color tar Domain AI Nginx SPIE IndexTTS2 搞笑 HaggingFace Video Numpy Anaconda Pytorch InvalidArgumentError VSCode TSV Plotly RGB GIT Claude VPN Interview Qwen Paddle UI YOLO Math BF16 SQLite MD5 Pandas Paper Statistics Qwen2 关于博主 OpenCV OpenAI Bitcoin 阿里云 Git Search FlashAttention mmap SQL GGML Knowledge
站点统计

本站现有博文321篇,共被浏览779283次

本站已经建立2471天!

热门文章
文章归档
回到顶部