EADST

CONTINUE READING
CONTINUE READING
CONTINUE READING

Quick Review: ZeroQuant-FP

ZeroQuant-FP: A Leap Forward in LLMs Post-Training W4A8 Quantization Using Floating-Point Formats

Paper: https://arxiv.org/abs/2307.09782

Code: https://github.com/microsoft/DeepSpeed

Organization: Microsoft

CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
  • 1
  • About Me
    XD
    Goals determine what you are going to be.
    Category
    标签云
    Augmentation MD5 算法题 Attention Distillation CC Ptyhon Dataset PyCharm TensorRT LeetCode Quantization Gemma Input Domain Land Hilton OCR Bin tar 签证 Tensor uwsgi Disk Pickle 云服务器 Michelin mmap 报税 Math FP32 FlashAttention RL Ubuntu GoogLeNet 顶会 Tracking Streamlit transformers LLM LoRA Food scipy QWEN 域名 Paper FP64 v0.dev Password Website uWSGI DeepSeek TSV TensorFlow Shortcut Pytorch 搞笑 Qwen2.5 RAR 证件照 Jetson Zip Random PIP Google Rebuttal AI Anaconda CV torchinfo Animate 论文 WebCrawler HaggingFace 论文速读 TTS Claude GPT4 NLP ResNet-50 diffusers XGBoost Qwen Markdown llama.cpp Django 继承 Plotly SPIE WAN Review Python 多进程 GGML 递归学习法 FP8 API 公式 Windows EXCEL CAM Crawler Firewall Magnet LaTeX Use Logo OpenCV JSON logger Baidu Datetime CSV SAM Docker Search tqdm Cloudreve Interview Llama Data UNIX Qwen2 git-lfs v2ray Heatmap Conda News 音频 VSCode XML 净利润 Diagram FastAPI InvalidArgumentError Web VPN Plate 图标 Image2Text 财报 阿里云 关于博主 Color Pandas Transformers IndexTTS2 Freesound Hungarian icon Jupyter LLAMA RGB Git 腾讯云 PDB ms-swift SQLite hf Permission ChatGPT Quantize Algorithm SQL Nginx Video Vmess BF16 Tiktoken 多线程 Translation UI Github Statistics BeautifulSoup Vim Bitcoin Bert CUDA C++ Miniforge ONNX Linux Sklearn Excel NameSilo 版权 CEIR PyTorch Card GPTQ 飞书 FP16 第一性原理 Pillow Template SVR Clash 强化学习 Bipartite Mixtral NLTK VGG-16 PDF git BTC CTC Base64 Hotel YOLO Agent CLAP Numpy 图形思考法 Knowledge printf HuggingFace Safetensors GIT Paddle ModelScope Breakpoint DeepStream Proxy COCO OpenAI
    站点统计

    本站现有博文333篇,共被浏览916348

    本站已经建立2621天!

    热门文章
    文章归档
    回到顶部