EADST

CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING

FP8位数解析

在 AI 模型越来越庞大的今天,我们面临的不仅是算力挑战,更有带宽、能耗和模型部署的瓶颈。正因如此,更高效的数值表示方式成为突破口,其中最受关注的就是 FP8(8位浮点数)格式。

CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING

Quick Review: ZeroQuant-FP

ZeroQuant-FP: A Leap Forward in LLMs Post-Training W4A8 Quantization Using Floating-Point Formats

Paper: https://arxiv.org/abs/2307.09782

Code: https://github.com/microsoft/DeepSpeed

Organization: Microsoft

CONTINUE READING
About Me
XD
Goals determine what you are going to be.
Category
标签云
Qwen2 PDF ResNet-50 Proxy CEIR OpenAI Bitcoin CUDA Knowledge VSCode Ptyhon torchinfo Gemma Web Freesound 证件照 Datetime Color AI Clash mmap CAM PIP XML LLM 净利润 Shortcut Pillow 音频 HuggingFace SVR printf C++ Transformers Pytorch Pickle Tensor Interview diffusers scipy git-lfs LaTeX FlashAttention Permission YOLO DeepSeek PyTorch Jetson Hungarian Breakpoint GIT PyCharm Michelin ModelScope 搞笑 LLAMA Nginx Input 签证 Bin TensorFlow API SAM Bipartite Template transformers RGB 多进程 Zip 版权 Quantization JSON Ubuntu PDB InvalidArgumentError Heatmap CSV ChatGPT LeetCode Random Data TSV Paper FastAPI NLTK Diagram Django 图形思考法 Algorithm 公式 SQL 继承 Plate Crawler Conda Vim hf FP16 GPTQ Hotel Miniforge Excel Pandas Card Baidu Review llama.cpp Search NameSilo Google CV Paddle 腾讯云 VGG-16 TensorRT Safetensors Video ONNX Quantize Markdown Git 第一性原理 OCR Dataset NLP Agent Jupyter git SQLite Bert Sklearn Vmess WAN Claude Streamlit Firewall Python UI HaggingFace Image2Text EXCEL COCO 算法题 Math BF16 Github TTS uWSGI 关于博主 多线程 FP64 RAR Cloudreve Qwen2.5 Numpy XGBoost Tiktoken BTC GGML UNIX GoogLeNet Attention 报税 CLAP Linux Anaconda Augmentation CC CTC Distillation LoRA Food DeepStream Windows VPN Password MD5 FP8 Land logger WebCrawler 飞书 Hilton Statistics v2ray Use tqdm Translation BeautifulSoup GPT4 Base64 Plotly Qwen tar FP32 Tracking 财报 Magnet Website Logo 递归学习法 Animate Domain Docker IndexTTS2 Mixtral Llama OpenCV uwsgi QWEN 阿里云 SPIE 域名 Disk v0.dev
站点统计

本站现有博文317篇,共被浏览748483

本站已经建立2399天!

热门文章
文章归档
回到顶部