EADST

CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING

FP8位数解析

在 AI 模型越来越庞大的今天,我们面临的不仅是算力挑战,更有带宽、能耗和模型部署的瓶颈。正因如此,更高效的数值表示方式成为突破口,其中最受关注的就是 FP8(8位浮点数)格式。

CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING

Quick Review: ZeroQuant-FP

ZeroQuant-FP: A Leap Forward in LLMs Post-Training W4A8 Quantization Using Floating-Point Formats

Paper: https://arxiv.org/abs/2307.09782

Code: https://github.com/microsoft/DeepSpeed

Organization: Microsoft

CONTINUE READING
CONTINUE READING
CONTINUE READING
CONTINUE READING
About Me
XD
Goals determine what you are going to be.
Category
标签云
阿里云 RL QWEN 多线程 Permission YOLO 论文速读 SVR ms-swift 音频 AI 域名 Agent Gemma v2ray Freesound ONNX WebCrawler VPN 搞笑 NLTK Hungarian Streamlit MD5 PDF LeetCode Plotly RAR HuggingFace Transformers Website transformers Windows Cloudreve Google Dataset 图形思考法 tqdm VGG-16 GGML Claude OCR LaTeX Magnet Baidu Rebuttal Web Animate TensorRT mmap 顶会 RGB 飞书 EXCEL 图标 LoRA Bipartite Datetime Github XML CUDA Miniforge Anaconda CV Qwen tar Bert CEIR Nginx Jetson BF16 Password CSV Vmess FlashAttention 腾讯云 Algorithm Python 递归学习法 Clash scipy Tensor Pillow FP64 Color ModelScope Interview IndexTTS2 API GPTQ Image2Text Docker Breakpoint Michelin DeepSeek Hotel Vim LLAMA 财报 Shortcut CC Quantization TSV Bitcoin UI Zip Quantize Logo FastAPI git-lfs Translation Proxy Firewall Excel 净利润 DeepStream Statistics HaggingFace CAM Numpy 继承 XGBoost Food 关于博主 icon SQLite 报税 Tracking Template Linux Random 版权 Harness Sklearn 多进程 签证 ResNet-50 Mixtral OpenAI 第一性原理 Jupyter Llama PDB 公式 Qwen2 VSCode Card JSON Pandas CLAP diffusers 算法题 torchinfo 云服务器 强化学习 Safetensors WAN Django logger SAM Qwen2.5 Land BTC C++ Crawler OpenCV v0.dev Bin Conda TensorFlow SQL Search Review Input Diagram Hilton Video InvalidArgumentError LLM printf Disk Pickle BeautifulSoup Ptyhon Heatmap Base64 CTC PyCharm PIP Git Distillation GPT4 FP8 Jev git Data GIT uwsgi Pytorch Paddle COCO Domain llama.cpp GoogLeNet uWSGI SPIE PyTorch 证件照 Paper News API网关 NameSilo Use UNIX FP32 Tiktoken ChatGPT FP16 Markdown Plate 论文 Ubuntu Knowledge Attention TTS Math NLP Augmentation hf
站点统计

本站现有博文337篇,共被浏览957665次

本站已经建立2669天!

热门文章
文章归档
回到顶部