EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
算法题 Firewall 图标 Baidu Image2Text SPIE MD5 XGBoost BeautifulSoup hf FP16 torchinfo 腾讯云 Augmentation TSV FP8 COCO git-lfs LLM 签证 git Video Safetensors Heatmap Use NLTK Cloudreve QWEN Statistics ms-swift CV 顶会 Domain Bitcoin EXCEL Docker printf Miniforge Pillow 公式 FP32 搞笑 Dataset LoRA Nginx Hotel Django Random Datetime logger FP64 ChatGPT Bert Qwen2 tar ResNet-50 ModelScope Anaconda Permission Linux LLAMA OpenAI OpenCV Google Jetson Streamlit Pandas Windows 报税 Claude Qwen Harness scipy TTS GIT 版权 Card Qwen2.5 Python Transformers uWSGI Tensor Mixtral C++ 强化学习 Color RL Excel Pickle Animate SAM 关于博主 继承 Tiktoken PyCharm XML 第一性原理 API网关 Sklearn Magnet Jupyter OCR Hilton CSV tqdm 论文速读 Diagram diffusers NameSilo uwsgi Plotly Interview YOLO Password DeepSeek Crawler Land Proxy Input Review Tracking transformers Michelin InvalidArgumentError Vmess BF16 Attention LaTeX mmap HuggingFace Base64 云服务器 Clash Ptyhon Github PDB Web Markdown Hungarian Numpy Rebuttal Search Shortcut Quantize PDF Vim Algorithm VPN CTC 图形思考法 CUDA Bipartite CLAP Data Math Conda GoogLeNet HaggingFace 飞书 多进程 GGML Freesound Knowledge FastAPI CAM Website Pytorch Ubuntu v2ray VGG-16 Bin Llama Paper SQL AI Breakpoint LeetCode TensorFlow UI WebCrawler CEIR NLP SQLite BTC 论文 PyTorch Template 净利润 DeepStream FlashAttention Quantization 域名 IndexTTS2 Jev ONNX 证件照 News RGB Translation SVR Plate VSCode 阿里云 Food WAN TensorRT GPTQ Git Disk UNIX API RAR 递归学习法 v0.dev Distillation PIP Zip icon 音频 llama.cpp JSON 财报 CC Paddle Logo GPT4 多线程 Agent Gemma
站点统计

本站现有博文338篇,共被浏览972267次

本站已经建立2685天!

热门文章
文章归档
回到顶部