EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
Logo Plate Permission GIT Datetime Web Base64 继承 Qwen2.5 Ptyhon Markdown 域名 Template PyCharm HuggingFace Magnet COCO Firewall TensorRT Statistics RL 音频 Use TTS C++ Freesound GPTQ LLM GPT4 API Michelin Diagram Django OpenAI TensorFlow 顶会 Shortcut Paddle Hungarian FlashAttention mmap diffusers Gemma GoogLeNet Review News CLAP Conda Safetensors MD5 SQL Google VPN Disk QWEN Proxy LoRA 证件照 Baidu VSCode CUDA Card 多进程 腾讯云 EXCEL CC 递归学习法 阿里云 Github RAR 论文 Quantize Pickle uWSGI OpenCV Land Clash VGG-16 Crawler SPIE Pytorch Linux Tracking 图标 UI CAM tqdm Cloudreve 签证 BeautifulSoup Zip uwsgi BF16 Tensor Quantization JSON FastAPI Distillation Search Nginx BTC Claude Pillow PDF InvalidArgumentError ms-swift Llama 云服务器 Knowledge printf LaTeX RGB IndexTTS2 Image2Text DeepStream WAN Paper UNIX FP16 Random FP64 Qwen2 logger 报税 强化学习 Plotly transformers 关于博主 PDB YOLO NLTK OCR Color SVR Heatmap WebCrawler Numpy XML v0.dev llama.cpp SAM Breakpoint Docker Mixtral Anaconda Vim Bipartite ResNet-50 PIP Jetson git Algorithm Video Math XGBoost Data 搞笑 PyTorch FP8 Miniforge Attention 版权 CSV 多线程 Augmentation SQLite Qwen tar Windows Website Rebuttal v2ray Agent Dataset 财报 git-lfs GGML Python Hotel CEIR HaggingFace Input Bitcoin AI ChatGPT NLP 公式 DeepSeek Pandas torchinfo Excel TSV ModelScope icon Tiktoken Interview 算法题 Sklearn Git Bin 论文速读 Bert Hilton Password LLAMA Vmess FP32 NameSilo scipy Domain Transformers Jupyter Streamlit CV Ubuntu Animate Translation ONNX 净利润 图形思考法 LeetCode CTC Food 第一性原理 hf 飞书
站点统计

本站现有博文333篇,共被浏览914719

本站已经建立2618天!

热门文章
文章归档
回到顶部