EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
Miniforge SQL Hotel Anaconda GPT4 Animate Bert XGBoost Bin Ptyhon Bipartite Freesound 强化学习 CC HaggingFace PDF Interview PIP PDB Markdown LeetCode Datetime DeepStream uwsgi Translation 第一性原理 GGML SVR Hungarian Data Firewall Distillation Sklearn Color git TensorFlow Breakpoint Math FP8 LLM Conda Vim Tiktoken Google HuggingFace UI Plate Algorithm Video 飞书 InvalidArgumentError CTC Git Knowledge FP64 GPTQ CEIR CUDA v2ray Website hf TensorRT 证件照 News Statistics tqdm Card Linux Base64 版权 图形思考法 VPN ModelScope PyCharm Zip FastAPI 递归学习法 Hilton Excel Land IndexTTS2 CAM Qwen2.5 Nginx Clash YOLO Transformers 算法题 Mixtral Heatmap Crawler JSON Quantization RGB Plotly Windows CSV Template icon CLAP Proxy Llama MD5 EXCEL Pytorch NameSilo 继承 printf llama.cpp 签证 Bitcoin Paddle COCO OCR Web Django C++ QWEN Vmess API Claude 关于博主 多线程 scipy Docker Jetson logger Random 搞笑 LLAMA Pickle Review VGG-16 Shortcut OpenCV Ubuntu mmap LaTeX BTC NLTK Disk ChatGPT UNIX Michelin tar 多进程 PyTorch Agent 域名 CV LoRA GIT Safetensors Dataset 顶会 Python transformers Pillow TTS DeepSeek 净利润 Github git-lfs Tracking AI FP32 SQLite SAM OpenAI WebCrawler torchinfo Cloudreve 报税 ResNet-50 FlashAttention RAR Rebuttal Gemma uWSGI Image2Text BeautifulSoup GoogLeNet 图标 财报 Domain Magnet Diagram Augmentation XML 公式 音频 Quantize TSV Paper WAN Attention diffusers Permission 腾讯云 Tensor Jupyter Qwen BF16 Use ONNX Search Pandas Food SPIE Input Numpy v0.dev 云服务器 阿里云 NLP Streamlit VSCode FP16 Logo Qwen2 Baidu Password
站点统计

本站现有博文324篇,共被浏览820071

本站已经建立2524天!

热门文章
文章归档
回到顶部