EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
Qwen2 Web 阿里云 CC Michelin Bert Math Pytorch Git 多线程 Hilton Attention 多进程 Plate RAR printf JSON ModelScope Jupyter AI 腾讯云 Qwen 飞书 API Rebuttal NLTK UNIX COCO Docker LLAMA 搞笑 transformers Pillow logger tar Magnet TensorFlow 算法题 Conda BTC Knowledge GPTQ Windows Pandas SVR 签证 uWSGI Linux EXCEL MD5 LoRA CAM VPN git XML torchinfo Ubuntu FP64 Augmentation 图形思考法 Bitcoin Clash Zip LeetCode Dataset PyCharm WebCrawler Food tqdm IndexTTS2 Breakpoint Gemma Diagram Quantization Interview Statistics TSV Pickle TensorRT WAN 强化学习 Claude 财报 Cloudreve Disk git-lfs Shortcut HaggingFace QWEN FlashAttention Vmess llama.cpp Animate LaTeX Anaconda CUDA 图标 Python scipy Quantize Bin diffusers Permission Paper YOLO SQLite 证件照 Markdown FP32 音频 Freesound 版权 Search Distillation OpenAI 净利润 mmap Qwen2.5 ResNet-50 Land PDF Firewall Translation 云服务器 NameSilo ChatGPT XGBoost OpenCV uwsgi Bipartite FP16 Use Vim Llama GoogLeNet Template Heatmap CEIR UI GGML 报税 TTS DeepStream RGB Sklearn News CLAP Streamlit Review hf Numpy VGG-16 Base64 NLP CSV Random Logo Crawler FP8 LLM Hungarian SQL Image2Text PDB icon ONNX Tensor Datetime FastAPI Algorithm 继承 Input Tracking v2ray Mixtral Ptyhon Safetensors Google SAM Hotel Miniforge 第一性原理 DeepSeek Paddle GIT Color Tiktoken PIP 域名 Baidu Domain Transformers Jetson Plotly PyTorch Django Nginx C++ Github 关于博主 Password CTC BeautifulSoup BF16 Card Data SPIE 公式 VSCode 顶会 OCR v0.dev CV 递归学习法 Agent GPT4 Proxy Excel Video HuggingFace InvalidArgumentError Website
站点统计

本站现有博文323篇,共被浏览799449

本站已经建立2498天!

热门文章
文章归档
回到顶部