EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
多进程 IndexTTS2 Sklearn News HuggingFace git-lfs Linux Jetson Ubuntu Statistics 强化学习 BF16 RGB ONNX Land Breakpoint Website Permission Quantization AI ChatGPT PyCharm Bert 净利润 SQLite Docker CC Input FP8 顶会 Heatmap FastAPI git API 继承 XGBoost hf Qwen Ptyhon Google LoRA Pandas FP16 报税 NLTK CEIR Proxy Datetime Vmess UI 递归学习法 Data Anaconda Python Color Card SPIE Math Safetensors 搞笑 LaTeX BTC Domain 第一性原理 Michelin ModelScope uWSGI Paper 财报 Interview OpenCV Logo DeepStream transformers 版权 EXCEL 腾讯云 Bitcoin NameSilo CLAP CAM Hungarian Pickle FP32 MD5 Augmentation Jupyter 云服务器 OpenAI TensorRT Translation TSV Plotly Agent Vim Web llama.cpp Tracking Search LLAMA PIP QWEN CV BeautifulSoup Magnet 阿里云 Use 证件照 Disk C++ Algorithm Food Llama GIT UNIX Gemma mmap torchinfo Animate CUDA GPTQ Numpy 签证 算法题 Firewall Markdown v2ray Base64 tqdm Image2Text XML Windows Bipartite Excel FlashAttention SQL GoogLeNet Plate WAN Distillation 关于博主 NLP TensorFlow FP64 Zip YOLO Tiktoken CTC Bin Pillow Password Miniforge 域名 Nginx LLM Random Github WebCrawler Streamlit Crawler CSV Cloudreve Mixtral LeetCode 飞书 logger Qwen2.5 InvalidArgumentError 公式 Quantize printf PyTorch Paddle VSCode HaggingFace diffusers PDB Knowledge Conda COCO Freesound Hotel tar JSON Django RAR 多线程 Clash Diagram Qwen2 Git VPN SVR v0.dev Attention 图形思考法 Pytorch Tensor GPT4 PDF Dataset ResNet-50 OCR Shortcut Baidu GGML TTS Template Claude Hilton DeepSeek Transformers uwsgi SAM 音频 VGG-16 Video scipy Review
站点统计

本站现有博文321篇,共被浏览782256

本站已经建立2475天!

热门文章
文章归档
回到顶部