EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
域名 Heatmap CEIR Proxy FlashAttention Jetson Animate 报税 RAR Tracking scipy Interview Bitcoin Pillow Miniforge PIP logger TensorFlow UNIX Bipartite 飞书 SVR Mixtral 云服务器 Math Claude 版权 Tiktoken GPTQ 公式 证件照 Card TTS Tensor Dataset NLTK Hilton Transformers ChatGPT Streamlit Quantize Video 净利润 音频 diffusers GIT 腾讯云 News RGB Anaconda Translation Excel llama.cpp tar Use 签证 Vmess v2ray DeepSeek LoRA HuggingFace Permission JSON XML Datetime Web AI Search Qwen2 VGG-16 Paper 图形思考法 强化学习 GoogLeNet UI transformers Cloudreve CC Michelin v0.dev Base64 第一性原理 Git Sklearn Gemma Safetensors Domain Windows FP32 TSV 多线程 InvalidArgumentError Vim Conda SPIE EXCEL Attention Jupyter IndexTTS2 XGBoost OCR NameSilo Firewall Qwen torchinfo FP16 API Numpy SQL ResNet-50 Pandas Image2Text Linux Hotel CLAP VSCode FastAPI CV Markdown 财报 WAN Website BF16 Bin CUDA GGML FP64 LeetCode Docker Password mmap YOLO SAM Land Augmentation Plotly Paddle printf Ubuntu Food PyTorch ONNX FP8 Hungarian OpenCV tqdm LLM WebCrawler Diagram Knowledge Algorithm BTC LaTeX 多进程 PyCharm Color BeautifulSoup CTC PDB CSV OpenAI Pickle git-lfs Agent Crawler Pytorch Statistics Zip VPN Plate DeepStream HaggingFace Ptyhon 继承 算法题 Nginx MD5 搞笑 git Freesound PDF Magnet SQLite Template 递归学习法 Python Review Django COCO 关于博主 Baidu Bert Github Clash Random Disk CAM 阿里云 Breakpoint NLP C++ Distillation Google hf Qwen2.5 Data Shortcut GPT4 uWSGI QWEN uwsgi ModelScope TensorRT Quantization Llama 顶会 Input Logo LLAMA
站点统计

本站现有博文321篇,共被浏览782213

本站已经建立2475天!

热门文章
文章归档
回到顶部