EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
递归学习法 Python FastAPI Attention 域名 TTS TensorFlow VGG-16 Windows GPTQ uWSGI LaTeX Claude Interview Logo icon TensorRT Password v0.dev Math uwsgi Tiktoken Crawler Pytorch FP16 Permission Review Nginx WAN Video PDB Bert Search Markdown 报税 tqdm 阿里云 Heatmap ResNet-50 OCR Tensor Vmess Statistics Animate Domain 飞书 VPN v2ray Qwen2.5 Gemma Llama Plotly Pickle ChatGPT Template DeepSeek Firewall Vim ms-swift NLTK 音频 腾讯云 Anaconda XGBoost Food PyTorch 图形思考法 多进程 Ptyhon Knowledge BeautifulSoup YOLO Excel Qwen2 Distillation CUDA Tracking COCO Hotel 论文速读 Google Augmentation Safetensors News Quantization LoRA tar Clash NameSilo transformers Bitcoin mmap 财报 Algorithm Paddle Use CC 第一性原理 SQLite FP64 公式 UI Cloudreve Qwen HuggingFace EXCEL Bipartite diffusers InvalidArgumentError Bin SVR Ubuntu AI BTC GGML Hilton FP32 Pandas Sklearn DeepStream VSCode Proxy Baidu SAM 论文 FP8 UNIX IndexTTS2 Dataset Numpy PIP FlashAttention LLAMA 强化学习 scipy CAM MD5 TSV Image2Text OpenCV Web Datetime Pillow Linux Breakpoint CV 图标 printf Git Card Hungarian Streamlit 版权 Rebuttal RAR Zip git Paper C++ Magnet BF16 llama.cpp QWEN Docker 关于博主 Data Quantize API 签证 Freesound 云服务器 XML Jupyter Mixtral Jetson Input Michelin 搞笑 torchinfo ONNX GPT4 CEIR hf Website 证件照 OpenAI Shortcut 多线程 GIT 继承 PyCharm logger Miniforge SQL WebCrawler 净利润 LLM SPIE GoogLeNet Django Conda Github Agent Diagram CTC Translation Disk CSV 顶会 CLAP 算法题 ModelScope Base64 Color Transformers RGB NLP Land PDF Plate git-lfs JSON HaggingFace LeetCode Random
站点统计

本站现有博文330篇,共被浏览861269

本站已经建立2569天!

热门文章
文章归档
回到顶部