EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
Python COCO TensorFlow Card 阿里云 Bitcoin Cloudreve Firewall News Bin XGBoost ResNet-50 EXCEL CAM Template SAM git-lfs 飞书 diffusers 顶会 GPT4 Ptyhon SPIE Git Plate 关于博主 Web Github CTC PyCharm C++ Claude 净利润 NLTK Tensor Docker Random Anaconda 版权 BF16 Baidu TSV 公式 v2ray 图标 Data Freesound Qwen2 Pytorch 音频 AI Domain Harness Dataset Jev Hilton 云服务器 CUDA CEIR Review Linux LaTeX 算法题 Video Website Jupyter SQLite 腾讯云 PIP Image2Text Land Statistics Math Gemma uWSGI HuggingFace Algorithm Base64 PDF Disk v0.dev QWEN Distillation Quantize Input CSV Breakpoint Heatmap GoogLeNet scipy FP64 Hungarian RGB Animate FP32 Knowledge Numpy Attention Crawler Vmess Pickle 多线程 Sklearn GGML logger Datetime NameSilo RL 强化学习 tar LoRA VPN BTC Mixtral WAN uwsgi GIT Bert Michelin CLAP ms-swift Paddle Vim Diagram 论文速读 论文 DeepSeek Google YOLO PyTorch transformers Augmentation UNIX 递归学习法 Jetson mmap git Tiktoken API WebCrawler 图形思考法 域名 TTS llama.cpp 继承 Translation Password OpenCV GPTQ ChatGPT Shortcut Transformers Windows InvalidArgumentError Use LLAMA DeepStream API网关 Permission Agent OpenAI 财报 MD5 Food Color Qwen2.5 报税 IndexTTS2 HaggingFace icon Nginx Proxy FastAPI Ubuntu LeetCode Llama PDB FlashAttention Tracking Logo SQL Rebuttal Pillow Magnet Quantization Safetensors 证件照 FP8 CC tqdm UI Qwen Paper RAR 签证 Conda SVR TensorRT JSON Interview Miniforge Streamlit ModelScope FP16 Zip Hotel Plotly Pandas XML Search 搞笑 NLP ONNX Django Bipartite OCR CV 多进程 Excel Clash hf Markdown printf BeautifulSoup VSCode VGG-16 LLM 第一性原理 torchinfo
站点统计

本站现有博文337篇,共被浏览949910

本站已经建立2661天!

热门文章
文章归档
回到顶部