EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
签证 PDF SQLite Tensor 强化学习 CC LLAMA 递归学习法 ResNet-50 SVR NameSilo QWEN Color Math Claude CSV Anaconda Ptyhon WAN Use Vim Paddle 财报 C++ SQL Django Augmentation InvalidArgumentError Disk Hungarian PDB CTC PIP TensorFlow MD5 顶会 音频 阿里云 XGBoost Permission Github Bipartite Google Attention Transformers RGB PyCharm LaTeX torchinfo BF16 Michelin 搞笑 scipy Jetson Statistics Agent Web FP16 VGG-16 Video Safetensors LeetCode Distillation Data Heatmap Website Land RAR NLP Qwen2.5 Gemma Tracking CEIR Cloudreve News 图形思考法 GIT GoogLeNet FP64 UNIX git-lfs uwsgi Excel Mixtral Git API ONNX HaggingFace 继承 AI Card CAM Python Domain ChatGPT Pytorch Pandas Algorithm LoRA FP32 Jupyter Qwen 第一性原理 Review transformers Pillow GPTQ 算法题 llama.cpp NLTK hf 报税 WebCrawler Base64 diffusers 多线程 Knowledge Datetime git DeepStream Dataset Llama LLM printf PyTorch Sklearn Crawler Hotel Template Nginx GPT4 Animate Firewall Translation Input Zip Interview CLAP Bin 飞书 OpenAI 腾讯云 logger OpenCV FlashAttention Hilton VSCode Random FP8 Tiktoken Linux Pickle 证件照 净利润 Quantization SAM mmap Bitcoin 域名 Windows 多进程 Clash Vmess CV uWSGI TensorRT YOLO Numpy Bert Paper Quantize 版权 Shortcut Diagram CUDA HuggingFace Freesound SPIE IndexTTS2 Miniforge v0.dev Streamlit DeepSeek Proxy BTC Plotly COCO Breakpoint Ubuntu XML Markdown TTS BeautifulSoup ModelScope Conda v2ray 关于博主 FastAPI Password UI tar Image2Text OCR Logo Plate Search GGML tqdm Baidu Docker TSV Food Qwen2 Magnet JSON 公式 EXCEL VPN
站点统计

本站现有博文320篇,共被浏览761098

本站已经建立2433天!

热门文章
文章归档
回到顶部