EADST

C++: ONNX Model to TensorRT model

C++: ONNX Model to TensorRT model

/usr/src/tensorrt/bin/trtexec --onnx=/home/onnx_model_path/onnx_model_name.onnx --saveEngine=/home/trt_model_path/trt_model_name.engine --minShapes=x:1x3x32x128 --optShapes=x:25x3x32x128 --maxShapes=x:25x3x32x128
# trt exe : /usr/src/tensorrt/bin/trtexec
# onnx path: --onnx
# trt path: --saveEngine
# min batch shape: --minShapes
# opt batch shape: --optShapes
# max batch shape: --maxShapes
# onnx input x name: x
# 25x3x32x128: Batch x Channel x Height x Weight
相关标签
About Me
XD
Goals determine what you are going to be.
Category
标签云
Data 继承 LoRA OCR 自我改进 CLAP PDF LaTeX Gemma Dataset Safetensors 财报 Use RAR GoogLeNet logger 长期记忆 Datetime Jev 净利润 printf 域名 Cloudreve Conda v0.dev Qwen2.5 InvalidArgumentError Ubuntu Translation LLAMA 第一性原理 Color MD5 Video 飞书 TensorFlow 公式 GIT FP64 CAM Miniforge Logo TTS SAM Vim 云服务器 icon AI Mixtral SPIE hf HuggingFace RL ResNet-50 WebCrawler PyTorch Disk Shortcut transformers Math ms-swift Breakpoint 版权 多进程 Interview NLTK tar mmap Rebuttal VPN Pickle Algorithm 报税 SQLite NameSilo WAN Pytorch ModelScope BTC TensorRT Git SVR Pillow Baidu 强化学习 PDB Zip Linux Web Google Paper Password CC Search Animate CTC 腾讯云 VSCode NLP Heatmap Template torchinfo GGML News Sklearn Windows Hotel Clash YOLO Claude Django RGB CV Michelin PIP Markdown Transformers diffusers HaggingFace UI FlashAttention Firewall Permission Plate Quantize 多线程 UNIX GPT4 图标 Land 论文速读 Tensor C++ Harness GPTQ ChatGPT CEIR Tracking Docker Diagram SQL uWSGI git-lfs 搞笑 Ptyhon 顶会 Numpy Food Qwen2 Jupyter Anaconda 论文 IndexTTS2 FastAPI BF16 uwsgi git scipy 音频 Knowledge JSON Python Qwen FP16 算法题 XGBoost Github EXCEL LLM Statistics v2ray 图形思考法 Hungarian Domain Bin TSV 递归学习法 PyCharm API网关 BeautifulSoup Pandas Random COCO Review OpenAI VGG-16 DeepSeek Image2Text FP32 Freesound Distillation Streamlit ONNX Proxy 证件照 Card API 关于博主 Attention Hilton Nginx Tiktoken Website DeepStream 签证 Base64 Crawler XML Augmentation Bert Jetson LeetCode Bitcoin Magnet Quantization OpenCV CUDA FP8 Excel Plotly Llama Paddle Vmess Bipartite CSV Input llama.cpp tqdm 阿里云 Agent QWEN
站点统计

本站现有博文339篇,共被浏览996081次

本站已经建立2706天!

热门文章
文章归档
回到顶部