TensorRT 11.1
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- TensorRT 11.1 tuner details model-specific inference optimization
NVIDIA Technical Blog details the architecture and best practices of the Global Performance Tuner, an automatic, accuracy-aware performance-tuning feature released in TensorRT 11.1. It represents alternative compiler scheduling strategies as searchable build routes made from combinations of compiler knob values, then selects the fastest measured engine that meets the user-defined accuracy boundary. NVIDIA recommends re-tuning when the model, input shapes, target GPU, software stack or relevant TensorRT version changes.
NVIDIA Technical Blog · 🔥 0
Experience and discussion from the community
Share my TensorRT 11.1 experienceAsk about TensorRT 11.1
Nobody has shared their experience with TensorRT 11.1 yet.