Tensorrt
tensorrt
NVIDIA's inference optimizer for deep learning
Leverages hardware-accelerator like tensor-cores
Optimizes models for production deployment
NVIDIA's inference optimizer for deep learning
Leverages hardware-accelerator like tensor-cores
Optimizes models for production deployment