Nvidia has released a new version of TensorRT, a runtime system for serving inferences using deep learning models through Nvidia’s own GPUs. Inferences, or predictions made from a trained model, can ...