GTC ON-DEMAND

 
SEARCH SESSIONS
SEARCH SESSIONS

Search All
 
Refine Results:
 
Year(s)

SOCIAL MEDIA

EMAIL SUBSCRIPTION

 
 

GTC ON-DEMAND

Autonomous Vehicles
Presentation
Media
Fast Neural Network Inference with TensorRT on Autonomous Vehicles
Abstract:
Autonomous driving systems use various neural network models that require extremely accurate and efficient computation on GPUs. This session will outline how Zoox employs two strategies to improve inference performance (i.e., latency) of trained neural network models without loss of accuracy: (1) inference with NVIDIA TensorRT, and (2) inference with lower precision (i.e., Fp16 and Int8). We will share our learned lessons about neural network deployment with TensorRT and our current conversion workflow to tackle limitations.
 
Topics:
Autonomous Vehicles
Type:
Talk
Event:
GTC Silicon Valley
Year:
2019
Session ID:
S9895
Streaming:
Download:
Share: