GTC ON-DEMAND

 
SEARCH SESSIONS
SEARCH SESSIONS

Search All
 
Refine Results:
 
Year(s)

SOCIAL MEDIA

EMAIL SUBSCRIPTION

 
 

GTC ON-DEMAND

Deep Learning & AI Frameworks
Presentation
Media
Myia: A Differentiable Language for Deep Learning
Abstract:
Myia is a new, experimental deep learning framework that aims to provide to deep learning researchers both the expressive power and the performance that they need. Symbolic frameworks such as TensorFlow only cover a curated subset of programming language features and do not support second order gradients very well. Dynamic frameworks such as PyTorch, while very powerful, use an operator overloading approach for automatic differentiation, which does not lend itself well to optimization. With Myia, we attempt to have the best of both worlds: we implement a general and composable approach to automatic differentiation over a functional abstraction of a subset of the Python programming language. That subset includes if, while, for, and recursion, providing plenty of expressive power, and yet it can also be analyzed statically to provide the best possible performance. We''ll present the Myia language from a high-level technical perspective, including a short primer on functional programming and automatic differentiation. It is of special interest to deep learning framework or library implementers.
 
Topics:
Deep Learning & AI Frameworks, Programming Languages
Type:
Talk
Event:
GTC Silicon Valley
Year:
2018
Session ID:
S8441
Streaming:
Download:
Share: