Trends and Developments in Deep Learning Research Jeff Dean Google Brain team g.co/brain In collaboration with many other people at Google ConvNets Accuracy Scale (data size, model size) 1980s and 1990s neural networks other approaches more computeAccuracy Scale (data size, model size) neural networks other approaches 1980s and 1990s more computeAccuracy Scale (data size, model size) neural networks other approaches Now 5% errors humans 2011 26% errors 2016 3% errors 2011 5% errors humans 26% errors Growing Use of Deep Learning at Google Android Apps drug discovery Gmail Image understanding Maps Natural language understanding Photos Robotics research Speech Translation YouTube … many others ... Across many products/areas: # of directories containing model description files Google Brain Team ● Research: 27 papers in ICML, NIPS, and ICLR in 2016, plus others in venues like ACL, ICASSP, CVPR, ICER, and OSDI; Brain Residency Progra