Large-Scale Deep Learning for Intelligent Computer Systems Jeff Dean Google Brain team in collaboration with many other teams Growing Use of Deep Learning at Google Android Apps GMail Image Understanding Maps NLP Photos Robotics Speech Translation many research uses.. YouTube … many others ... Across many products/areas:# of directories containing model description files Outline Two generations of deep learning software systems: ● 1st generation: DistBelief [Dean et al., NIPS 2012] ● 2nd generation: TensorFlow (unpublished) An overview of how we use these in research and products Plus, ...a new approach for training (people, not models) Google Brain project started in 2011, with a focus on pushing state-of-the-art in neural networks. Initial emphasis: ● use large datasets, and ● large amounts of computation to push boundaries of what is possible in perception and language understanding Plenty of raw data ● Text: trillions of words of English + o
