Deep learning, where are you going? Kyunghyun Cho New York University Center for Data Science, and Courant Institute of Mathematical Sciences Three axes of advance in machine learning 1. Network architectures • ConvNet • Highway networks/ResNet • LSTM/GRU 2. Learning algorithms • Supervised learning • Unsupervised learning • Reinforcement learning 3. Temporal/Spatial Hierarchy • Thumbnails => high-res images • Single frame => multi-frame video clips • Words => phrases => sentences => … Te mp ora l/S pa tia l Hie rar ch y Network Architectures Le ar ni ng Al go rit hm s Three axes of advance in machine learning 1. Network architectures • ConvNet • Highway networks/ResNet • LSTM/GRU 2. Learning algorithms • Supervised learning • Unsupervised learning • Reinforcement learning 3. Temporal/Spatial Hierarchy • Thumbnails => high-res images • Single frame => multi-frame video clips • Words => phrases => sentences => … Te mp ora l/S pa
