Day #202 - Ilya Sutskever at AI Frontiers 2018 - Great Talk

Key Lesson 

• OpenAI Five - NN that play as Strongest Players (strategy game)

• Solution Approach - Very Large Scale RL
• Bot has accumulated 500 years of Game play experience
• Breakthrough with old algorithms
• It takes human many more years to become good but RL learns faster than before

Dexterity

• Vision + Sensation to deal with block
• Diverse Objects Handling using RL approach
• Train in Simulation and Deploy in Real world (Randomize perception and physics)
• SIM2Real is hard as simulation different for real robot
• If you don't know Randomize actions
• Generality and System able to learn

Curiosity based Exploration

• Seek Novelty, Avoid boredom

OpenAI Mission

• AGI (Artificial General Intelligence)
• Work to benefit humanity

Deep Learning is Root of all

Exponential reduction in error year after year
The accuracy of Machine Translation improved drastically
GAN in 2014

Compute used has increased by a factor of 300K

Challenges

• Unsupervised Learning
• Robust Classification
• Reasoning
• Abstraction

Rapid progress past 6 years.

Happy Mastering DL!!!