Behavioral and Brain Sciences · 2016 · 170 citations · 167 references
ComputingComputer SciencePhysicsArtificial IntelligenceKnowledge RepresentationMachine LearningCognitive ModelingDeep LearningLearning In Neural SystemsLearning SystemsNeural NetworksPattern RecognitionCausal Action ModelsCompositionality PrinciplesComputational Cognitive ScienceHuman IntelligenceLearned World ModelsMachine UnderstandingRecognition ProblemsWorld Models
Recent advances in deep neural networks have achieved human‑level performance in tasks such as object recognition and games, yet these systems still differ fundamentally from human intelligence. The authors argue that truly human‑like learning and thinking machines must extend beyond current engineering trends in both the content and the process of learning. They propose that such machines should build causal models, ground learning in intuitive physics and psychology, and exploit compositionality and learning‑to‑learn, outlining concrete challenges that combine neural network strengths with structured cognitive models.
Recent progress in artificial intelligence has renewed interest in building systems that learn and think like people. Many advances have come from using deep neural networks trained end-to-end in tasks such as object recognition, video games, and board games, achieving performance that equals or even beats that of humans in some respects. Despite their biological inspiration and performance achievements, these systems differ from human intelligence in crucial ways. We review progress in cognitive science suggesting that truly human-like learning and thinking machines will have to reach beyond current engineering trends in both what they learn and how they learn it. Specifically, we argue that these machines should (1) build causal models of the world that support explanation and understanding, rather than merely solving pattern recognition problems; (2) ground learning in intuitive theories of physics and psychology to support and enrich the knowledge that is learned; and (3) harness compositionality and learning-to-learn to rapidly acquire and generalize knowledge to new tasks and situations. We suggest concrete challenges and promising routes toward these goals that can combine the strengths of recent neural network advances with more structured cognitive models.
167
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
ImageNet Large Scale Visual Recognition Challenge
Olga Russakovsky, Jia Deng, Hao Su et al. · International Journal of Computer Vision · 2015 · 40.2K citations
Learning representations by back-propagating errors
David E. Rumelhart, Geoffrey E. Hinton, Ronald J. Williams · Nature · 1986 · 30.9K citations
Human-level control through deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver et al. · Nature · 2015 · 30K citations
A Fast Learning Algorithm for Deep Belief Nets
Geoffrey E. Hinton, Simon Osindero, Yee‐Whye Teh · Neural Computation · 2006 · 16.4K citations