Constraint-aware neural networks for Riemann problems

Understanding the difficulty of training deep feedforward neural networks

Xavier Glorot, Yoshua Bengio · 2010 · 12.6K citations

Automatic differentiation in PyTorch

Adam Paszke, Sam Gross, Soumith Chintala et al. · 2017 · 11.1K citations

Geometric Learning, Computational Science, Engineering +5

Proceedings of the 25th international conference on Machine learning

William W. Cohen, Andrew McCallum, Sam T. Roweis · 2008 · 5.5K citations

Artificial Intelligence, Ai Reliability, Engineering +15

Deep Sparse Rectifier Neural Networks

Xavier Glorot, Antoine Bordes, Yoshua Bengio · 2012 · 5.4K citations

An overview of gradient descent optimization algorithms

Sebastian Ruder · arXiv (Cornell University) · 2016 · 4.8K citations · Full text

Artificial Intelligence, Model Optimization, Review Architectures +14