Theano: Deep Learning on GPUs with Python

Abstract

In this paper, we present Theano1, a framework in the Python programming language for defining, optimizing and evaluating expressions involving high-level operations on ten-sors. Theano offers most of NumPy’s functionality, but adds automatic symbolic differen-tiation, GPU support, and faster expression evaluation. Theano is a general mathematical tool, but it was developed with the goal of facilitating research in deep learning. The Deep Learning Tutorials2 introduce recent advances in deep learning, and showcase how Theano makes such algorithms compact, elegant, and fast.