Automatic differentiation in machine learning - Concepedia

Concepedia

Publication | Closed Access

Automatic differentiation in machine learning

81

Citations

0

References

2017

Year

BaydinAtılım Günes, A PearlmutterBarak, RadulAlexey Andreyevich, SiskindJeffrey Mark

Journal of Machine Learning Research

Artificial IntelligenceAlgorithmic DifferentiationMachine LearningEngineeringData MiningAutomatic DifferentiationComputational Learning TheoryAutomated Machine LearningKnowledge DiscoveryDerivative-free OptimizationComputer ScienceDifferential Analysis

Abstract

Derivatives, mostly in the form of gradients and Hessians, are ubiquitous in machine learning. Automatic differentiation (AD), also called algorithmic differentiation or simply auto-diff, is a fa...