ACM Transactions on Mathematical Software · 2005 · 26 citations · 14 references
ComputingComputer ScienceAlgorithmsCompilersProgramming LanguagesCompiler ConstructionGradient-based OptimizationNumerical AlgorithmsNumerical AnalysisNumerical Linear AlgebraNumerical Methods For Differential EquationsAccuracyAutomatic DifferentiationCompiler DesignCompiler SupportCompiler-based GenerationDifferentiationSource Code TransformationVector-valued Functions
The availability of first derivatives of vector functions is crucial for the robustness and efficiency of a large number of numerical algorithms. An upcoming new version of the differentiation-enabled NAGWare Fortran 95 compiler is described that uses programming language extensions and a semantic code transformation known as automatic differentiation to provide Jacobians of numerical programs with machine accuracy. We describe a new user interface as well as the relevant algorithmic details. In particular, we focus on the source transformation approach that generates locally optimal gradient code for single assignments by vertex elimination in the linearized computational graph. Extensive tests show the superiority of this method over the current overloading-based approach. The robustness and convenience of the new compiler-feature is illustrated by various case studies.
14
On the Estimation of Sparse Jacobian Matrices
A. R. Curtis, M. J. D. Powell, John Reid · IMA Journal of Applied Mathematics · 1974 · 416 citations
A simple automatic derivative evaluation program
R. E. Wengert · Communications of the ACM · 1964 · 389 citations · Full text
Adifor 2.0: automatic differentiation of Fortran 77 programs
Christian Bischof, P. Khademi, A. Mauer et al. · IEEE Computational Science and Engineering · 1996 · 366 citations