Mathematics in Engineering · 2018 · 70 citations · 18 references
ComputingComputer ScienceData ScienceAlgorithmsMachine LearningScientific ComputingGradient-based OptimizationNeural NetworksNumerical AlgorithmsNumerical AnalysisNumerical Methods For Differential EquationsPartial Differential EquationsArtificial Neural Network SurrogatesDifferential Equation SolversGradient DescentMachine Learning AccelerationMachine Learning SurrogatesOptimization AlgorithmsStochastic Gradient DescentTraining
We propose a machine learning framework to accelerate numerical computations of time-dependent ODEs and PDEs. Our method is based on recasting (generalizations of) existing numerical methods as artificial neural networks, with a set of trainable parameters. These parameters are determined in an o ine training process by (approximately) minimizing suitable (possibly nonconvex) loss functions by (stochastic) gradient descent methods. The proposed algorithm is designed to be always consistent with the underlying di erential equation. Numerical experiments involving both linear and non-linear ODE and PDE model problems demonstrate a significant gain in computational e ciency over standard numerical methods.
18
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Multilayer feedforward networks are universal approximators
Kurt Hornik, Maxwell B. Stinchcombe, Halbert White · Neural Networks · 1989 · 21.2K citations
Multilayer feedforward networks are universal approximators
HornikK., StinchcombeM., WhiteH. · Neural Networks · 1989 · 9.4K citations
An overview of gradient descent optimization algorithms
Sebastian Ruder · arXiv (Cornell University) · 2016 · 4.8K citations · Full text