Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · 2024 · 41 citations · 54 references
ComputingComputational EngineeringComputational Fluid DynamicsMultiscale ModelingSpatial ModelingDimension ReductionDimensionality ReductionPartial Differential Equation ModelsPartial Differential EquationsReduced-order ModelingSurrogate ModelingArtificial Neural Network SurrogatesLong Short-term Memory NetworksModel FidelityMulti-fidelity Surrogate ModelingNeural Network SurrogatesProper Orthogonal DecompositionReduced-order SurrogatesSpatial Basis
High-fidelity numerical simulations of partial differential equations (PDEs) given a restricted computational budget can significantly limit the number of parameter configurations considered and/or time window evaluated. Multi-fidelity surrogate modelling aims to leverage less accurate, lower-fidelity models that are computationally inexpensive in order to enhance predictive accuracy when high-fidelity data are scarce. However, low-fidelity models, while often displaying the qualitative solution behaviour, fail to accurately capture fine spatio-temporal and dynamic features of high-fidelity models. To address this shortcoming, we present a data-driven strategy that combines dimensionality reduction with multi-fidelity neural network surrogates. The key idea is to generate a spatial basis by applying proper orthogonal decomposition (POD) to high-fidelity solution snapshots, and approximate the dynamics of the reduced states—time-parameter-dependent expansion coefficients of the POD basis—using a multi-fidelity long short-term memory network. By mapping low-fidelity reduced states to their high-fidelity counterpart, the proposed reduced-order surrogate model enables the efficient recovery of full solution fields over time and parameter variations in a non-intrusive manner. The generality of this method is demonstrated by a collection of PDE problems where the low-fidelity model can be defined by coarser meshes and/or time stepping, as well as by misspecified physical features.
54
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Advances in neural information processing systems 7
Krzysztof J. Cios, Mark E. Shields · Neurocomputing · 1997 · 22.3K citations
Learning to Forget: Continual Prediction with LSTM
Felix A. Gers, Jürgen Schmidhuber, Fred Cummins · Neural Computation · 2000 · 5.4K citations