SPE Reservoir Simulation Conference · 2021 · 65 citations · 29 references
EngineeringComputational EngineeringPhysicsFluid DynamicsFluid MechanicsReservoir SimulationBoundary-layer TheoryDeep LearningFlow ModelingNeural ModelingNeural NetworksPartial Differential EquationsInitial Boundary ConditionsMachine Learning-assisted Reservoir SimulationNeural Network ModelingPartial Differential Equation SolversPartial Differential Equation SystemsPhysical LawsPhysics-informed ModelingReservoir Computing
Abstract We present our progress on the application of physics informed deep learning to reservoir simulation problems. The model is a neural network that is jointly trained to respect governing physical laws and match boundary conditions. The methodology is hereby used to simulate a 2-phase immiscible transport problem (Buckley-Leverett). The model is able to produce an accurate physical solution both in terms of shock and rarefaction and honors the governing partial differential equation along with initial and boundary conditions. We test various hypothesis (uniform and non-uniform initial conditions) and show that with the proper implementation of physical constraints, a robust solution can be trained within a reasonable amount of time and iterations. We revisit some of the limitations presented in previous work [1] and further the applicability of this method in a forward, pure hyperbolic setup. We also share some practical findings on the application of physics informed neural networks (PINN). We review various network architectures presented in the literature and show tips that helped improve their convergence and accuracy. The proposed methodology is a simple and elegant way to instill physical knowledge to machine-learning algorithms. This alleviates the two most significant shortcomings of machine-learning algorithms: the requirement for large datasets and the reliability of extrapolation. The principles presented can be generalized in innumerable ways in the future and should lead to a new class of algorithms to solve both forward and inverse physical problems.
29
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
A Limited Memory Algorithm for Bound Constrained Optimization
Richard H. Byrd, Peihuang Lu, Jorge Nocedal et al. · SIAM Journal on Scientific Computing · 1995 · 6.2K citations
Ciyou Zhu, Richard H. Byrd, Peihuang Lu et al. · ACM Transactions on Mathematical Software · 1997 · 3.4K citations · Full text