Applied Sciences · 2021 · 45 citations · 41 references
ComputingComputational EngineeringMechanical EngineeringComputational MechanicsMachine LearningStructural EngineeringDeep LearningStructural Finite Element AnalysisStructural SimulationSurrogate ModelingArtificial Neural Network SurrogatesComputational Structural MechanicsFinite Element ModelingMachine Learning SurrogatesMultilayer PerceptronNeural Network SurrogatesPhysics-informed ModelingRobust Surrogate Modeling
The technical world of today fundamentally relies on structural analysis in the form of design and structural mechanic simulations. A traditional and robust simulation method is the physics-based finite element method (FEM) simulation. FEM simulations in structural mechanics are known to be very accurate; however, the higher the desired resolution, the more computational effort is required. Surrogate modeling provides a robust approach to address this drawback. Nonetheless, finding the right surrogate model and its hyperparameters for a specific use case is not a straightforward process. In this paper, we discuss and compare several classes of mesh-free surrogate models based on traditional and thriving machine learning (ML) and deep learning (DL) methods. We show that relatively simple algorithms (such as k-nearest neighbor regression) can be competitive in applications with low geometrical complexity and extrapolation requirements. With respect to tasks exhibiting higher geometric complexity, our results show that recent DL methods at the forefront of literature (such as physics-informed neural networks) are complicated to train and to parameterize and thus, require further research before they can be put to practical use. In contrast, we show that already well-researched DL methods, such as the multi-layer perceptron, are superior with respect to interpolation use cases and can be easily trained with available tools. With our work, we thus present a basis for the selection and practical implementation of surrogate models.
41
Learning representations by back-propagating errors
David E. Rumelhart, Geoffrey E. Hinton, Ronald J. Williams · Nature · 1986 · 30.9K citations
Greedy function approximation: A gradient boosting machine.
Jerome H. Friedman · The Annals of Statistics · 2001 · 29K citations · Full text
Multilayer feedforward networks are universal approximators
Kurt Hornik, Maxwell B. Stinchcombe, Halbert White · Neural Networks · 1989 · 21.2K citations
Maziar Raissi, Paris Perdikaris, George Em Karniadakis · Journal of Computational Physics · 2018 · 16.9K citations · Full text
A tutorial on support vector regression
Alex Smola, Bernhard Schölkopf · Statistics and Computing · 2004 · 13K citations