Data-Centric Engineering · 2020 · 17 citations · 47 references
ComputingComputational EngineeringComputer ScienceInternal Combustion EnginesMachine LearningStatistical LearningDeep LearningEngine ModelingKernel MethodsNeural NetworksOptimization For Machine LearningRepresentation LearningBenchmark Model DevelopmentCompression Ignition Engine ModelingCompression-ignition Engine EmissionsEmission Prediction ModelsKernel LearningMachine Learning SurrogatesOptimization AlgorithmsPredictive Emission Modeling
Abstract We apply deep kernel learning (DKL), which can be viewed as a combination of a Gaussian process (GP) and a deep neural network (DNN), to compression ignition engine emissions and compare its performance to a selection of other surrogate models on the same dataset. Surrogate models are a class of computationally cheaper alternatives to physics-based models. High-dimensional model representation (HDMR) is also briefly discussed and acts as a benchmark model for comparison. We apply the considered methods to a dataset, which was obtained from a compression ignition engine and includes as outputs soot and NO x emissions as functions of 14 engine operating condition variables. We combine a quasi-random global search with a conventional grid-optimization method in order to identify suitable values for several DKL hyperparameters, which include network architecture, kernel, and learning parameters. The performance of DKL, HDMR, plain GPs, and plain DNNs is compared in terms of the root mean squared error (RMSE) of the predictions as well as computational expense of training and evaluation. It is shown that DKL performs best in terms of RMSE in the predictions whilst maintaining the computational cost at a reasonable level, and DKL predictions are in good agreement with the experimental emissions data.
47
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.3K citations
Advances in neural information processing systems 7
Krzysztof J. Cios, Mark E. Shields · Neurocomputing · 1997 · 22.3K citations
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2015 · 18.8K citations
Extreme learning machine: Theory and applications
Guang-Bin Huang, Qinyu Zhu, Chee‐Kheong Siew · Neurocomputing · 2006 · 13.2K citations