AIChE Journal · 1994 · 591 citations · 31 references
ComputingChemical EngineeringBiochemical EngineeringBioprocess EngineeringMachine LearningBioprocess ModelingBioprocess OptimizationDeep LearningKinetic ModelingNeural ModelingNeural NetworksChemical Process DevelopmentChemical Process SynthesisChemical Process SystemsFermentation ModelingNeural Network ModelingParameter Estimation In BioprocessesPrior Related Knowledge
The study proposes a hybrid modeling approach that integrates prior knowledge with artificial neural networks to improve predictions from sparse and noisy chemical process data. Prior knowledge is incorporated as a simple process model and first‑principle equations that enforce equality constraints, while the neural network compensates for inaccuracies and inequality constraints guide parameter estimation, demonstrated on fed‑batch penicillin fermentation to predict biomass and metabolites. The hybrid model outperforms a pure neural network, requiring less data, yielding more accurate, consistent predictions, and providing reliable extrapolation.
Abstract We present a method for synthesizing chemical process models that combines prior knowledge and artificial neural networks. The inclusion of prior knowledge is investigated as a means of improving the neural network predictions when trained on sparse and noisy process data. Prior knowledge enters the hybrid model as a simple process model and first principle equations. The simple model controls the extrapolation of the hybrid in the regions of input space that lack training data. The first principle equations, such as mass and component balances, enforce equality constraints. The neural network compensates for inaccuracy in the prior model. In addition, inequality constraints are imposed during parameter estimation. For illustration, the approach is applied in predicting cell biomass and secondary metabolite in a fed‐batch penicillin fermentation. Our results show that prior knowledge enhances the generalization capabilities of a pure neural network model. The approach is shown to require less data for parameter estimation, produce more accurate and consistent predictions, and provide more reliable extrapolation.
31
Multilayer feedforward networks are universal approximators
Kurt Hornik, Maxwell B. Stinchcombe, Halbert White · Neural Networks · 1989 · 21.2K citations
Multivariate Adaptive Regression Splines
Jerome H. Friedman · The Annals of Statistics · 1991 · 8.1K citations · Full text
Robert A. Koyak, T. J. Hastie, Ryan J. Tibshirani · Journal of the American Statistical Association · 1991 · 7.7K citations
David Mackay · Neural Computation · 1992 · 4.4K citations · Full text