Environmental Modelling & Software · 2022 · 16 citations · 37 references
ComputingComputer ScienceMeteorologyArtificial IntelligenceAtmospheric ScienceWeather ForecastingDeep LearningFog ForecastingNeural NetworksRepresentation LearningCoastal Fog ForecastingComplexityConvolutional Forecasting ModelsDeep Learning For Big DataDeep Learning For ForecastingDeep Learning-based ForecastingFeature ImportanceModel Complexity
The forecasting of hazardous atmospheric phenomena is often challenging. Artificial intelligence (AI) models have been applied to atmospheric science problems. Model complexity provides a motivation to quantify the importance of model architecture components. We studied the relative importance of the components of the FogNet model that was designed for big atmospheric data: 1) 3D versus 2D convolution, 2) physics-based grouping and ordering of meteorological input features, 3) different auxiliary CNN-based feature learning modules and 4) parallel versus sequential spatial-variable-wise feature learning. We investigate the relative importance of these CNN architectural features by predicting coastal fog,a complex spatiotemporal dynamical process. We use four explainable AI techniques to better understand input feature contributions. The results of the experiments demonstrate that 3D-CNN based models better capture the complexity of the fog prediction process than the 2D-CNNs. We also show that physics-based feature grouping, and the order in which they are fed into the CNNs, significantly impacts performance.
37
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.3K citations
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
1993 · 14.3K citations