Advances in Space Research · 2022 · 50 citations · 38 references
ComputingComputer ScienceData ScienceGeodesyMachine LearningUncertainty QuantificationDeep LearningGeospatial Uncertainty ModelingLoss FunctionMachine Learning For Big DataSatellite GeodesySpace GeodesyEarth Orientation ParametersGeodetic Data ProcessingGeodetic SignalsGlobal Navigation Satellite System GeodesyParameter Estimation In GeodesyParameter UncertaintyPolar Motion ModelingPolar Motion Theory
Data uncertainty plays an important role in the field of geodesy. Even though deep learning is becoming increasingly important for geodetic applications due to its high accuracy, it typically does not consider the data uncertainty. As we demonstrate in this study, we propose to include the uncertainty of data in deep neural network architectures to achieve a better generalization. This is advantageous for big data applications as well as for small datasets. Inspired by weighted and total least squares, we formulate the problem for both input and target uncertainties, and combine it with the Bayesian learning method. This results in a new form of the loss function in machine learning. As an alternative approach, we consider data uncertainties by including them as additional features. For comparison purposes, we use models without the consideration of data uncertainty as a benchmark. To show the efficacy of the proposed method, we apply it to the prediction of Earth Orientation Parameters (EOPs, namely polar motion, dUT1, and LOD) and Global Navigation Satellite System (GNSS) station coordinate time series. We demonstrate that the least-squares-inspired method outperforms both the benchmark and the feature-inspired method for both the studies. In the EOPs study, the improvement can be more than 50% in the study interval. In the study of GNSS station coordinate time series, which is presented for 1000 stations across the globe, the improvement on an average basis is around 12%. The results demonstrate the advantage of using uncertainty information in the machine learning algorithms, when applied to geodetic time series.
38
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Klaus Greff, Rupesh K. Srivastava, Jan Koutník et al. · IEEE Transactions on Neural Networks and Learning Systems · 2016 · 6.8K citations · Full text
Proceedings of the 21st International Conference on Neural Information Processing Systems
Daphne Koller, Dale Schuurmans, Yoshua Bengio et al. · 2008 · 4.5K citations