Spatial Statistics · 2018 · 56 citations · 54 references
ComputingComputer ScienceMachine LearningSpatial StatisticsTime Series AnalysisFourier AnalysisGaussian Process ModelingGaussian ProcessesKernel MethodsNeural NetworksRepresentation LearningFourier FeaturesFourier Transform FeaturesKernel LearningKernel-based Spatial FeaturesLand Surface Temperature MappingLand Surface Temperature RetrievalsSpatial Machine LearningTime Series Representation Learning
The use of covariance kernels is ubiquitous in the field of spatial statistics. Kernels allow data to be mapped into high-dimensional feature spaces and can thus extend simple linear additive methods to nonlinear methods with higher order interactions. However, until recently, there has been a strong reliance on a limited class of stationary kernels such as the Matérn or squared exponential, limiting the expressiveness of these modelling approaches. Recent machine learning research has focused on spectral representations to model arbitrary stationary kernels and introduced more general representations that include classes of nonstationary kernels. In this paper, we exploit the connections between Fourier feature representations, Gaussian processes and neural networks to generalise previous approaches and develop a simple and efficient framework to learn arbitrarily complex nonstationary kernel functions directly from the data, while taking care to avoid overfitting using state-of-the-art methods from deep learning. We highlight the very broad array of kernel classes that could be created within this framework. We apply this to a time series dataset and a remote sensing problem involving land surface temperature in Eastern Africa. We show that without increasing the computational or storage complexity, nonstationary kernels can be used to improve generalisation performance and provide more interpretable results.
54
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.3K citations
The global distribution and burden of dengue
Samir Bhatt, Peter W. Gething, Oliver J. Brady et al. · Nature · 2013 · 10.2K citations · Full text
Public Health, Infectious Disease Control, Infectious Diseases +12
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Martı́n Abadi, Ashish Agarwal, Paul Barham et al. · arXiv (Cornell University) · 2016 · 9.8K citations · Full text
Random search for hyper-parameter optimization
James Bergstra, Yoshua Bengio · 2012 · 7.9K citations
<i>Stan</i> : A Probabilistic Programming Language
Bob Carpenter, Andrew Gelman, Matthew D. Hoffman et al. · Journal of Statistical Software · 2017 · 7.4K citations · Full text