Remote Sensing of Environment · 2021 · 94 citations · 56 references
ComputingComputer ScienceUrban PlanningMachine LearningSpatial AnalysisUrban InequalityDeep LearningGeospatial Machine LearningRemote Sensing For Urban StudiesUrban Inequality AnalysisUrban Remote SensingDeep Learning-based Data FusionDeprivation IndexesEnvironmental DeprivationMean Absolute ErrorMultimodal Representation LearningSpatial Deep LearningStreet View Imagery
Data collected at large scale and low cost (e.g. satellite and street level imagery) have the potential to substantially improve resolution, spatial coverage, and temporal frequency of measurement of urban inequalities. Multiple types of data from different sources are often available for a given geographic area. Yet, most studies utilize a single type of input data when making measurements due to methodological difficulties in their joint use. We propose two deep learning-based methods for jointly utilizing satellite and street level imagery for measuring urban inequalities. We use London as a case study for three selected outputs, each measured in decile classes: income, overcrowding, and environmental deprivation. We compare the performances of our proposed multimodal models to corresponding unimodal ones using mean absolute error (MAE). First, satellite tiles are appended to street level imagery to enhance predictions at locations where street images are available leading to improvements in accuracy by 20, 10, and 9% in units of decile classes for income, overcrowding, and living environment. The second approach, novel to the best of our knowledge, uses a U-Net architecture to make predictions for all grid cells in a city at high spatial resolution (e.g. for 3 m × 3 m pixels in London in our experiments). It can utilize city wide availability of satellite images as well as more sparse information from street-level images where they are available leading to improvements in accuracy by 6, 10, and 11%. We also show examples of prediction maps from both approaches to visually highlight performance differences.
56
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
ImageNet Large Scale Visual Recognition Challenge
Olga Russakovsky, Jia Deng, Hao Su et al. · International Journal of Computer Vision · 2015 · 40.2K citations
Proceedings of IEEE International Conference on Computer Vision
1995 · 12.9K citations
Bag-of-visual-words and spatial extensions for land-use classification
Yi Yang, Shawn Newsam · 2010 · 2.9K citations