Scalable GWR: A Linear-Time Algorithm for Large-Scale Geographically Weighted Regression with Polynomial Kernels

Although a number of studies have developed fast geographically weighted regression (GWR) algorithms for large samples, none of them has achieved linear-time estimation, which is considered a requisite for big data analysis in machine learning, geostatistics, and related domains. Against this backdr...

Full description

Saved in:
Bibliographic Details
Published in:Annals of the American Association of Geographers Vol. 111; no. 2; pp. 459 - 480
Main Authors: Murakami, Daisuke, Tsutsumida, Narumasa, Yoshida, Takahiro, Nakaya, Tomoki, Lu, Binbin
Format: Journal Article
Language:English
Published: Routledge 12.08.2020
Subjects:
computación veloz
datos espaciales grandes
escalabilidad
fast computation
geographically weighted regression
large spatial data
preprocesamiento
preprocessing
regresión geográficamente ponderada
scalability
可扩展性
地理加权回归
快速计算
空间大数据
预处理
ISSN:2469-4452, 2469-4460
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Although a number of studies have developed fast geographically weighted regression (GWR) algorithms for large samples, none of them has achieved linear-time estimation, which is considered a requisite for big data analysis in machine learning, geostatistics, and related domains. Against this backdrop, this study proposes a scalable GWR (ScaGWR) for large data sets. The key improvement is the calibration of the model through a precompression of the matrices and vectors whose size depends on the sample size, prior to the leave-one-out cross-validation, which is the heaviest computational step in conventional GWR. This precompression allows us to run the proposed GWR extension so that its computation time increases linearly with the sample size. With this improvement, the ScaGWR can be calibrated with 1 million observations without parallelization. Moreover, the ScaGWR estimator can be regarded as an empirical Bayesian estimator that is more stable than the conventional GWR estimator. We compare the ScaGWR with the conventional GWR in terms of estimation accuracy and computational efficiency using a Monte Carlo simulation. Then, we apply these methods to a U.S. income analysis. The code for ScaGWR is available in the R package scgwr. The code is embedded into C++ code and implemented in another R package, GWmodel.
ISSN:2469-4452
2469-4460
DOI:10.1080/24694452.2020.1774350