GeoQuery: Integrating HPC systems and public web-based geospatial data tools

Interdisciplinary use of geospatial data requires the integration of data from a breadth of sources, and frequently involves the harmonization of different methods of sampling, measurement, and technical data types. These integrative efforts are often inhibited by fundamental geocomputational challe...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Computers & geosciences Jg. 122; S. 103 - 112
Hauptverfasser: Goodman, Seth, BenYishay, Ariel, Lv, Zhonghui, Runfola, Daniel
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Elsevier Ltd 01.01.2019
Schlagworte:
Algorithms
Computational methods
computers
data collection
Data processing
Geographical information science & systems
geophysics
geospatial data processing
Internet
Parallel and high-performance computing
processing technology
spatial data
Spatial statistics
statistics
Data processing
Computational methods
Algorithms
Geographical information science & systems
Parallel and high-performance computing
Spatial statistics
ISSN:0098-3004
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Interdisciplinary use of geospatial data requires the integration of data from a breadth of sources, and frequently involves the harmonization of different methods of sampling, measurement, and technical data types. These integrative efforts are often inhibited by fundamental geocomputational challenges, including a lack of memory efficient or parallel processing approaches to traditional methods such as zonal statistics. GeoQuery (geoquery.org) is a dynamic web application which utilizes a High Performance Computing cluster and novel parallel geospatial data processing methods to overcome these challenges. Through an online interface, GeoQuery users can request geospatial data - which spans categories including geophysical, environmental and social measurements - to be aggregated to user-selected units of analysis (e.g., subnational administrative boundaries). Once a request has been processed, users are provided with permanent links to access their customized data and documentation. Datasets made available through GeoQuery are reviewed, prepared, and provisioned by geospatial data specialists, with processing routines tailored for each dataset. The code used and steps taken while preparing datasets and processing user requests are publicly available, ensuring transparency and replicability of all data and processes. By mediating the complexities of working with geospatial data, GeoQuery reduces the barriers to entry and the related costs of incorporating geospatial data into research across disciplines. This paper presents the technology and methods used by GeoQuery to process and manage geospatial data and user requests. •Open source web application to access and integrate spatial data.•Integration of High Performance Computing (HPC) cluster and web application.•Improved zonal statistics methods for use in an HPC environment.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:0098-3004
DOI:10.1016/j.cageo.2018.10.009