DESIGN AND VERIFICATION OF REMOTE SENSING IMAGE DATA CENTER STORAGE ARCHITECTURE BASED ON HADOOP

The data center is a new concept of data processing and application proposed in recent years. It is a new method of processing technologies based on data, parallel computing, and compatibility with different hardware clusters. While optimizing the data storage management structure, it fully utilizes...

Full description

Saved in:
Bibliographic Details
Published in:International archives of the photogrammetry, remote sensing and spatial information sciences. Vol. XLII-3; pp. 1639 - 1642
Main Authors: Tang, D., Zhou, X., Jing, Y., Cong, W., Li, C.
Format: Journal Article
Language:English
Published: Copernicus Publications 30.04.2018
ISSN:2194-9034, 1682-1750, 2194-9034
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The data center is a new concept of data processing and application proposed in recent years. It is a new method of processing technologies based on data, parallel computing, and compatibility with different hardware clusters. While optimizing the data storage management structure, it fully utilizes cluster resource computing nodes and improves the efficiency of data parallel application. This paper used mature Hadoop technology to build a large-scale distributed image management architecture for remote sensing imagery. Using MapReduce parallel processing technology, it called many computing nodes to process image storage blocks and pyramids in the background to improve the efficiency of image reading and application and sovled the need for concurrent multi-user high-speed access to remotely sensed data. It verified the rationality, reliability and superiority of the system design by testing the storage efficiency of different image data and multi-users and analyzing the distributed storage architecture to improve the application efficiency of remote sensing images through building an actual Hadoop service system.
ISSN:2194-9034
1682-1750
2194-9034
DOI:10.5194/isprs-archives-XLII-3-1639-2018