Survey on the solution of data skew in big data

The use of big data is increasing day by day. The problem, while processing big data also increases. Big data processing is done by a powerful tool called Map Reduce. The main problem faced while processing the big data is data skew. In the Past, while utilizing the MapReduce many problems occur lik...

Full description

Saved in:
Bibliographic Details
Published in:2016 Online International Conference on Green Engineering and Technologies (IC-GET) pp. 1 - 4
Main Authors: Jenifer, M., Bharathi, B.
Format: Conference Proceeding
Language:English
Published: IEEE 01.11.2016
Subjects:
Big Data
Cloud computing
Distributed databases
Hardware
Heuristic algorithms
Load management
map Reduce
Runtime
theta join
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The use of big data is increasing day by day. The problem, while processing big data also increases. Big data processing is done by a powerful tool called Map Reduce. The main problem faced while processing the big data is data skew. In the Past, while utilizing the MapReduce many problems occur like theta join processing, running the application in cloud based environment, execution time being slow due to complex record usage etc. This paper elaborates the problems and solution found by authors while processing the big data using MapReduce tool.
DOI:10.1109/GET.2016.7916740