Survey on the solution of data skew in big data

The use of big data is increasing day by day. The problem, while processing big data also increases. Big data processing is done by a powerful tool called Map Reduce. The main problem faced while processing the big data is data skew. In the Past, while utilizing the MapReduce many problems occur lik...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:2016 Online International Conference on Green Engineering and Technologies (IC-GET) s. 1 - 4
Hlavní autoři: Jenifer, M., Bharathi, B.
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 01.11.2016
Témata:
Big Data
Cloud computing
Distributed databases
Hardware
Heuristic algorithms
Load management
map Reduce
Runtime
theta join
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:The use of big data is increasing day by day. The problem, while processing big data also increases. Big data processing is done by a powerful tool called Map Reduce. The main problem faced while processing the big data is data skew. In the Past, while utilizing the MapReduce many problems occur like theta join processing, running the application in cloud based environment, execution time being slow due to complex record usage etc. This paper elaborates the problems and solution found by authors while processing the big data using MapReduce tool.
DOI:10.1109/GET.2016.7916740