Double-layered big data analytics architecture for solar cells series welding machine

•A hybrid service-driven architecture ATWDP is achieved by processing the real-time and large scale hypo-real-time data.•A parallel algorithm for quality evaluation is proposed to contribute the high dependability of the ATWDP.•The Hadoop Apache framework with Hive, MySQL, Spark, and Sqoop are used...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Computers in industry Ročník 97; s. 17 - 23
Hlavní autoři: Pei, Feng-Que, Li, Dong-Bo, Tong, Yi-Fei
Médium: Journal Article
Jazyk:angličtina
Vydáno: Elsevier B.V 01.05.2018
Témata:
Batch process
Big data analytics
MapReduce
Quality evaluation
Real-Time monitoring
Solar cells series welding
Big data analytics
Real-Time monitoring
Quality evaluation
Solar cells series welding
Batch process
MapReduce
ISSN:0166-3615, 1872-6194
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:•A hybrid service-driven architecture ATWDP is achieved by processing the real-time and large scale hypo-real-time data.•A parallel algorithm for quality evaluation is proposed to contribute the high dependability of the ATWDP.•The Hadoop Apache framework with Hive, MySQL, Spark, and Sqoop are used in this paper. The rapid and extensive pervasion of big data has enhanced the revolution of the society. A great interest has arisen in the past five years for mining and sharing the massive data. However, implementation of the big data analysis is facing many challenges, such as the storage, transmission, and computing. How to make the decision more intelligent in latency time becomes a crucial requirement for many researches. In this paper, a double-layered architecture ATWDP of online and offline analytics for solar cells series welding machine industry is proposed and the distributed and parallel computing system can handle the above challenges. The ATWDP offers an approach to analyze the data gathered from various sensing devices stably and efficiently. Some key implementation technologies in the system are discussed, especially the Hadoop Apache framework. The evaluation of service quality based on Support Vector Machine-Dempster Shafer Theory (SVMs-DS) and Spark is an application scenario to illustrate the mechanism of the ATWDP. And a data set is used to verify the rationality of the ATWDP in the storage and processing. Test results show that the ATWDP platform has a good performance and is a suitable solution for dealing with the big data of solar cells series welding machine.
ISSN:0166-3615
1872-6194
DOI:10.1016/j.compind.2018.01.019