An Electric Power Big Data Deployment Solution for Distributed Memory Computing

In the Big Data computing, improving performance with memory computing is one of hot spots. In the memory computing, the data deployment directly affects load balance and task efficiency. In the scene of memory computing of electric power data, two unsolved problems are: (1) only memory space, witho...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Proceedings (International Symposium on Parallel Architectures, Algorithms and Programming. Print) S. 155 - 161
Hauptverfasser: Zhi Yang, Chunping Zhang, Mu Hu, Feng Lin
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 01.12.2015
Schlagworte:
Big data
Business
Data Deployment strategy
Distributed databases
Distributed Memory Computing
Hardware
Objectification Parallel Computing
Parallel processing
Power systems
ISSN:2168-3042
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:In the Big Data computing, improving performance with memory computing is one of hot spots. In the memory computing, the data deployment directly affects load balance and task efficiency. In the scene of memory computing of electric power data, two unsolved problems are: (1) only memory space, without the CPU frequency and nuclear number, could be considered for load balance and improving performance, (2) there are so many manual operations that it is difficult to complete data deployment automatically. This paper provides an electric power data deployment solution for distributed memory computing to solve the above challenges. In the solution, according to business logic and hardware configuration of cluster nodes, the data deployment strategy can be established. Then, the deployment scheme can be implemented with interface operation. Lastly, cluster nodes load data according to the deployment scheme. The solution has been applied to the Objectification Parallel Computing (OPC). The application result shows that OPC can achieve the best performance which can meet the demand of system efficiency and the operation of data deployment is simple.
ISSN:2168-3042
DOI:10.1109/PAAP.2015.38