Data Distribution Service Based on Symbol Bloom Filter for Large-Scale Distributed Computing

Data distribution service (DDS) has been widely used for the data communication of distributed computing system. But the existing DDS is based on the Simple Discovery Protocol (SDP). Its high network data transmission cannot meet the real-time requirement of the large-scale distributed computing. Fo...

Full description

Saved in:

Bibliographic Details
Published in:	2022 7th International Conference on Cloud Computing and Big Data Analytics (ICCCBDA) pp. 112 - 116
Main Authors:	Liu, Zhexu, Zhao, Zhen
Format:	Conference Proceeding
Language:	English
Published:	IEEE 22.04.2022
Subjects:	Cloud computing DDS Distributed databases false positive ratio Filtering algorithms Information filters large-scale distributed computing network data transmission Protocols Real-time systems Symbols
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	Data distribution service (DDS) has been widely used for the data communication of distributed computing system. But the existing DDS is based on the Simple Discovery Protocol (SDP). Its high network data transmission cannot meet the real-time requirement of the large-scale distributed computing. For this problem, this paper proposes a lightweight automatic discovery algorithm for DDS. In this algorithm, a new Bloom Filter with symbol is presented to compress the information transmitted between the distributed computing nodes, which is called Symbol Bloom Filter (SBF). Then it is combined with the SDP to reduce the consumption of the automatic discovery process in DDS. Experiments show that the proposed SDP_SBF can present a lower fault positive ratio while reducing data transmission, and therefore improves the real-time performance of DDS in the large-scale distributed computing.
DOI:	10.1109/ICCCBDA55098.2022.9778936