Search Results - "Distributed data processing"

DolphinNext: a distributed data processing platform for high throughput genomics by Yukselen, Onur, Turkyilmaz, Osman, Ozturk, Ahmet Rasit, Garber, Manuel, Kucukural, Alper

“…Background The emergence of high throughput technologies that produce vast amounts of genomic data, such as next-generation sequencing (NGS) is transforming…”
Get full text

Scalable Data Partitioning Techniques for Distributed Data Processing in Cloud Environments : A Review by Ponnusamy, Sivakumar, Gupta, Pankaj

“…Cloud storage allows individuals to store and access data from remote locations, providing the convenience of on-demand access to high-quality cloud…”
Get full text

Evaluation of distributed data processing frameworks in hybrid clouds by Ullah, Faheem, Dhingra, Shagun, Xia, Xiaoyu, Babar, M. Ali

“…Distributed data processing frameworks (e.g., Hadoop, Spark, and Flink) are widely used to distribute data among computing nodes of a cloud…”
Get full text

LEO Satellite Networks Assisted Geo-Distributed Data Processing by Zhao, Zhiyuan, Chen, Zhe, Lin, Zheng, Zhu, Wenjun, Qiu, Kun, You, Chaoqun, Gao, Yue

“…Nowadays, the increasing deployment of edge clouds globally provides users with low-latency services. However, connecting an edge cloud to a core cloud via…”
Get full text

A distributed data processing scheme based on Hadoop for synchrotron radiation experiments by Zhang, Ding, Dai, Ze-Yi, Sun, Xue-Ping, Wu, Xue-Ting, Li, Hui, Tang, Lin, He, Jian-Hua

“… This paper presents a set of distributed data processing…”
Get full text

High Performance Distributed Data Processing Architecture for AI-Based Multivariate Arctic Geospatial Predictive Weather Modeling by Moradi, Meisam Shayegh, Foerster, Kyle, Kaabouch, Naima, Parker, Sheridan, Ahajjam, Aymane, Wilcox, Andrew, Pasch, Timothy J.

“… Distributed data processing reduces computation time, improves model accuracy, and enhances…”
Get full text

MapReduce functions to remote sensing distributed data processing—Global vegetation drought monitoring as example by Zou, Quan, Li, Guoqing, Yu, Wenyang

“…Summary Global change models for different applications are developed, according to the principle of remote sensing technology. Data for these models are…”
Get full text

Distributed data processing and task scheduling based on GPU parallel computing by Li, Jun

“…Distributed data parallel (DDP) computing ensures data parallelism, enabling execution across several computers. A separate distributed data parallel computing…”
Get full text

Guest editorial: Distributed data processing in industrial applications by Gaj, Piotr, Malinowski, Aleksander, Sauter, Thilo, Valenzano, Adriano

“…The papers in this special section focus on the deployment of distributed data processing in industrial applications…”
Get full text

Towards an Energy Complexity Model for Distributed Data Processing Algorithms by Song, Jie, Zhao, Xingchen, Guo, Chaopeng, Gu, Yu, Yu, Ge

“… Electricity cost accounts for about 50% of data centers' operational costs. Therefore, the energy consumed for running distributed data processing algorithms on a data center is starting to attract both academia and industry…”
Get full text

Toward Distributed Data Processing on Intelligent Leak-Points Prediction in Petrochemical Industries by Wang, Kun, Zhuo, Linchao, Shao, Yun, Yue, Dong, Tsang, Kim Fung

“…Focusing on the leak-points in petrochemical industries, this paper discusses the key factors (i.e., equipment temperature, gas pressure, and diffusion rate)…”
Get full text

Security Framework for Distributed Data Processing by Jagadeesh, Sai D, Krishnaraj, P M

“…The increasing significance of distributed data processing services draws attention to the need to develop security solutions that are tailored to meet the requirements of these types of systems…”
Get full text

Distributed Data Processing and Its Impact on the Financial Ecosystem by Lakkireddy, Srinivas

“…This article examines the transformative impact of distributed data processing on the financial services industry…”
Get full text

Development Methodology for Organizing a Unified Architecture of the Software Complex for Distributed Data Processing and Storage in the BM@N Experiment by Gertsenberger, K. V.

“… To perform multiple processing and necessary physics analyses of such a large volume of data, a comprehensive architecture of software solutions for distributed data processing and storage is required…”
Get full text

Network-enabled MIMO systems with distributed data processing by Feng, Jiao, Liu, Wen, Li, Peng, Zhang, Johnson

“… In order to address this problem, the capacity of access network with network-enabled MIMO systems with distributed data processing is investigated in this paper…”
Get full text

Distributed Data Processing Optimization Based on Edge Computing in Intelligent Transportation System by Li, Wei, Wang, Lina

“…With the rapid development of intelligent transportation systems, the amount of data is growing exponentially, which puts higher demands on real-time…”
Get full text

A Network Load Perception Based Task Scheduler for Parallel Distributed Data Processing Systems by Tang, Zhuo, Xiao, Zhanfei, Yang, Li, He, Kailin, Li, Kenli

“…In parallel distributed data processing frameworks like Spark and Flink, task scheduling has a great impact on cluster performance…”
Get full text

Accelerating I/O in Distributed Data Processing Systems with Apache Arrow CHFS by Koyama, Sohei, Hiraga, Kohei, Tatebe, Osamu

“…In recent years, distributed data-processing frameworks have become popular for processing big data…”
Get full text

Distributed data processing and analysis environment for neutron scattering experiments at CSNS by Tian, H.L., Zhang, J.R., Yan, L.L., Tang, M., Hu, L., Zhao, D.X., Qiu, Y.X., Zhang, H.Y., Zhuang, J., Du, R.

“… A new distributed data processing and analysis environment has been developed, which has generic functionalities for neutron scattering experiments…”
Get full text

Creation of Information-Technological Reserve in Distributed Data Processing Systems by Somov, S. K.

“…The main stages are presented of creating an information-technological data reserve in distributed automated informational control systems. The reserve is…”
Get full text