Search Results - "• Computing methodologies → Distributed algorithms"

Submodularity of Distributed Join Computation by Li, Rundong, Riedewald, Mirek, Deng, Xinyan

“…We study distributed equi-join computation in the presence of join-attribute skew, which causes load imbalance. Skew can be addressed by more fine-grained…”
Get more information

Centralized Training and Decentralized Control through the Actor-Critic Paradigm for Highly Optimized Multicores by Dietrich, Benedikt, Khdr, Heba, Henkel, Jorg

“…While distributed, neural-network-based resource controllers represent the state of the art for their ability to cope with the ever-expanding decision space,…”
Get full text

HADFL: Heterogeneity-aware Decentralized Federated Learning Framework by Cao, Jing, Lian, Zirui, Liu, Weihong, Zhu, Zongwei, Ji, Cheng

“…Federated learning (FL) supports training models on geographically distributed devices. However, traditional FL systems adopt a centralized synchronous…”
Get full text

DeepScaler: Holistic Autoscaling for Microservices Based on Spatiotemporal GNN with Adaptive Graph Learning by Meng, Chunyang, Song, Shijie, Tong, Haogang, Pan, Maolin, Yu, Yang

“…Autoscaling functions provide the foundation for achieving elasticity in the modern cloud computing paradigm. It enables dynamic provisioning or…”
Get full text

MMDFL: Multi-Model-based Decentralized Federated Learning for Resource-Constrained AIoT Systems by Yan, Dengke, Yang, Yanxin, Hu, Ming, Fu, Xin, Chen, Mingsong

“…Along with the prosperity of Artificial Intelligence (AI) techniques, more and more Artificial Intelligence of Things (AIoT) applications adopt Federated…”
Get full text

MAD-Max Beyond Single-Node: Enabling Large Machine Learning Model Acceleration on Distributed Systems by Hsia, Samuel, Golden, Alicia, Acun, Bilge, Ardalani, Newsha, DeVito, Zachary, Wei, Gu-Yeon, Brooks, David, Wu, Carole-Jean

“…Training and deploying large-scale machine learning models is time-consuming, requires significant distributed computing infrastructures, and incurs high…”
Get full text

Derm: SLA-aware Resource Management for Highly Dynamic Microservices by Chen, Liao, Luo, Shutian, Lin, Chenyu, Mo, Zizhao, Xu, Huanle, Ye, Kejiang, Xu, Chengzhong

“…Ensuring efficient resource allocation while providing service level agreement (SLA) guarantees for end-to-end (E2E) latency is crucial for microservice…”
Get full text

FedAT: A High-Performance and Communication-Efficient Federated Learning System with Asynchronous Tiers by Chai, Zheng, Chen, Yujing, Anwar, Ali, Zhao, Liang, Cheng, Yue, Rangwala, Huzefa

“…Federated learning (FL) involves training a model over massive distributed devices, while keeping the training data localized and private. This form of…”
Get full text

PreSto: An In-Storage Data Preprocessing System for Training Recommendation Models by Lee, Yunjae, Kim, Hyeseong, Rhu, Minsoo

“…Training recommendation systems (RecSys) faces several challenges as it requires the "data preprocessing" stage to preprocess an ample amount of raw data and…”
Get full text

NDFT: Accelerating Density Functional Theory Calculations via Hardware/Software Co-Design on Near-Data Computing System by Jiang, Qingcai, Tu, Buxin, Hao, Xiaoyu, Chen, Junshi, An, Hong

“…Linear-response time-dependent Density Functional Theory (LR-TDDFT) is a widely used method for accurately predicting the excited-state properties of physical…”
Get full text

DS-GL: Advancing Graph Learning via Harnessing Nature's Power within Scalable Dynamical Systems by Song, Ruibing, Wu, Chunshu, Liu, Chuan, Li, Ang, Huang, Michael, Geng, Tony Tong

“…With the rapid digitization of the world, an increasing number of real-world applications are turning to non-Euclidean data, modeled as graphs. Due to their…”
Get full text

Invited: Waving the Double-Edged Sword: Building Resilient CAVs with Edge and Cloud Computing by Liu, Xiangguo, Luo, Yunpeng, Goeckner, Anthony, Chakraborty, Trishna, Jiao, Ruochen, Wang, Ningfei, Wang, Yixuan, Sato, Takami, Chen, Qi Alfred, Zhu, Qi

“…The rapid advancement of edge and cloud computing platforms, vehicular ad-hoc networks, and machine learning techniques have brought both opportunities and…”
Get full text

AdaGL: Adaptive Learning for Agile Distributed Training of Gigantic GNNs by Zhang, Ruisi, Javaheripi, Mojan, Ghodsi, Zahra, Bleiweiss, Amit, Koushanfar, Farinaz

“…Distributed GNN training on contemporary massive and densely connected graphs requires information aggregation from all neighboring nodes, which leads to an…”
Get full text

Personalized Heterogeneity-aware Federated Search Towards Better Accuracy and Energy Efficiency by Yang, Zhao, Sun, Qingshuang

“…Federated learning (FL), a new distributed technology, allows us to train the global model on the edge and embedded devices without local data sharing…”
Get full text

Clairvoyant Prefetching for Distributed Machine Learning I/O by Dryden, Nikoli, Bohringer, Roman, Ben-Nun, Tal, Hoefler, Torsten

“…I/O is emerging as a major bottleneck for machine learning training, especially in distributed environments. Indeed, at large scale, I/O takes as much as 85%…”
Get full text

SparCML: High-Performance Sparse Communication for Machine Learning by Renggli, Cedric, Ashkboos, Saleh, Aghagolzadeh, Mehdi, Alistarh, Dan, Hoefler, Torsten

“…Applying machine learning techniques to the quickly growing data in science and industry requires highly-scalable algorithms. Large datasets are most commonly…”
Get full text

BLOwing Trees to the Ground: Layout Optimization of Decision Trees on Racetrack Memory by Hakert, Christian, Khan, Asif Ali, Chen, Kuan-Hsun, Hameed, Fazal, Castrillon, Jeronimo, Chen, Jian-Jia

“…Modern distributed low power systems tend to integrate machine learning algorithms, which are directly executed on the distributed devices (on the edge). In…”
Get full text

MyML: User-Driven Machine Learning by Goyal, Vidushi, Bertacco, Valeria, Das, Reetuparna

“…Machine learning (ML) on resource-constrained edge devices is expensive and often requires offloading computation to the cloud, which may compromise the…”
Get full text

Leveraging the Compute Power of two HPC Systems for Higher-Dimensional Grid-Based Simulations with the Widely-Distributed Sparse Grid Combination Technique by Pollinger, Theresa, Van Craen, Alexander, Niethammer, Christoph, Breyer, Marcel, Pfluger, Dirk

“…Grid-based simulations of hot fusion plasmas are often severely limited by computational and memory resources; the grids live in four- to six-dimensional space…”
Get full text

Efficient Scaling of Dynamic Graph Neural Networks by Chakaravarthy, Venkatesan T., Pandian, Shivmaran S., Raje, Saurabh, Sabharwal, Yogish, Suzumura, Toyotaro, Ubaru, Shashanka

“…We present distributed algorithms for training dynamic Graph Neural Networks (GNN) on large scale graphs spanning multi-node, multi-GPU systems. To the best of…”
Get full text