English
Related papers

Related papers: Enabling Compute-Communication Overlap in Distribu…

200 papers

To process and transfer large amounts of data in emerging wireless services, it has become increasingly appealing to exploit distributed data communication and learning. Specifically, edge learning (EL) enables local model training on…

Information Theory · Computer Science 2023-03-22 Wei Xu , Zhaohui Yang , Derrick Wing Kwan Ng , Marco Levorato , Yonina C. Eldar , M'erouane Debbah

Deep learning (DL) has emerged as a powerful tool for addressing the intricate challenges inherent in communication and sensing systems, significantly enhancing the intelligence of future sixth-generation (6G) networks. A substantial body…

Signal Processing · Electrical Eng. & Systems 2025-03-12 Cheng Luo , Luping Xiang , Jie Hu , Kun Yang

Deep Learning (DL) is penetrating into a diverse range of mass mobility, smart living, and industrial applications, rapidly transforming the way we live and work. DL is at the heart of many AI implementations. A key set of challenges is to…

Networking and Internet Architecture · Computer Science 2023-11-27 Weisi Guo , Schyler Sun , Bin Li , Sam Blakeman

We present Epidemic Learning (EL), a simple yet powerful decentralized learning (DL) algorithm that leverages changing communication topologies to achieve faster model convergence compared to conventional DL approaches. At each round of EL,…

Machine Learning · Computer Science 2023-10-30 Martijn de Vos , Sadegh Farhadkhani , Rachid Guerraoui , Anne-Marie Kermarrec , Rafael Pires , Rishi Sharma

Training deep learning (DL) models on petascale datasets is essential for achieving competitive and state-of-the-art performance in applications such as speech, video analytics, and object recognition. However, existing distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-08 Alex Aizman , Gavin Maltby , Thomas Breuel

The ubiquitous use of IoT and machine learning applications is creating large amounts of data that require accurate and real-time processing. Although edge-based smart data processing can be enabled by deploying pretrained models, the…

Machine Learning · Computer Science 2021-09-15 Yinghan Long , Indranil Chakraborty , Gopalakrishnan Srinivasan , Kaushik Roy

The emergence of Large Language Models (LLMs) has necessitated the adoption of distributed training techniques, involving the deployment of thousands of GPUs to train a single model. Unfortunately, the efficiency of large-scale distributed…

The convergence of communication and computation, along with the integration of machine learning and artificial intelligence, stand as key empowering pillars for the sixth-generation of communication systems (6G). This paper considers a…

Information Theory · Computer Science 2024-06-07 Robert-Jeron Reifert , Hayssam Dahrouj , Alaa Alameer Ahmad , Haris Gacanin , Aydin Sezgin

Deep neural networks (DNNs) typically employ an end-to-end (E2E) training paradigm which presents several challenges, including high GPU memory consumption, inefficiency, and difficulties in model parallelization during training. Recent…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Yuming Zhang , Shouxin Zhang , Peizhe Wang , Feiyu Zhu , Dongzhi Guan , Junhao Su , Jiabin Liu , Changpeng Cai

SoCs are now designed with their own AI accelerator segment to accommodate the ever-increasing demand of Deep Learning (DL) applications. With powerful MAC engines for matrix multiplications, these accelerators show high computing…

Hardware Architecture · Computer Science 2023-11-15 Kaniz Mishty , Mehdi Sadi

Federated Learning (FL) has become a viable technique for realizing privacy-enhancing distributed deep learning on the network edge. Heterogeneous hardware, unreliable client devices, and energy constraints often characterize edge computing…

Machine Learning · Computer Science 2024-11-05 Herbert Woisetschläger , Alexander Erben , Ruben Mayer , Shiqiang Wang , Hans-Arno Jacobsen

To enhance the quality and speed of data processing and protect the privacy and security of the data, edge computing has been extensively applied to support data-intensive intelligent processing services at edge. Among these data-intensive…

Networking and Internet Architecture · Computer Science 2020-10-30 Yana Qin , Danye Wu , Zhiwei Xu , Jie Tian , Yujun Zhang

Recent studies from several hyperscalars pinpoint to embedding layers as the most memory-intensive deep learning (DL) algorithm being deployed in today's datacenters. This paper addresses the memory capacity and bandwidth challenges of…

Machine Learning · Computer Science 2019-08-27 Youngeun Kwon , Yunjae Lee , Minsoo Rhu

Edge devices with local computation capability has made distributed deep learning training on edges possible. In such method, the cluster head of a cluster of edges schedules DL training jobs from the edges. Using such centralized…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-03 Tanmoy Sen , Haiying Shen

Advances in hybrid bonding and packaging have driven growing interest in 3D DRAM-stacked accelerators with higher memory bandwidth and capacity. As LLMs scale to hundreds of billions or trillions of parameters, distributed inference across…

Over the past two decades, High-Performance Computing (HPC) communities have developed many models for delivering education aiming to help students understand and harness the power of parallel and distributed computing. Most of these…

Computers and Society · Computer Science 2018-12-27 Xi Chen , Gregory S. Gutmann , Joe Bungo

Deep learning has become widely used in complex AI applications. Yet, training a deep neural network (DNNs) model requires a considerable amount of calculations, long running time, and much energy. Nowadays, many-core AI accelerators (e.g.,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-12 Yuxin Wang , Qiang Wang , Shaohuai Shi , Xin He , Zhenheng Tang , Kaiyong Zhao , Xiaowen Chu

Artificial Intelligence (AI) and Deep Learning (DL) algorithms are currently applied to a wide range of products and solutions. DL training jobs are highly resource demanding and they experience great benefits when exploiting AI…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-12 Federica Filippini , Danilo Ardagna , Marco Lattuada , Edoardo Amaldi , Michele Ciavotta , Maciek Riedl , Katarzyna Materka , Paweł Skrzypek , Fabrizio Magugliani , Marco Cicala

Deep learning has become very popular for tasks such as predictive modeling and pattern recognition in handling big data. Deep learning is a powerful machine learning method that extracts lower level features and feeds them forward for the…

Machine Learning · Computer Science 2018-03-07 Steven Young , Tamer Abdou , Ayse Bener

As deep neural networks (DNNs) grow in complexity and size, the resultant increase in communication overhead during distributed training has become a significant bottleneck, challenging the scalability of distributed training systems.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-13 Haoyu Li , Yuchen Xu , Jiayi Chen , Rohit Dwivedula , Wenfei Wu , Keqiang He , Aditya Akella , Daehyeok Kim