English
Related papers

Related papers: Enabling Compute-Communication Overlap in Distribu…

200 papers

Cognitive communications have emerged as a promising solution to enhance, adapt, and invent new tools and capabilities that transcend conventional wireless networks. Deep learning (DL) is critical in enabling essential features of cognitive…

Signal Processing · Electrical Eng. & Systems 2022-04-05 Ahmet M. Elbir , Kumar Vijay Mishra

Deep learning (DL) has shown the great potentials to break the bottleneck of communication systems. This article provides an overview on the recent advancements in DL-based physical layer communications. DL can improve the performance of…

Information Theory · Computer Science 2019-02-20 Zhijin Qin , Hao Ye , Geoffrey Ye Li , Biing-Hwang Fred Juang

Training task in classical machine learning models, such as deep neural networks, is generally implemented at a remote cloud center for centralized learning, which is typically time-consuming and resource-hungry. It also incurs serious…

Machine Learning · Computer Science 2020-10-27 Jinke Ren , Guanding Yu , Guangyao Ding

Deep learning (DL) has achieved great success in signal processing and communications and has become a promising technology for future wireless communications. Existing works mainly focus on exploiting DL to improve the performance of…

Information Theory · Computer Science 2024-10-30 Jiajia Guo , Jinghe Wang , Chao-Kai Wen , Shi Jin , Geoffrey Ye Li

Deep learning (DL) workflows demand an ever-increasing budget of compute and energy in order to achieve outsized gains. Neural architecture searches, hyperparameter sweeps, and rapid prototyping consume immense resources that can prevent…

This article comprehensively reviews recent developments and research on deep learning-based (DL-based) techniques for integrated sensing and communication (ISAC) systems. ISAC, which combines sensing and communication functionalities, is…

Signal Processing · Electrical Eng. & Systems 2025-09-10 Murat Temiz , Yongwei Zhang , Yanwei Fu , Chi Zhang , Chenfeng Meng , Orhan Kaplan , Christos Masouros

The increased use of deep learning (DL) in academia, government and industry has, in turn, led to the popularity of on-premise and cloud-hosted deep learning platforms, whose goals are to enable organizations utilize expensive resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-25 Vaibhav Saxena , K. R. Jayaram , Saurav Basu , Yogish Sabharwal , Ashish Verma

Constant envelope (CE) precoding design is of great interest for massive multiuser multi-input multi-output systems because it can significantly reduce hardware cost and power consumption. However, existing CE precoding algorithms are…

Signal Processing · Electrical Eng. & Systems 2020-06-30 Yunfeng He , Hengtao , He , Chao-Kai Wen , Shi Jin

Decentralized learning (DL) leverages edge devices for collaborative model training while avoiding coordination by a central server. Due to privacy concerns, DL has become an attractive alternative to centralized learning schemes since…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-08 Martijn de Vos , Akash Dhasade , Anne-Marie Kermarrec , Erick Lavoie , Johan Pouwelse , Rishi Sharma

With the widespread deployment of fifth-generation (5G) wireless networks, research on sixth-generation (6G) technology is gaining momentum. Artificial Intelligence (AI) is anticipated to play a significant role in 6G, particularly through…

Information Theory · Computer Science 2025-05-26 Zhen Qiao , Jiang Xue , Junkai Zhang , Guanzhang Liu , Xiaoqin Ma , Runhua Li , Faheem A. Khan , John S. Thompson , Zongben Xu

This letter proposes two novel proactive cooperative caching approaches using deep learning (DL) to predict users' content demand in a mobile edge caching network. In the first approach, a (central) content server takes responsibilities to…

Networking and Internet Architecture · Computer Science 2018-12-14 Yuris Mulya Saputra , Dinh Thai Hoang , Diep N. Nguyen , Eryk Dutkiewicz , Dusit Niyato , Dong In Kim

Deep learning (DL) has emerged as a rapidly developing advanced technology, enabling the performance of complex tasks involving image recognition, natural language processing, and autonomous decision-making with high levels of accuracy.…

Hardware Architecture · Computer Science 2026-03-11 Soumita Chatterjee , Sudip Ghosh , Tamal Ghosh , Hafizur Rahaman

Communication overhead poses an important obstacle to distributed DNN training and draws increasing attention in recent years. Despite continuous efforts, prior solutions such as gradient compression/reduction, compute/communication…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-20 Hao Wang , Jingrong Chen , Xinchen Wan , Han Tian , Jiacheng Xia , Gaoxiong Zeng , Weiyan Wang , Kai Chen , Wei Bai , Junchen Jiang

It is important to scale out deep neural network (DNN) training for reducing model training time. The high communication overhead is one of the major performance bottlenecks for distributed DNN training across multiple GPUs. Our…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-23 Peng Sun , Wansen Feng , Ruobing Han , Shengen Yan , Yonggang Wen

Recent trend towards increasing large machine learning models require both training and inference tasks to be distributed. Considering the huge cost of training these models, it is imperative to unlock optimizations in computation and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-29 Abhinav Jangda , Jun Huang , Guodong Liu , Amir Hossein Nodehi Sabet , Saeed Maleki , Youshan Miao , Madanlal Musuvathi , Todd Mytkowicz , Olli Sarikivi

Deep learning (DL)-based channel state information (CSI) feedback has received significant research attention in recent years. However, previous research has overlooked the potential privacy disclosure problem caused by the transmission of…

Signal Processing · Electrical Eng. & Systems 2023-12-05 Yiming Cui , Jiajia Guo , Chao-Kai Wen , Shi Jin

Beam selection for millimeter-wave links in a vehicular scenario is a challenging problem, as an exhaustive search among all candidate beam pairs cannot be assuredly completed within short contact times. We solve this problem via a novel…

Decentralized learning (DL) is an emerging technique that allows nodes on the web to collaboratively train machine learning models without sharing raw data. Dealing with stragglers, i.e., nodes with slower compute or communication than…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-04 Sayan Biswas , Anne-Marie Kermarrec , Alexis Marouani , Rafael Pires , Rishi Sharma , Martijn de Vos

This paper studies a federated edge learning system, in which an edge server coordinates a set of edge devices to train a shared machine learning model based on their locally distributed data samples. During the distributed training, we…

Information Theory · Computer Science 2020-03-03 Xiaopeng Mo , Jie Xu

The growth of large language models (LLMs) increases challenges of accelerating distributed training across multiple GPUs in different data centers. Moreover, concerns about data privacy and data exhaustion have heightened interest in…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-18 Zhenheng Tang , Zichen Tang , Junlin Huang , Xinglin Pan , Rudan Yan , Yuxin Wang , Amelie Chi Zhou , Shaohuai Shi , Xiaowen Chu , Bo Li