English
Related papers

Related papers: Training-Based Schemes are Suboptimal for High Rat…

200 papers

Although Terahertz communication systems can provide high data rates, it needs high directional beamforming at transmitters and receivers to achieve such rates over a long distance. Therefore, an efficient beam training method is vital to…

Information Theory · Computer Science 2022-01-03 Songjie Yang , Zhongpei Zhang , Zhenzhen Hu , Nuan Song , Hao Liu

Supercomputer architectures are trending toward higher computational throughput due to the inclusion of heterogeneous compute nodes. These multi-GPU nodes increase on-node computational efficiency, while also increasing the amount of data…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-14 Shelby Lockhart , Amanda Bienz , William D. Gropp , Luke N. Olson

In this paper, a novel time-based modulation scheme is proposed in the time-asynchronous channel for diffusion-based molecular communication systems with drift. Based on this modulation scheme, we demonstrate that the sample variance of…

Information Theory · Computer Science 2019-05-31 Qingchao Li

We consider the problem of exact synchronization of two rankings at remote locations connected by a two-way channel. Such synchronization problems arise when items in the data are distinguishable, as is the case for playlists, tasklists,…

Information Theory · Computer Science 2014-02-13 Lili Su , Olgica Milenkovic

Decentralized training has been actively studied in recent years. Although a wide variety of methods have been proposed, yet the decentralized momentum SGD method is still underexplored. In this paper, we propose a novel periodic…

Machine Learning · Computer Science 2020-08-25 Hongchang Gao , Heng Huang

Coherent communications aim to support higher data rates and extended connectivity at lower power consumption compared with traditional point-to-point transmissions. The typical setting of coherent communication schemes is based on a single…

Networking and Internet Architecture · Computer Science 2019-12-24 Yi Shi , Yalin E. Sagduyu

We consider optimal sensor scheduling with unknown communication channel statistics. We formulate two types of scheduling problems with the communication rate being a soft or hard constraint, respectively. We first present some structural…

Systems and Control · Computer Science 2025-04-03 Shuang Wu , Xiaoqiang Ren , Qing-Shan Jia , Karl Henrik Johansson , Ling Shi

Data parallel training is widely used for scaling distributed deep neural network (DNN) training. However, the performance benefits are often limited by the communication-heavy parameter synchronization step. In this paper, we take…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-13 Anand Jayarajan , Jinliang Wei , Garth Gibson , Alexandra Fedorova , Gennady Pekhimenko

We study asynchronous distributed decision-making for scalable multi-agent bandit submodular maximization. We are motivated by distributed information-gathering tasks in unknown environments and under heterogeneous inter-agent communication…

Systems and Control · Electrical Eng. & Systems 2026-04-09 Pranjal Sharma , Zirui Xu , Vasileios Tzoumas

In this paper, we analyze the impact of communication failures on the performance of optimal distributed frequency control. We consider a consensus-based control scheme, and show that it does not converge to the optimal solution when the…

Systems and Control · Computer Science 2016-05-04 Marzieh Parandehgheibi , Konstantin Turitsyn , Eytan Modiano

In this paper, we consider a multiuser multiple-input multiple-output (MU-MIMO) communication system between a base station equipped with multiple antennas and multiple mobile users each equipped with a single antenna. The uplink scenario…

Information Theory · Computer Science 2014-09-23 Songtao Lu , Zhengdao Wang

Samples from a high-dimensional AR[1] process are observed by a sender which can communicate only finitely many bits per unit time to a receiver. The receiver seeks to form an estimate of the process value at every time instant in…

Information Theory · Computer Science 2022-02-01 Rooji Jinan , Parimal Parag , Himanshu Tyagi

In this paper we address distributed learning problems over peer-to-peer networks. In particular, we focus on the challenges of quantized communications, asynchrony, and stochastic gradients that arise in this set-up. We first discuss how…

Optimization and Control · Mathematics 2025-09-04 Nicola Bastianello , Apostolos I. Rikos , Karl H. Johansson

Communication systems are traditionally designed to have tight transmitter-receiver synchronization. This requirement has negligible overhead in the high-SNR regime. However, in many applications, such as wireless sensor networks,…

Information Theory · Computer Science 2016-02-22 Yu-Chih Huang , Urs Niesen , Piyush Gupta

Split learning is a promising privacy-preserving distributed learning scheme that has low computation requirement at the edge device but has the disadvantage of high communication overhead between edge device and server. To reduce the…

Machine Learning · Computer Science 2022-03-10 Xing Chen , Jingtao Li , Chaitali Chakrabarti

As artificial intelligence systems spread to more diverse and larger tasks in many domains, the machine learning algorithms, and in particular the deep learning models and the databases required to train them are getting bigger themselves.…

Machine Learning · Computer Science 2019-04-22 Philippe Lacaille

A non-regenerative dual-hop wireless system based on a distributed space-time coding strategy is considered. It is assumed that each relay retransmits an appropriately scaled space-time coded version of its received signal. The main goal of…

Information Theory · Computer Science 2016-11-18 Jamshid Abouei , Hossein Bagheri , Amir K. Khandani

Recommendation systems are often trained with a tremendous amount of data, and distributed training is the workhorse to shorten the training time. While the training throughput can be increased by simply adding more workers, it is also…

Machine Learning · Computer Science 2021-02-24 Qinqing Zheng , Bor-Yiing Su , Jiyan Yang , Alisson Azzolini , Qiang Wu , Ou Jin , Shri Karandikar , Hagay Lupesko , Liang Xiong , Eric Zhou

As datasets and models become increasingly large, distributed training has become a necessary component to allow deep neural networks to train in reasonable amounts of time. However, distributed training can have substantial communication…

Machine Learning · Computer Science 2021-10-18 Jose Javier Gonzalez Ortiz , Jonathan Frankle , Mike Rabbat , Ari Morcos , Nicolas Ballas

Entanglement assistance can improve communication rates significantly. Yet, its generation is susceptible to failure. The unreliable assistance model accounts for those challenges. Previous work provided an asymptotic formula that outlines…

Quantum Physics · Physics 2023-10-04 Uzi Pereg