English
Related papers

Related papers: Demonstrating Interoperable Channel State Feedback…

200 papers

Large-scale Transformer models are known for their exceptional performance in a range of tasks, but training them can be difficult due to the requirement for communication-intensive model parallelism. One way to improve training speed is to…

Machine Learning · Computer Science 2023-01-09 Song Bian , Dacheng Li , Hongyi Wang , Eric P. Xing , Shivaram Venkataraman

Recurrent neural networks have proved to be an effective method for statistical language modeling. However, in practice their memory and run-time complexity are usually too large to be implemented in real-time offline mobile applications.…

Computation and Language · Computer Science 2019-04-09 Artem M. Grachev , Dmitry I. Ignatov , Andrey V. Savchenko

Federated Learning (FL) incurs high communication overhead, which can be greatly alleviated by compression for model updates. Yet the tradeoff between compression and model accuracy in the networked environment remains unclear and, for…

Machine Learning · Computer Science 2021-12-14 Laizhong Cui , Xiaoxin Su , Yipeng Zhou , Jiangchuan Liu

Codebook-based beam selection is one approach for configuring millimeter wave communication links. The overhead required to reconfigure the transmit and receive beam pair, though, increases in highly dynamic vehicular communication systems.…

Signal Processing · Electrical Eng. & Systems 2024-04-18 Ibrahim Kilinc , Ryan M. Dreifuerst , Junghoon Kim , Robert W. Heath

The classic wireless communication channel modeling is performed using Deterministic and Stochastic channel methodologies. Machine learning (ML) emerges to revolutionize system design for 5G and beyond. ML techniques such as supervise…

Signal Processing · Electrical Eng. & Systems 2020-05-05 Saud Aldossari , Kwang-Cheng Chen

The development of deep learning algorithms has extensively empowered humanity's task automatization capacity. However, the huge improvement in the performance of these models is highly correlated with their increasing level of complexity,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Eduarda Caldeira , Pedro C. Neto , Marco Huber , Naser Damer , Ana F. Sequeira

Wireless embedded edge devices are ubiquitous in our daily lives, enabling them to gather immense data via onboard sensors and mobile applications. This offers an amazing opportunity to train machine learning (ML) models in the realm of…

Information Theory · Computer Science 2023-12-15 Varun Laxman Muttepawar , Arjun Mehra , Zubair Shaban , Ranjitha Prasad , Harshan Jagadeesh

Deep neural networks (DNNs) have been quite successful in solving many complex learning problems. However, DNNs tend to have a large number of learning parameters, leading to a large memory and computation requirement. In this paper, we…

Machine Learning · Computer Science 2019-05-21 Sangkyun Lee , Jeonghyun Lee

This paper investigates deep learning techniques to predict transmit beamforming based on only historical channel data without current channel information in the multiuser multiple-input-single-output downlink. This will significantly…

Information Theory · Computer Science 2023-02-03 Juping Zhang , Gan Zheng , Yangyishi Zhang , Ioannis Krikidis , Kai-Kit Wong

Sharing forecasts of network timeseries data, such as cellular or electricity load patterns, can improve independent control applications ranging from traffic scheduling to power generation. Typically, forecasts are designed without…

Machine Learning · Computer Science 2021-10-06 Jiangnan Cheng , Marco Pavone , Sachin Katti , Sandeep Chinchali , Ao Tang

Despite the increasing prevalence of large language models (LLMs), we still have a limited understanding of how their representational spaces are structured. This limits our ability to interpret how and what they learn or relate them to…

Communication-constrained algorithms for decentralized learning and optimization rely on local updates coupled with the exchange of compressed signals. In this context, differential quantization is an effective technique to mitigate the…

Multiagent Systems · Computer Science 2024-06-27 Roula Nassif , Stefan Vlaski , Marco Carpentiero , Vincenzo Matta , Ali H. Sayed

Current Large Language Models (LLMs) face three major challenges: context length limitations, high inference costs, and catastrophic forgetting during continual learning. While Mixture-of-Experts (MoE) architectures mitigate some of these…

Machine Learning · Computer Science 2025-12-23 Zhongpan Tang

Decentralized distributed learning is the key to enabling large-scale machine learning (training) on edge devices utilizing private user-generated local data, without relying on the cloud. However, the practical realization of such…

Machine Learning · Computer Science 2022-09-13 Sai Aparna Aketi , Sangamesh Kodge , Kaushik Roy

Learned image compression sits at the intersection of machine learning and image processing. With advances in deep learning, neural network-based compression methods have emerged. In this process, an encoder maps the image to a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Fabien Allemand , Attilio Fiandrotti , Sumanta Chaudhuri , Alaa Eddine Mazouz

This paper investigates the optimization of the long-standing probabilistically robust transmit beamforming problem with channel uncertainties in the multiuser multiple-input single-output (MISO) downlink transmission. This problem poses…

Information Theory · Computer Science 2024-06-06 Kai Liang , Gan Zheng , Zan Li , Kai-Kit Wong , Chan-Byoung Chae

When deploying deep learning models to a device, it is traditionally assumed that available computational resources (compute, memory, and power) remain static. However, real-world computing systems do not always provide stable resource…

Machine Learning · Computer Science 2021-10-11 Elvis Nunez , Maxwell Horton , Anish Prabhu , Anurag Ranjan , Ali Farhadi , Mohammad Rastegari

In network MIMO cellular systems, subsets of base stations (BSs), or remote radio heads, are connected via backhaul links to central units (CUs) that perform joint encoding in the downlink and joint decoding in the uplink. Focusing on the…

Information Theory · Computer Science 2013-10-24 Jinkyu Kang , Osvaldo Simeone , Joonhyuk Kang , Shlomo Shamai

Recently, the Multilinear Compressive Learning (MCL) framework was proposed to efficiently optimize the sensing and learning steps when working with multidimensional signals, i.e. tensors. In Compressive Learning in general, and in MCL in…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Dat Thanh Tran , Moncef Gabbouj , Alexandros Iosifidis

Efficient channel state information (CSI) compression at the user equipment plays a key role in enabling accurate channel reconstruction and precoder design in massive multiple-input multiple-output systems. A key challenge lies in…

Information Theory · Computer Science 2026-02-04 Xi Chen , Homa Esfahanizadeh , Foad Sohrabi