English
Related papers

Related papers: Simple Modulo can Significantly Outperform Deep Le…

200 papers

For reliable transmission across a noisy communication channel, classical results from information theory show that it is asymptotically optimal to separate out the source and channel coding processes. However, this decomposition can fall…

Machine Learning · Computer Science 2019-05-15 Kristy Choi , Kedar Tatwawadi , Aditya Grover , Tsachy Weissman , Stefano Ermon

High quality data is essential in deep learning to train a robust model. While in other fields data is sparse and costly to collect, in error decoding it is free to query and label thus allowing potential data exploitation. Utilizing this…

Information Theory · Computer Science 2019-11-22 Ishay Be'ery , Nir Raviv , Tomer Raviv , Yair Be'ery

Training large language models is generally done via optimization methods on clusters containing tens of thousands of accelerators, communicating over a high-bandwidth interconnect. Scaling up these clusters is expensive and can become…

Machine Learning · Computer Science 2025-06-13 Jari Kolehmainen , Nikolay Blagoev , John Donaghy , Oğuzhan Ersoy , Christopher Nies

Decentralized nonconvex optimization has received increasing attention in recent years in machine learning due to its advantages in system robustness, data privacy, and implementation simplicity. However, three fundamental challenges in…

Machine Learning · Computer Science 2021-05-20 Xin Zhang , Jia Liu , Zhengyuan Zhu , Elizabeth S. Bentley

Channel state information (CSI) at the base station (BS) is crucial to achieve beamforming and multiplexing gains in multiple-input multiple-output (MIMO) systems. State-of-the-art limited feedback schemes require feedback overhead that…

Information Theory · Computer Science 2018-10-17 Panos N. Alevizos , Xiao Fu , Nicholas D. Sidiropoulos , Yang Ye , Aggelos Bletsas

In this letter, we propose a new molecular modulation scheme for nanonetworks. To evaluate the scheme we introduce a more realistic system model for molecule dissemination and propagation processes based on the Poisson distribution. We…

Information Theory · Computer Science 2012-09-26 Hamidreza Arjmandi , Amin Gohari , Masoume Nasiri Kenari , Farshid Bateni

In this study, we conduct a comparative analysis of deep learning-based noise reduction methods in low signal-to-noise ratio (SNR) scenarios. Our investigation primarily focuses on five key aspects: The impact of training data, the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-28 Shrishti Saha Shetu , Emanuël A. P. Habets , Andreas Brendel

Leveraging deep learning (DL)-based code analysis tools to solve software engineering tasks is becoming increasingly popular. Code models often suffer performance degradation due to various reasons (e.g., code data shifts). Retraining is…

Software Engineering · Computer Science 2025-06-18 Ravishka Rathnasuriya , Zijie Zhao , Wei Yang

Recent advances in large language models (LLMs) have given rise to powerful coding agents, making it possible for code assistants to evolve into code engineers. However, existing methods still face significant challenges in achieving…

Software Engineering · Computer Science 2025-12-10 Zongwei Li , Zhonghang Li , Zirui Guo , Xubin Ren , Chao Huang

This paper is concerned with bounds on the maximum-likelihood (ML) decoding error probability of Reed-Solomon (RS) codes over additive white Gaussian noise (AWGN) channels. To resolve the difficulty caused by the dependence of the Euclidean…

Information Theory · Computer Science 2014-01-22 Qiutao Zhuang , Xiao Ma , Aleksander Kavcic

End-to-end learning of communication systems enables joint optimization of transmitter and receiver, implemented as deep neural network-based autoencoders, over any type of channel and for an arbitrary performance metric. Recently, an…

Information Theory · Computer Science 2019-06-25 Mathieu Goutay , Fayçal Ait Aoudia , Jakob Hoydis

In this paper, a deep learning (DL)-based sphere decoding algorithm is proposed, where the radius of the decoding hypersphere is learned by a deep neural network (DNN). The performance achieved by the proposed algorithm is very close to the…

Signal Processing · Electrical Eng. & Systems 2024-03-26 Mostafa Mohammadkarimi , Mehrtash Mehrabi , Masoud Ardakani , Yindi Jing

Deep neural network (DNN)-assisted channel coding designs, such as low-complexity neural decoders for existing codes, or end-to-end neural-network-based auto-encoder designs are gaining interest recently due to their improved performance…

Information Theory · Computer Science 2022-11-04 Emre Ozfatura , Yulin Shao , Amin Ghazanfari , Alberto Perotti , Branislav Popovic , Deniz Gunduz

In frequency-division duplex (FDD) massive multiple-input multiple-output (MIMO) systems, the growing number of base station antennas leads to prohibitive feedback overhead for downlink channel state information (CSI). To address this…

Signal Processing · Electrical Eng. & Systems 2024-06-25 Yifan Ma , Hengtao He , Shenghui Song , Jun Zhang , Khaled B. Letaief

With the successful application of deep learning in communications systems, deep neural networks are becoming the preferred method for signal classification. Although these models yield impressive results, they often come with high…

Machine Learning · Computer Science 2024-06-13 Yao Lu , Yutao Zhu , Yuqi Li , Dongwei Xu , Yun Lin , Qi Xuan , Xiaoniu Yang

In this work, the critical role of noisy feedback in enhancing the secrecy capacity of the wiretap channel is established. Unlike previous works, where a noiseless public discussion channel is used for feedback, the feed-forward and…

Information Theory · Computer Science 2016-11-18 Lifeng Lai , Hesham El Gamal , H. Vincent Poor

In traditional software programs, it is easy to trace program logic from variables back to input, apply assertion statements to block erroneous behavior, and compose programs together. Although deep learning programs have demonstrated…

Machine Learning · Computer Science 2021-10-27 Mike Wu , Noah Goodman , Stefano Ermon

The classical Schalkwijk-Kailath (SK) scheme for the additive Gaussian noise channel with noiseless feedback is highly efficient since its coding complexity is extremely low and the decoding error doubly exponentially decays as the coding…

Information Theory · Computer Science 2025-07-03 Yuhan Yang , Mei Han , Haonan Zhang , Haoheng Yuan , Fan Cheng , Bin Dai

Transfer learning has recently become the dominant paradigm of machine learning. Pre-trained models fine-tuned for downstream tasks achieve better performance with fewer labelled examples. Nonetheless, it remains unclear how to develop…

Machine Learning · Computer Science 2024-01-30 Jonas Pfeiffer , Sebastian Ruder , Ivan Vulić , Edoardo Maria Ponti

In this paper, we propose a deep learning model for Demodulation Reference Signal (DMRS) based channel estimation task. Specifically, a novel Denoise, Linear interpolation and Refine (DLR) pipeline is proposed to mitigate the noise…

Signal Processing · Electrical Eng. & Systems 2021-09-23 Yu Tian , Chengguang Li , Sen Yang