English
Related papers

Related papers: Feedback is Good, Active Feedback is Better: Block…

200 papers

Reliable communication over noisy channels requires the design of specialized error-correcting codes (ECCs) tailored to specific system requirements. Recently, neural network-based decoders have emerged as promising tools for enhancing ECC…

Information Theory · Computer Science 2025-12-01 Anastasiia Kurmukova , Selim F. Yilmaz , Emre Ozfatura , Deniz Gunduz

Deep Learning has been widely applied in the area of image processing and natural language processing. In this paper, we propose an end-to-end communication structure based on autoencoder where the transceiver can be optimized jointly. A…

Information Theory · Computer Science 2019-06-18 Tianjie Mu , Xiaohui Chen , Li Chen , Huarui Yin , Weidong Wang

Semantic communication focuses on conveying the task-relevant meaning rather than exact bitwise recovery. For image transmission with a generative receiver, relying only on text descriptions can be insufficient to preserve instance-specific…

Information Theory · Computer Science 2026-01-27 Xuesong Wang , Xinyan Xie , Mo Li , Zhaoqian Liu

The iterative selection of examples for labeling in active machine learning is conceptually similar to feedback channel coding in information theory: in both tasks, the objective is to seek a minimal sequence of actions to encode…

Machine Learning · Statistics 2021-03-02 Gregory Canal , Matthieu Bloch , Christopher Rozell

Graph neural networks (GNNs) are widely used as surrogates for costly experiments and first-principles simulations to study the behavior of compounds at atomistic scale, and their architectural complexity is constantly increasing to enable…

Machine Learning · Computer Science 2026-05-04 Arindam Chowdhury , Massimiliano Lupo Pasini

Innovation in the physical layer of communication systems has traditionally been achieved by breaking down the transceivers into sets of processing blocks, each optimized independently based on mathematical models. Conversely, deep learning…

Information Theory · Computer Science 2022-05-04 Mathieu Goutay

While end-to-end training of Deep Neural Networks (DNNs) yields state of the art performance in an increasing array of applications, it does not provide insight into, or control over, the features being extracted. We report here on a…

Neural and Evolutionary Computing · Computer Science 2022-07-11 Metehan Cekic , Can Bakiskan , Upamanyu Madhow

Decoding brain cognitive states from neuroimaging signals is an important topic in neuroscience. In recent years, deep neural networks (DNNs) have been recruited for multiple brain state decoding and achieved good performance. However, the…

Image and Video Processing · Electrical Eng. & Systems 2021-10-05 Zhoufan Jiang , Yanming Wang , ChenWei Shi , Yueyang Wu , Rongjie Hu , Shishuo Chen , Sheng Hu , Xiaoxiao Wang , Bensheng Qiu

In the past years, artificial neural networks (ANNs) have become the de-facto standard to solve tasks in communications engineering that are difficult to solve with traditional methods. In parallel, the artificial intelligence community…

Signal Processing · Electrical Eng. & Systems 2023-01-19 Eike-Manuel Bansbach , Alexander von Bank , Laurent Schmalen

Given the rapid changes in telecommunication systems and their higher dependence on artificial intelligence, it is increasingly important to have models that can perform well under different, possibly adverse, conditions. Deep Neural…

Signal Processing · Electrical Eng. & Systems 2021-03-30 Javier Maroto , Gérôme Bovet , Pascal Frossard

Training deep neural networks (DNNs) with backpropagation (BP) achieves state-of-the-art accuracy but requires global error propagation and full parameterization, leading to substantial memory and computational overhead. Direct Feedback…

Machine Learning · Computer Science 2025-10-30 Arani Roy , Marco P. Apolinario , Shristi Das Biswas , Kaushik Roy

This paper introduces a novel approach called "friendly attack" aimed at enhancing the performance of error correction channel codes. Inspired by the concept of adversarial attacks, our method leverages the idea of introducing slight…

Information Theory · Computer Science 2024-01-26 Anastasiia Kurmukova , Deniz Gunduz

Deep neural network (DNN)-based channel decoding is widely considered in the literature. The existing solutions are investigated for the case of hard output, i.e. when the decoder returns the estimated information word. At the same time,…

Information Theory · Computer Science 2024-10-28 Dmitry Artemasov , Kirill Andreev , Pavel Rybin , Alexey Frolov

Designing channel codes under low-latency constraints is one of the most demanding requirements in 5G standards. However, a sharp characterization of the performance of traditional codes is available only in the large block-length limit.…

Signal Processing · Electrical Eng. & Systems 2020-07-27 Yihan Jiang , Hyeji Kim , Himanshu Asnani , Sreeram Kannan , Sewoong Oh , Pramod Viswanath

Recent advances in deep neural networks have been developed via architecture search for stronger representational power. In this work, we focus on the effect of attention in general deep neural networks. We propose a simple and effective…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Jongchan Park , Sanghyun Woo , Joon-Young Lee , In So Kweon

Faced with the massive connection, sporadic transmission, and small-sized data packets in future cellular communication, a grant-free non-orthogonal random access (NORA) system is considered in this paper, which could reduce the access…

Information Theory · Computer Science 2019-10-10 Zhaoji Zhang , Ying Li , Chongwen Huang , Qinghua Guo , Chau Yuen , Yong Liang Guan

In conventional multi-user multiple-input multiple-output (MU-MIMO) systems with frequency division duplexing (FDD), channel acquisition and precoder optimization processes have been designed separately although they are highly coupled.…

Information Theory · Computer Science 2022-09-22 Jeonghyeon Jang , Hoon Lee , Il-Min Kim , Inkyu Lee

We consider wireless transmission of images in the presence of channel output feedback. From a Shannon theoretic perspective feedback does not improve the asymptotic end-to-end performance, and separate source coding followed by…

Information Theory · Computer Science 2020-04-13 David Burth Kurka , Deniz Gündüz

Recently, deep learning has been exploited in many fields with revolutionary breakthroughs. In the light of this, deep learning-assisted communication systems have also attracted much attention in recent years and have potential to break…

Signal Processing · Electrical Eng. & Systems 2019-09-04 Chieh-Fang Teng , Han-Mo Ou , An-Yeu Wu

Whereas deep neural networks were first mostly used for classification tasks, they are rapidly expanding in the realm of structured output problems, where the observed target is composed of multiple random variables that have a rich joint…

Neural and Evolutionary Computing · Computer Science 2016-11-15 Kyunghyun Cho , Aaron Courville , Yoshua Bengio