English
Related papers

Related papers: Capacity-Approaching Autoencoders for Communicatio…

200 papers

Semantic communication systems often use an end-to-end neural network to map input data into continuous symbols. These symbols, which are essentially neural network features, usually have fixed dimensions and heavy-tailed distributions.…

Information Theory · Computer Science 2025-12-17 Hanju Yoo , Dongha Choi , Songkuk Kim , Chan-Byoung Chae , Robert W. Heath

We propose a new approach to the problem of optimizing autoencoders for lossy image compression. New media formats, changing hardware technology, as well as diverse requirements and content types create a need for compression algorithms…

Machine Learning · Statistics 2017-03-02 Lucas Theis , Wenzhe Shi , Andrew Cunningham , Ferenc Huszár

Quantum neural networks are emerging as potential candidates to leverage noisy quantum processing units for applications. Here we introduce hybrid quantum-classical autoencoders for end-to-end radio communication. In the physical layer of…

Attracted by its scalability towards practical codeword lengths, we revisit the idea of Turbo-autoencoders for end-to-end learning of PHY-Layer communications. For this, we study the existing concepts of Turbo-autoencoders from the…

Information Theory · Computer Science 2021-07-23 Jannis Clausius , Sebastian Dörner , Sebastian Cammerer , Stephan ten Brink

We consider a queue-channel model that captures the waiting time-dependent degradation of information bits as they wait to be transmitted. Such a scenario arises naturally in quantum communications, where quantum bits tend to decohere…

Information Theory · Computer Science 2023-05-09 Jaswanthi Mandalapu , Krishna Jagannathan , Avhishek Chatterjee , Andrew Thangaraj

Feedback communication is studied from a control-theoretic perspective, mapping the communication problem to a control problem in which the control signal is received through the same noisy channel as in the communication problem, and the…

Information Theory · Computer Science 2010-06-29 Ehsan Ardestanizadeh , Massimo Franceschetti

Transferring knowledge from one neural network to another has been shown to be helpful for learning tasks with few training examples. Prevailing fine-tuning methods could potentially contaminate pre-trained features by comparably high…

Machine Learning · Computer Science 2019-07-15 Farshid Varno , Behrouz Haji Soleimani , Marzie Saghayi , Lisa Di Jorio , Stan Matwin

Autoencoding has achieved great empirical success as a framework for learning generative models for natural images. Autoencoders often use generic deep networks as the encoder or decoder, which are difficult to interpret, and the learned…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Xili Dai , Ke Chen , Shengbang Tong , Jingyuan Zhang , Xingjian Gao , Mingyang Li , Druv Pai , Yuexiang Zhai , XIaojun Yuan , Heung-Yeung Shum , Lionel M. Ni , Yi Ma

We study the index coding problem in the presence of an eavesdropper, where the aim is to communicate without allowing the eavesdropper to learn any single message aside from the messages it may already know as side information. We…

Information Theory · Computer Science 2018-09-12 Yuxin Liu , Badri N. Vellambi , Young-Han Kim , Parastoo Sadeghi

The design of fluid channel structures of reactors or separators of chemical processes is key to enhancing the mass transfer processes inside the devices. However, the systematic design of channel topological structures is difficult for…

Fluid Dynamics · Physics 2025-03-07 Chenhui Kou , Yuhui Yin , Min Zhu , Shengkun Jia , Yiqing Luo , Xigang Yuana , Lu Lu

We present a novel autoencoder-based approach for designing codes that provide unequal error protection (UEP) capabilities. The proposed design is based on a generalization of an autoencoder loss function that accommodates both message-wise…

Information Theory · Computer Science 2021-04-19 Vukan Ninkovic , Dejan Vukobratovic , Christian Häger , Henk Wymeersch , Alexandre Graell i Amat

This work investigates the fundamental limits of communication over a noisy discrete memoryless channel that wears out, in the sense of signal-dependent catastrophic failure. In particular, we consider a channel that starts as a memoryless…

Information Theory · Computer Science 2018-08-07 Ting-Yi Wu , Lav R. Varshney , Vincent Y. F. Tan

A grand challenge in representation learning is to learn the different explanatory factors of variation behind the high dimen- sional data. Encoder models are often determined to optimize performance on training data when the real objective…

Machine Learning · Statistics 2018-02-16 Matías Vera , Pablo Piantanida , Leonardo Rey Vega

One of the paramount advantages of multi-level cache-enabled (MLCE) networks is pushing contents proximity to the network edge and proactively caching them at multiple transmitters (i.e., small base-stations (SBSs), unmanned aerial vehicles…

Information Theory · Computer Science 2021-02-09 Mohammed S. Al-Abiad , Md. Zoheb Hassan , Md. Jahangir Hossain

Traditional communication theory focuses on minimizing transmit power. However, communication links are increasingly operating at shorter ranges where transmit power can be significantly smaller than the power consumed in decoding. This…

Information Theory · Computer Science 2011-02-17 Pulkit Grover , Kristen Ann Woyach , Anant Sahai

A major challenge of today's quantum communication systems lies in the transmission of quantum information with high rates over long distances in the presence of unavoidable losses. Thereby the achievable quantum communication rate is…

Quantum Physics · Physics 2012-08-22 Andreas Christ , Cosmo Lupo , Christine Silberhorn

Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mackenzie J. Meni , Ryan T. White , Michael Mayo , Kevin Pilkiewicz

The optimal decoder achieving the outage capacity under imperfect channel estimation is investigated. First, by searching into the family of nearest neighbor decoders, which can be easily implemented on most practical coded modulation…

Information Theory · Computer Science 2016-11-15 Pablo Piantanida , Sajad Sadough , Pierre Duhamel

This paper proposes a method to optimize communication code rates via the application of neural polar decoders (NPDs). Employing this approach enables simultaneous optimization of code rates over input distributions while providing a…

Information Theory · Computer Science 2025-06-23 Ziv Aharoni , Bashar Huleihel , Henry D Pfister , Haim H Permuter

In this paper the cognitive interference channel with a common message, a variation of the classical cognitive interference channel in which the cognitive message is decoded at both receivers, is studied. For this channel model new outer…

Information Theory · Computer Science 2012-08-21 Stefano Rini , Carolin Huppert