English
Related papers

Related papers: Deep Learning for Channel Coding via Neural Mutual…

200 papers

Mutual information (MI) is a fundamental measure of statistical dependence between two variables, yet accurate estimation from finite data remains notoriously difficult. No estimator is universally reliable, and common approaches fail in…

Data Analysis, Statistics and Probability · Physics 2025-10-02 Eslam Abdelaleem , K. Michael Martini , Ilya Nemenman

Meta-learning provides a popular and effective family of methods for data-efficient learning of new tasks. However, several important issues in meta-learning have proven hard to study thus far. For example, performance degrades in…

Machine Learning · Computer Science 2021-12-03 Rui Li , Ondrej Bohdal , Rajesh Mishra , Hyeji Kim , Da Li , Nicholas Lane , Timothy Hospedales

The design of codes for feedback-enabled communications has been a long-standing open problem. Recent research on non-linear, deep learning-based coding schemes have demonstrated significant improvements in communication reliability over…

Information Theory · Computer Science 2023-06-09 Junghoon Kim , Taejoon Kim , David Love , Christopher Brinton

Deep unfolding is a method of growing popularity that fuses iterative optimization algorithms with tools from neural networks to efficiently solve a range of tasks in machine learning, signal and image processing, and communication systems.…

Signal Processing · Electrical Eng. & Systems 2019-10-09 Alexios Balatsoukas-Stimming , Christoph Studer

In this paper, a diffusion-based molecular communication channel between two nano-machines is considered. The effect of the amount of memory on performance is characterized, and a simple memory-limited decoder is proposed and its…

Biological Physics · Physics 2014-05-05 Reza Mosayebi , Hamidreza Arjmandi , Amin Gohari , Masoumeh Nasiri Kenari , Urbashi Mitra

The deep learning trend has recently impacted a variety of fields, including communication systems, where various approaches have explored the application of neural networks in place of traditional designs. Neural networks flexibly allow…

Signal Processing · Electrical Eng. & Systems 2019-03-12 Ye Wang , Toshiaki Koike-Akino

Can artificial intelligence unlock the secrets of the human brain? How do the inner mechanisms of deep learning models relate to our neural circuits? Is it possible to enhance AI by tapping into the power of brain recordings? These…

Neurons and Cognition · Quantitative Biology 2024-12-31 Subba Reddy Oota , Zijiao Chen , Manish Gupta , Raju S. Bapi , Gael Jobard , Frederic Alexandre , Xavier Hinaut

How to aggregate information from multiple instances is a key question multiple instance learning. Prior neural models implement different variants of the well-known encoder-decoder strategy according to which all input features are encoded…

Machine Learning · Computer Science 2022-07-26 Markus Zopf

Deep learning is popular as an end-to-end framework extracting the prominent features and performing the classification also. In this paper, we extensively investigate deep networks as an alternate to feature encoding technique of low level…

Machine Learning · Computer Science 2018-11-15 Bhalaji Nagarajan , V Ramana Murthy Oruganti

Many recent methods for unsupervised or self-supervised representation learning train feature extractors by maximizing an estimate of the mutual information (MI) between different views of the data. This comes with several immediate…

Machine Learning · Computer Science 2020-01-24 Michael Tschannen , Josip Djolonga , Paul K. Rubenstein , Sylvain Gelly , Mario Lucic

This paper is concerned with channel estimation in MIMO systems with few-bit ADCs. In these systems, a linear minimum mean-squared error (MMSE) channel estimator obtained in closed-form is not an optimal solution. We first consider a deep…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Duy H. N. Nguyen

This paper introduces a novel precoder design aimed at reducing pilot overhead for effective channel estimation in multiple-input multiple-output orthogonal frequency division multiplexing (MIMO-OFDM) applications utilizing high-order…

Signal Processing · Electrical Eng. & Systems 2025-04-30 Nilesh Kumar Jha , Huayan Guo , Vincent K. N. Lau

Recently, the ever-increasing demand for bandwidth in multi-modal communication systems requires a paradigm shift. Powered by deep learning, semantic communications are applied to multi-modal scenarios to boost communication efficiency and…

Signal Processing · Electrical Eng. & Systems 2023-05-19 Yangshuo He , Guanding Yu , Yunlong Cai

Despite rapid advances in machine learning tools, the majority of neural decoding approaches still use traditional methods. Modern machine learning tools, which are versatile and easy to use, have the potential to significantly improve…

Neurons and Cognition · Quantitative Biology 2020-07-06 Joshua I. Glaser , Ari S. Benjamin , Raeed H. Chowdhury , Matthew G. Perich , Lee E. Miller , Konrad P. Kording

Traditional communication system design has always been based on the paradigm of first establishing a mathematical model of the communication channel, then designing and optimizing the system according to the model. The advent of modern…

Information Theory · Computer Science 2022-10-07 Wei Yu , Foad Sohrabi , Tao Jiang

Accurate and efficient estimation of the high dimensional channels is one of the critical challenges for practical applications of massive multiple-input multiple-output (MIMO). In the context of hybrid analog-digital (HAD) transceivers,…

Information Theory · Computer Science 2022-02-08 Jiabao Gao , Caijun Zhong , Geoffrey Ye Li , Zhaoyang Zhang

An additive noise channel is considered, in which the distribution of the noise is nonparametric and unknown. The problem of learning encoders and decoders based on noise samples is considered. For uncoded communication systems, the problem…

Information Theory · Computer Science 2021-11-17 Nir Weinberger

This paper presents an innovative approach to enhancing machine learning based communication systems, specifically focusing on multiple-input multiple-output (MIMO) configurations using autoencoders. We optimize the transmitter, receiver,…

Signal Processing · Electrical Eng. & Systems 2026-05-26 Mohammad Reza Ghavidel Aghdam , Alireza Naghavi

Molecular communication (MC) provides a foundational framework for information transmission in the Internet of Bio-Nano Things (IoBNT), where efficiency and reliability are crucial. However, the inherent limitations of molecular channels,…

Signal Processing · Electrical Eng. & Systems 2025-04-02 Hanlin Cai , Ozgur B. Akan

In computer-aided diagnosis (CAD) focused on microscopy, denoising improves the quality of image analysis. In general, the accuracy of this process may depend both on the experience of the microscopist and on the equipment sensitivity and…

Image and Video Processing · Electrical Eng. & Systems 2021-05-04 Fabio Hernán Gil Zuluaga , Francesco Bardozzo , Jorge Iván Ríos Patiño , Roberto Tagliaferri