English
Related papers

Related papers: Information Flow Decomposition in Feedback Systems…

200 papers

The flow of quantum information in local dephasing channels is analyzed over short and long times in case the structured reservoirs of frequency modes exhibit a spectral gap in the density of modes over low frequencies. The presence of the…

Quantum Physics · Physics 2017-06-06 Filippo Giraldi

We establish lower and upper bounds for the identification capacity of discrete-time Gaussian channels subject to inter-symbol interference (ISI), a canonical model in wireless communication. Our analysis accounts for deterministic encoders…

Information Theory · Computer Science 2026-05-04 Mohammad Javad Salariseddigh , Christian Deppe

Image denoising is of vital importance in many imaging or computer vision related areas. With the convolutional neural networks showing strong capability in computer vision tasks, the performance of image denoising has also been brought up…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Zhuang Jia

A continuous-time white Gaussian channel can be formulated using a white Gaussian noise, and a conventional way for examining such a channel is the sampling approach based on the classical Shannon-Nyquist sampling theorem, where the…

Probability · Mathematics 2018-10-19 Xianming Liu , Guangyue Han

We consider linear time-varying channels with additive white Gaussian noise. For a large class of such channels we derive rigorous estimates of the eigenvalues of the correlation matrix of the effective channel in terms of the sampled…

Information Theory · Computer Science 2016-11-17 Brendan Farrell , Thomas Strohmer

We prove an exact relationship between the optimal denoising function and the data distribution in the case of additive Gaussian noise, showing that denoising implicitly models the structure of data allowing it to be exploited in the…

Neural and Evolutionary Computing · Computer Science 2017-09-11 Heikki Arponen , Matti Herranen , Harri Valpola

In this paper, we consider single- and multi-user Gaussian channels with feedback under expected power constraints and with non-vanishing error probabilities. In the first of two contributions, we study asymptotic expansions for the…

Information Theory · Computer Science 2016-09-22 Lan V. Truong , Silas L. Fong , Vincent Y. F. Tan

To provide an efficient approach to characterize the input-output mutual information (MI) under additive white Gaussian noise (AWGN) channel, this short report fits the curves of exact MI under multilevel quadrature amplitude modulation…

Information Theory · Computer Science 2019-08-27 Chongjun Ouyang , Sheng Wu , Hongwen Yang

Biological, artificial, and physical systems dissipate energy to accurately transmit information. While tools of information theory have been used to characterize information-processing capabilities, how reliably this information is…

Statistical Mechanics · Physics 2026-05-29 Giorgio Nicoletti , Daniel M. Busiello

A polar decomposition of mutual information between a complex-valued channel's input and output is proposed for a input whose amplitude and phase are independent of each other. The mutual information is symmetrically decomposed into three…

Information Theory · Computer Science 2013-04-02 Qiuliang Xie , Zhaocheng Wang , Zhixing Yang

A learning-based safety filter is developed for discrete-time linear time-invariant systems with unknown models subject to Gaussian noises with unknown covariance. Safety is characterized using polytopic constraints on the states and…

Machine Learning · Computer Science 2023-05-09 Farhad Farokhi , Alex S. Leong , Mohammad Zamani , Iman Shames

Information transmission over discrete-time channels with memoryless additive noise obeying a Cauchy, rather than Gaussian, distribution, are studied. The channel input satisfies an average power constraint. Upper and lower bounds to such…

Information Theory · Computer Science 2024-11-19 Shuqin Pang , Wenyi Zhang

Information flow is the branch of security that studies the leakage of information due to correlation between secrets and observables. Since in general such correlation cannot be avoided completely, it is important to quantify the leakage.…

Logic in Computer Science · Computer Science 2023-06-22 Yusuke Kawamoto , Konstantinos Chatzikokolakis , Catuscia Palamidessi

Recent advances in deep learning for wireless communications have renewed interest in channel output feedback codes. In the additive white Gaussian broadcast channel with feedback (AWGN-BC-F), feedback can expand the channel capacity region…

Signal Processing · Electrical Eng. & Systems 2025-12-02 Jacqueline Malayter , Yingyao Zhou , Natasha Devroye , Chih-Chun Wang , Christopher Brinton , David J. Love

One of the fundamental steps toward understanding a complex system is identifying variation at the scale of the system's components that is most relevant to behavior on a macroscopic scale. Mutual information provides a natural means of…

Machine Learning · Computer Science 2024-03-20 Kieran A. Murphy , Dani S. Bassett

Diffusion models generate high-quality images but pose serious risks like copyright violation and disinformation. Watermarking is a key defense for tracing and authenticating AI-generated content. However, existing methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Yi Zhang , Hongbo Huang , Liang-Jie Zhang

Density deconvolution is the task of estimating a probability density function given only noise-corrupted samples. We can fit a Gaussian mixture model to the underlying density by maximum likelihood if the noise is normally distributed, but…

Machine Learning · Statistics 2020-07-14 Tim Dockhorn , James A. Ritchie , Yaoliang Yu , Iain Murray

We study the identification capacity of discrete-time Gaussian channels impaired by correlated noise and inter-symbol interference (ISI). Our analysis is formulated for deterministic encoding functions subject to a peak power constraint and…

Information Theory · Computer Science 2026-04-07 Mohammad Javad Salariseddigh

This paper studies reliability-guaranteed decoding for variable-length stop-feedback (VLSF) codes over correlated noncoherent fading channels. The decoding rule is based on the evolution of the information density associated with a given…

Information Theory · Computer Science 2026-04-20 Guodong Sun , Samir M. Perlaza , Philippe Mary , Jean-Marie Gorce

We consider a signaling format where the information to be communicated from one or multiple transmitters to a receiver is modulated via a superposition of independent data streams. Each data stream is formed by error-correction encoding,…

Information Theory · Computer Science 2018-06-18 Dmitri Truhachev , Christian Schlegel