English
Related papers

Related papers: Strong data processing inequalities and $\Phi$-Sob…

200 papers

We study the mixing time of two popular discrete-time Markov chains in continuous space, the Unadjusted Langevin Algorithm and the Proximal Sampler, which are discretizations of the Langevin dynamics. We extend mixing time analyses for…

Statistics Theory · Mathematics 2025-02-13 Siddharth Mitra , Andre Wibisono

This paper considers a sequential estimation and sensor scheduling problem in the presence of multiple communication channels. As opposed to the classical remote estimation problem that involves one perfect (noiseless) channel and one…

Information Theory · Computer Science 2015-10-02 Xiaobin Gao , Emrah Akyol , Tamer Basar

We consider a network of two nodes separated by a noisy channel with two-sided state information, in which the input and output signals have to be coordinated with the source and its reconstruction. In the case of non-causal encoding and…

Information Theory · Computer Science 2020-09-04 Giulia Cervia , Laura Luzzi , Maël Le Treust , Matthieu R. Bloch

Stochastic transitions between discrete microscopic states play an important role in many physical and biological systems. Often, these transitions lead to fluctuations on a macroscopic scale. A classic example from neuroscience is the…

Statistical Mechanics · Physics 2024-02-20 Lukas Ramlow , Benjamin Lindner

For any given channel $W$ with classical inputs and possibly quantum outputs, a dual classical-input channel $W^\perp$ can be defined by embedding the original into a channel $\mathcal N$ with quantum inputs and outputs. Here we give new…

Quantum Physics · Physics 2017-12-25 Joseph M. Renes

We investigate the capacity of noisy frequency-based channels, motivated by DNA data storage in the short-molecule regime, where information is encoded in the frequency of items types rather than their order. The channel output is a…

Information Theory · Computer Science 2026-01-16 Yuval Gerzon , Ilan Shomorony , Nir Weinberger

Explaining individual differences in cognitive abilities requires both identifying brain parameters that vary across individuals and understanding how brain networks are recruited for specific tasks. Typically, task performance relies on…

Neurons and Cognition · Quantitative Biology 2026-05-05 Sida Chen , Siqi Yang , Zhao Chang , Taro Toyoizumi , Werner Sommer , Lianchun Yu , Qian-Yuan Tang , Changsong Zhou

We show that the uniform distribution minimizes entropy among all one-dimensional symmetric log-concave distributions with fixed variance, as well as various generalizations of this fact to R\'enyi entropies of orders less than 1 and with…

Information Theory · Computer Science 2021-10-20 Mokshay Madiman , Piotr Nayar , Tomasz Tkocz

Noisy quantum channels may be used in many information carrying applications. We show that different applications may result in different channel capacities. Upper bounds on several of these capacities are proved. These bounds are based on…

Quantum Physics · Physics 2009-10-30 Howard Barnum , M. A. Nielsen , Benjamin Schumacher

We consider the problem of optimal zero-delay coding and estimation of a stochastic dynamical system over a noisy communication channel under three estimation criteria concerned with the low-distortion regime. The criteria considered are…

Optimization and Control · Mathematics 2018-06-28 Christoph Kawan , Serdar Yüksel

Recently, Xu et al. [Phys. Rev. A 86, 012113(2012)] explored the behavior of the entropic uncertainty relation under the influence of local unital and nonunital noisy channels for a class of Bell-diagonal states. We here reform their…

Quantum Physics · Physics 2017-10-18 Youneng Guo , Maofa Fang , Ke Zeng

Unbinned likelihood fits aim at maximizing the information one can extract from experimental data, yet their application in realistic statistical analyses is often hindered by the computational cost of profiling systematic uncertainties.…

High Energy Physics - Phenomenology · Physics 2026-02-16 Davide Valsecchi , Mauro Donegà , Rainer Wallny

Recently deep neural networks have been successfully used for various classification tasks, especially for problems with massive perfectly labeled training data. However, it is often costly to have large-scale credible labels in real-world…

Machine Learning · Computer Science 2019-01-15 Mingxiao An , Yongzhou Chen , Qi Liu , Chuanren Liu , Guangyi Lv , Fangzhao Wu , Jianhui Ma

This paper investigates achievable information rates and error exponents of mismatched decoding when the channel belongs to the class of channels that are close to the decoding metric in terms of relative entropy. For both discrete- and…

Information Theory · Computer Science 2025-05-28 Priyanka Patel , Francesc Molina , Albert Guillén i Fàbregas

This work proposes a new loss function targeting classification problems, utilizing a source of information overlooked by cross entropy loss. First, we derive a series of the tightest upper and lower bounds for the probability of a random…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Ali Ghobadzadeh , Amir Lashkari

Entropy and mutual information in neural networks provide rich information on the learning process, but they have proven difficult to compute reliably in high dimensions. Indeed, in noisy and high-dimensional data, traditional estimates in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Danqi Liao , Chen Liu , Benjamin W. Christensen , Alexander Tong , Guillaume Huguet , Guy Wolf , Maximilian Nickel , Ian Adelstein , Smita Krishnaswamy

A group of $n$ users want to run a distributed protocol $\pi$ over a network where communication occurs via private point-to-point channels. Unfortunately, an adversary, who knows $\pi$, is able to maliciously flip bits on the channels. Can…

Cryptography and Security · Computer Science 2017-07-26 Abhinav Aggarwal , Varsha Dani , Thomas P. Hayes , Jared Saia

The random transitions of ion channels between conducting and non-conducting states generate a source of internal fluctuations in a neuron, known as channel noise. The standard method for modeling fluctuations in the states of ion channels…

Neurons and Cognition · Quantitative Biology 2011-04-27 Joshua H. Goldwyn , Nikita S. Imennov , Michael Famulare , Eric Shea-Brown

A generic qubit unitary operator affected by quantum noise is duplicated and inserted in a coherently superposed channel, superposing two paths offered to a probe qubit across the noisy unitary, and driven by a control qubit. A…

Quantum Physics · Physics 2021-10-14 Francois Chapeau-Blondeau

Wireless Fidelity (Wi-Fi) communication technologies hold significant potential for realizing the Industrial Internet of Things (IIoT). In this paper, both Single-Input Single-Output (SISO) and polarized Multiple-Input Multiple-Output…

Systems and Control · Electrical Eng. & Systems 2025-01-08 Li Zhang , Cheng-Xiang Wang , Zihao Zhou , Yuxiao Li , Jie Huang , Lijian Xin , Chun Pan , Dabo Zheng , Xiping Wu