English
Related papers

Related papers: A Logarithmic Decomposition for Information

200 papers

Entropic uncertainty relations are interesting in their own rights as well as for a lot of applications. Keeping this in mind, we try to make the corresponding inequalities as tight as possible. The use of parametrized entropies also allows…

Quantum Physics · Physics 2023-05-30 Alexey E. Rastegin

Large-scale behavior of a wide class of spatial and spatiotemporal processes is characterized in terms of informational measures. Specifically, subordinated random fields defined by non-linear transformations on the family of homogeneous…

Statistics Theory · Mathematics 2022-12-26 J. M. Angulo , M. D. Ruiz-Medina

Thermodynamic uncertainty relations reveal a fundamental trade-off between the precision of a trajectory observable and entropy production, where the uncertainty of the observable is quantified by its variance. In information theory,…

Statistical Mechanics · Physics 2025-11-25 Yoshihiko Hasegawa , Tomohiro Nishiyama

We study the following one-way asymmetric transmission problem, also a variant of model-based compressed sensing: a resource-limited encoder has to report a small set $S$ from a universe of $N$ items to a more powerful decoder (server). The…

Data Structures and Algorithms · Computer Science 2018-07-30 Alexandr Andoni , Javad Ghaderi , Daniel Hsu , Dan Rubenstein , Omri Weinstein

In this paper we will analyze discrete probability distributions in which probabilities of particular outcomes of some experiment (microstates) can be represented by the ratio of natural numbers (in other words, probabilities are…

Information Theory · Computer Science 2009-09-29 Marko V. Jankovic

We consider the problem of a generic stabilizer Hamiltonian under local, incoherent Pauli errors. Using two different approaches -- (i) Haah's polynomial formalism arXiv:1204.1063 and (ii) the homological perspective on CSS codes -- we…

Quantum Physics · Physics 2024-03-07 Anasuya Lyons

The body morphology plays an important role in the way information is perceived and processed by an agent. We address an information theory (IT) account on how the precision of sensors, the accuracy of motors, their placement, the body…

Robotics · Computer Science 2024-08-26 Alexandre Pitti , Kohei Nakajima , Yasuo Kuniyoshi

We propose new measures of shared information, unique information and synergistic information that can be used to decompose the multi-information of a pair of random variables $(Y,Z)$ with a third random variable $X$. Our measures are…

Information Theory · Computer Science 2014-06-18 Nils Bertschinger , Johannes Rauh , Eckehard Olbrich , Jürgen Jost , Nihat Ay

We demonstrate that the Renyi-2 entropy provides a natural measure of information for any multimode Gaussian state of quantum harmonic systems, operationally linked to the phase-space Shannon sampling entropy of the Wigner distribution of…

Quantum Physics · Physics 2013-05-27 Gerardo Adesso , Davide Girolami , Alessio Serafini

The so-called Darboux III oscillator is an exactly solvable $N$-dimensional nonlinear oscillator defined on a radially symmetric space with non-constant negative curvature. This oscillator can be interpreted as a smooth (super)integrable…

Mathematical Physics · Physics 2022-12-26 Angel Ballesteros , Ivan Gutierrez-Sagredo

We introduce a new protocol for a lossy data compression algorithm which is based on constraint satisfaction gates. We show that the theoretical capacity of algorithms built from standard parity-check gates converges exponentially fast to…

Disordered Systems and Neural Networks · Physics 2009-11-11 S. Ciliberti , M. Mezard , R. Zecchina

The additional information carried by an enlarged filtration and its measurement was studied by several authors. Already Meyer (Sur un theoreme de J. Jacod, 1978) and Yor (Entropie d'une partition, et grossissement initial d'une filtration,…

Probability · Mathematics 2026-03-26 Anna Aksamit

The rapid scaling of artificial intelligence models has revealed a fundamental tension between model capacity (storage) and inference efficiency (computation). While classical information theory focuses on transmission and storage limits,…

Information Theory · Computer Science 2026-01-01 Jianfeng Xu , Zeyan Li

We show that an information-theoretic property of Shannon's entropy power, known as concavity of entropy power, can be fruitfully employed to prove inequalities in sharp form. In particular, the concavity of entropy power implies the…

Information Theory · Computer Science 2012-07-13 Giuseppe Toscani

The information content of a source is defined in terms of the minimum number of bits needed to store the output of the source in a perfectly recoverable way. A similar definition can be given in the case of quantum sources, with qubits…

Quantum Physics · Physics 2023-04-03 Paolo Perinotti , Alessandro Tosini , Leonardo Vaglini

We propose a new thermodynamic, relativistic relationship between information and entropy, which is closely analogous to the classic Maxwell electro-magnetic equations. Determination of whether information resides in points of…

General Physics · Physics 2007-05-23 Michael C. Parker , Stuart D. Walker

We propose a unified theoretical framework for quantifying spatio-temporal interactions in a stochastic dynamical system based on information geometry. In the proposed framework, the degree of interactions is quantified by the divergence…

Neurons and Cognition · Quantitative Biology 2016-12-08 Masafumi Oizumi , Naotsugu Tsuchiya , Shun-ichi Amari

We present a quantum information theory that allows for the consistent description of quantum entanglement. It parallels classical (Shannon) information theory but is based entirely on density matrices, rather than probability…

Quantum Physics · Physics 2007-05-23 Nicolas J. Cerf , Chris Adami

This thesis consolidates, improves and extends the smooth entropy framework for non-asymptotic information theory and cryptography. We investigate the conditional min- and max-entropy for quantum states, generalizations of classical R\'enyi…

Quantum Physics · Physics 2015-03-20 Marco Tomamichel

Assuming the minimal time to send a bit of information in the Einstein clock synchronization of the two clocks located at different positions, we introduce the extended metric to the information space. This modification of relativity…

General Relativity and Quantum Cosmology · Physics 2018-05-01 Akio Hosoya , Shunsuke Fujii