English
Related papers

Related papers: Smooth Max-Information as One-Shot Generalization …

200 papers

We investigate fundamental connections between thermodynamics and quantum information theory. First, we show that the operational framework of thermal operations is nonequivalent to the framework of Gibbs-preserving maps, and we comment on…

Quantum Physics · Physics 2016-07-13 Philippe Faist

We propose a unified theoretical framework for quantifying spatio-temporal interactions in a stochastic dynamical system based on information geometry. In the proposed framework, the degree of interactions is quantified by the divergence…

Neurons and Cognition · Quantitative Biology 2016-12-08 Masafumi Oizumi , Naotsugu Tsuchiya , Shun-ichi Amari

We introduce a new information maximization (infomax) approach for the blind source separation problem. The proposed framework provides an information-theoretic perspective for determinant maximization-based structured matrix factorization…

Information Theory · Computer Science 2022-05-03 Alper T. Erdogan

Thermodynamic entropy, as defined by Clausius, characterizes macroscopic observations of a system based on phenomenological quantities such as temperature and heat. In contrast, information-theoretic entropy, introduced by Shannon, is a…

Quantum Physics · Physics 2017-01-04 Mirjam Weilenmann , Lea Krämer , Philippe Faist , Renato Renner

We introduce a way of quantifying how informative a quantum measurement is, starting from a resource-theoretic perspective. This quantifier, which we call the robustness of measurement, describes how much `noise' must be added to a…

Quantum Physics · Physics 2019-04-17 Paul Skrzypczyk , Noah Linden

We study submodular information measures as a rich framework for generic, query-focused, privacy sensitive, and update summarization tasks. While past work generally treats these problems differently ({\em e.g.}, different models are often…

Machine Learning · Computer Science 2020-10-13 Vishal Kaushal , Suraj Kothawade , Ganesh Ramakrishnan , Jeff Bilmes , Himanshu Asnani , Rishabh Iyer

Quantum entanglement plays a crucial role in quantum information, quantum teleportation and quantum computation. The information about the entanglement content between subsystems of the composite system is encoded in the Schmidt…

Statistical Mechanics · Physics 2013-05-07 Santosh Kumar , Akhilesh Pandey

Uncertainty principle is one of the most essential features in quantum mechanics and plays profound roles in quantum information processing. We establish tighter summation form uncertainty relations based on metric-adjusted skew information…

Quantum Physics · Physics 2024-06-26 Cong Xu , Qing-Hua Zhang , Shao-Ming Fei

A framework for a quantum information theory is introduced that is based on the measure of quantum information associated with probability distribution predicted by quantum measuring of state. The entanglement between states of measured…

Quantum Physics · Physics 2007-05-23 Yi-Xin Chen

The presence of mutual information in the research of deep learning has grown significantly. It has been proven that mutual information can be a good objective function to build a robust deep learning model. Most of the researches utilize…

Information Theory · Computer Science 2021-06-29 Marshal Arijona Sinaga

We consider two fundamental tasks in quantum information theory, data compression with quantum side information as well as randomness extraction against quantum side information. We characterize these tasks for general sources using…

Quantum Physics · Physics 2013-10-25 Marco Tomamichel , Masahito Hayashi

The von Neumann entropy plays a vital role in quantum information theory. The von Neumann entropy determines, e.g., the capacities of quantum channels. Also, entropies of composite quantum systems are important for future quantum networks,…

Quantum Physics · Physics 2018-10-31 Christian Majenz

After Shannon, entropy becomes a fundamental quantity to describe not only uncertainity or chaos of a system but also information carried by the system. Shannon's important discovery is to give a mathematical expression of the mutual…

Quantum Physics · Physics 2007-05-23 Masanori Ohya

The Shannon entropy of a collection of random variables is subject to a number of constraints, the best-known examples being monotonicity and strong subadditivity. It remains an open question to decide which of these "laws of information…

Quantum Physics · Physics 2013-08-30 David Gross , Michael Walter

Accessible information, which is a basic quantity in quantum information theory, is computed for a general quantum Gaussian ensemble under certain "threshold condition". It is shown that the maximizing measurement is Gaussian, constituting…

Quantum Physics · Physics 2025-09-01 A. S. Holevo

We perform a quantum information analysis for multi-mode Gaussian approximate position measurements, underlying noisy homodyning in quantum optics. The "Gaussian maximizer" property is established for the entropy reduction of these…

Quantum Physics · Physics 2022-04-04 A. S. Holevo , V. I. Yashin

Uncertainty principle is the basis of quantum mechanics. It reflects the basic law of the movement of microscopic particles. Wigner-Yanase skew information, as a measure of quantum uncertainties, is used to characterize the intrinsic…

Quantum Physics · Physics 2021-05-11 Limei Zhang , Ting Gao , Fengli Yan

The max-relative entropy and the conditional min-entropy it induces have become central to one-shot information theory. Both may be expressed in terms of a conic program over the positive semidefinite cone. Recently, it was shown that the…

Quantum Physics · Physics 2024-10-15 Ian George , Eric Chitambar

Mutual information (MI) is one of the most general ways to measure relationships between random variables, but estimating this quantity for complex systems is challenging. Denoising diffusion models have recently set a new bar for density…

Machine Learning · Computer Science 2025-11-20 Longxuan Yu , Xing Shi , Xianghao Kong , Tong Jia , Greg Ver Steeg

A distributed consensus algorithm for estimating the maximum value of the initial measurements in a sensor network with communication noise is proposed. In the absence of communication noise, max estimation can be done by updating the state…

Systems and Control · Computer Science 2016-02-04 Sai Zhang , Cihan Tepedelenlioglu , Mahesh K. Banavar , Andreas Spanias