English
Related papers

Related papers: Similarity-Sensitive Entropy under Representation …

200 papers

Predictive inference requires balancing statistical accuracy against informational complexity, yet the choice of complexity measure is usually imposed rather than derived. We treat econometric objects as predictive rules, mappings from…

Statistics Theory · Mathematics 2026-02-16 Nicholas G. Polson , Daniel Zantedeschi

Uncertainty principle, a fundamental principle in quantum physics, has been studied intensively via various uncertainty inequalities. Here we derive an uncertainty equality in terms of linear entropy, and show that the sum of uncertainty in…

Quantum Physics · Physics 2014-09-02 Zhihao Ma , Shengjun Wu , Zhihua Chen

Our knowledge of quantum mechanics can satisfactorily describe simple, microscopic systems, but is yet to explain the macroscopic everyday phenomena we observe. Here we aim to shed some light on the quantum-to-classical transition as seen…

Quantum Physics · Physics 2020-08-14 Isadora Veeren , Fernando de Melo

We define an entropy based on a chosen governing probability distribution. If a certain kind of measurements follow such a distribution it also gives us a suitable scale to study it with. This scale will appear as a link function that is…

Data Analysis, Statistics and Probability · Physics 2007-10-24 Peter Sunehag

Thermodynamic uncertainty relations reveal a fundamental trade-off between the precision of a trajectory observable and entropy production, where the uncertainty of the observable is quantified by its variance. In information theory,…

Statistical Mechanics · Physics 2025-11-25 Yoshihiko Hasegawa , Tomohiro Nishiyama

An algebraic approach to the study of entanglement entropy of quantum systems is reviewed. Starting with a state on a $C^*$-algebra, one can construct a density operator describing the state in the GNS representation state. Applications of…

Quantum Physics · Physics 2022-12-12 A. F. Reyes-Lega

A measure of how sensitive the entanglement entropy is in a quantum system, has been proposed and its information geometric origin is discussed. It has been demonstrated for two exactly solvable spin systems, that thermodynamic criticality…

Statistical Mechanics · Physics 2025-10-02 Pritam Sarkar

The representations of conditional entropy and conditional mutual information are significant in explaining the unique effects among variables. While previous studies based on conditional contrastive sampling have effectively removed…

Machine Learning · Computer Science 2025-01-07 Keng Hou Leong , Yuxuan Xiu , Wai Kin , Chan

Uncertainty sampling is a prevalent active learning algorithm that queries sequentially the annotations of data samples which the current prediction model is uncertain about. However, the usage of uncertainty sampling has been largely…

Machine Learning · Computer Science 2026-04-08 Shang Liu , Xiaocheng Li

A prominent formulation of the uncertainty principle identifies the fundamental quantum feature that no particle may be prepared with certain outcomes for both position and momentum measurements. Often the statistical uncertainties are…

Quantum Physics · Physics 2015-01-08 Fabian Furrer , Mario Berta , Marco Tomamichel , Volkher B. Scholz , Matthias Christandl

We prove an entropic uncertainty relation for two quantum channels, extending the work of Frank and Lieb for quantum measurements. This is obtained via a generalized strong super-additivity (SSA) of quantum entropy. Motivated by Petz's…

Quantum Physics · Physics 2023-01-23 Li Gao , Marius Junge , Nicholas LaRacuente

We define and investigate a notion of entropy for quantum error correcting codes. The entropy of a code for a given quantum channel has a number of equivalent realisations, such as through the coefficients associated with the Knill-Laflamme…

Quantum Physics · Physics 2009-02-24 David W. Kribs , Aron Pasieka , Karol Zyczkowski

Uncertainty principle is one of the cornerstones of quantum theory. In the literature, there are two types of uncertainty relations, the operator form concerning the variances of physical observables and the entropy form related to entropic…

Quantum Physics · Physics 2015-09-18 Jun-Li Li , Cong-Feng Qiao

We explore the relation between entanglement entropy of quantum many body systems and the distribution of corresponding, properly selected, observables. Such a relation is necessary to actually measure the entanglement entropy. We show that…

Statistical Mechanics · Physics 2009-11-11 Israel Klich , Gil Refael , Alessandro Silva

In [Berta 2014 Entanglement], uncertainty relations in the presence of quantum memory was formulated for mutually unbiased bases using conditional collision entropy. In this paper, we generalize their results to the mutually unbiased…

Quantum Physics · Physics 2018-10-03 Kun Wang , Nan Wu , Fangmin Song

We derive entropic uncertainty relations for successive generalized measurements by using general descriptions of quantum measurement within two {distinctive operational} scenarios. In the first scenario, by merging {two successive…

Quantum Physics · Physics 2018-01-04 Kyunghyun Baek , Wonmin Son

Coherent states (CS) quantum entropy can be split into two components. The dynamical entropy is linked with the dynamical properties of a quantum system. The measurement entropy, which tends to zero in the semiclassical limit, describes the…

chao-dyn · Physics 2009-10-28 Jaroslaw Kwapien , Wojciech Slomczynski , Karol Zyczkowski

The quantification of aleatoric and epistemic uncertainty in terms of conditional entropy and mutual information, respectively, has recently become quite common in machine learning. While the properties of these measures, which are rooted…

Machine Learning · Computer Science 2023-06-27 Lisa Wimmer , Yusuf Sale , Paul Hofman , Bern Bischl , Eyke Hüllermeier

We show that the natural scaling of measurement for a particular problem defines the most likely probability distribution of observations taken from that measurement scale. Our approach extends the method of maximum entropy to use…

Quantitative Methods · Quantitative Biology 2010-03-02 Steven A. Frank , D. Eric Smith

The uncertainty principle can be expressed in entropic terms, also taking into account the role of entanglement in reducing uncertainty. The information exclusion principle bounds instead the correlations that can exist between the outcomes…

Quantum Physics · Physics 2014-02-26 Patrick J. Coles , Marco Piani