English
Related papers

Related papers: A Projection Method for Derivation of Non-Shannon-…

200 papers

We show that two essentially conditional linear inequalities for Shannon's entropies (including the Zhang-Yeung'97 conditional inequality) do not hold for asymptotically entropic points. This means that these inequalities are non-robust in…

Information Theory · Computer Science 2012-07-24 Tarik Kaced , Andrei Romashchenko

Ranks of subspaces of vector spaces satisfy all linear inequalities satisfied by entropies (including the standard Shannon inequalities) and an additional inequality due to Ingleton. It is known that the Shannon and Ingleton inequalities…

Information Theory · Computer Science 2010-07-21 Randall Dougherty , Chris Freiling , Kenneth Zeger

Shannon entropy, a cornerstone of information theory, statistical physics and inference methods, is uniquely identified by the Shannon-Khinchin or Shore-Johnson axioms. Generalizations of Shannon entropy, motivated by the study of…

Data Analysis, Statistics and Probability · Physics 2026-04-20 Andrea Somazzi , Diego Garlaschelli

A causal structure is a relationship between observed variables that in general restricts the possible correlations between them. This relationship can be mediated by unobserved systems, modelled by random variables in the classical case or…

Quantum Physics · Physics 2018-03-15 Mirjam Weilenmann , Roger Colbeck

We study sum uncertainty relations for arbitrary finite $N$ quantum mechanical observables. Some uncertainty inequalities are presented by using skew information introduced by Wigner and Yanase. These uncertainty inequalities are nontrivial…

Quantum Physics · Physics 2016-06-07 Bin Chen , Shao-Ming Fei , Gui-Lu Long

This paper begins with a discussion of integration over probability types (p-types). After doing that, the paper re-visits 3 mainstay problems of classical (non-quantum) Shannon Information Theory (SIT): source coding without distortion,…

Information Theory · Computer Science 2012-08-15 Robert R. Tucci

A family of skew information quantities is obtained, in which the well-known Wigner-Yanase skew information and quantum Fisher information stand as special cases. A transparent proof of convexity of the generalized skew information is…

Quantum Physics · Physics 2023-06-14 Ma-Cheng Yang , Cong-Feng Qiao

In this paper, we first provide three general norm inequalities, which are used to give new uncertainty relations of any finite observables and quantum channels via metric-adjusted skew information. The results are applicable to its special…

Quantum Physics · Physics 2023-04-27 Hui Li , Ting Gao , Fengli Yan

This article introduces a new instrumental variable approach for estimating unknown population parameters with data having nonrandom missing values. With coarse and discrete instruments, Shao and Wang (2016) proposed a semiparametric method…

Methodology · Statistics 2021-11-19 Arkaprabha Ganguli , David Todem

The effectiveness of projection methods for solving systems of linear inequalities is investigated. It is shown that they have a computational advantage over some alternatives and that this makes them successful in real-world applications.…

Optimization and Control · Mathematics 2009-12-23 Y. Censor , W. Chen , P. L. Combettes , R. Davidi , G. T. Herman

The paper deals with conditional linear information inequalities valid for entropy functions induced by discrete random variables. Specifically, the so-called conditional Ingleton inequalities are in the center of interest: these are valid…

Information Theory · Computer Science 2022-03-16 Milan Studeny

In the era of big data, the increasing availability of diverse data sources has driven interest in analytical approaches that integrate information across sources to enhance statistical accuracy, efficiency, and scientific insights. Many…

Methodology · Statistics 2026-03-30 Lu Wang , Yanyuan Ma , Jiwei Zhao

In this article, we discuss the problem of establishing relations between information measures assessed for network structures. Two types of entropy based measures namely, the Shannon entropy and its generalization, the R\'{e}nyi entropy…

Information Theory · Computer Science 2013-01-24 Lavanya Sivakumar , Matthias Dehmer

In this note, we present an information diffusion inequality derived from an elementary argument, which gives rise to a very general Fano-type inequality. The latter unifies and generalizes the distance-based Fano inequality and the…

Information Theory · Computer Science 2015-04-22 Gábor Braun , Sebastian Pokutta

It is well known that there is a strong connection between entropy inequalities and submodularity, since the entropy of a collection of random variables is a submodular function. Unifying frameworks for information inequalities arising from…

Information Theory · Computer Science 2026-01-23 Gunank Jakhar , Gowtham R. Kurri , Suryajith Chillara , Vinod M. Prabhakaran

Fano's inequality is one of the most elementary, ubiquitous, and important tools in information theory. Using majorization theory, Fano's inequality is generalized to a broad class of information measures, which contains those of Shannon…

Information Theory · Computer Science 2020-08-04 Yuta Sakai

In classical information theory, both the form and performance of the optimal detector for additive noise channels can be precisely derived, based on the assumption that the channel noise follows a specific probability distribution or a…

Information Theory · Computer Science 2026-03-20 Wen-Xuan Lang , Guiying Yan , Zhi-Ming Ma

We derive a connection between performance of estimators the performance of the ideal observer on related detection tasks. Specifically we show how Shannon Information for the task of detecting a change in a parameter is related to the…

Information Theory · Computer Science 2019-07-24 Eric Clarkson

This paper is inspired by Wang, Wang and Zhang's work [ Observability and unique continuation inequalities for the Schr\"odinger equation. J. Eur. Math. Soc. 21, 3513--3572 (2019)], where they present several observability and unique…

Analysis of PDEs · Mathematics 2023-11-01 Hui Xu , Longben Wei , Zhiwen Duan

We discuss some inequalities for N nonnegative numbers. We use these inequalities to obtain known inequalities for probability distributions and new entropic and information inequalities for quantum tomograms of qudit states. The…

Quantum Physics · Physics 2013-07-04 Margarita A. Man'ko , Vladimir I. Man'ko