English
Related papers

Related papers: Almost-iid information theory

200 papers

The characterisation of information processing is an important task in complex systems science. Information dynamics is a quantitative methodology for modelling the intrinsic information processing conducted by a process represented as a…

Information Theory · Computer Science 2018-08-01 Richard E. Spinney , Joseph T. Lizier

Information asymmetry is a pervasive feature of multi-agent systems, especially evident in economics and social sciences. In these settings, agents tailor their actions based on private information to maximize their rewards. These strategic…

Machine Learning · Computer Science 2025-06-12 Jiachen Hu , Rui Ai , Han Zhong , Xiaoyu Chen , Liwei Wang , Zhaoran Wang , Zhuoran Yang

Causality is a central topic in scientific inquiry, yet for complex systems, the identification and analysis of synergistic causation remain a challenging and fundamental problem. In the context of causal relations among multivariate…

Machine Learning · Statistics 2026-05-06 Mingzhe Yang , Shuo Wang , Jiang Zhang

We introduce an axiomatic approach for characterizing quantum conditional entropy. Our approach relies on two physically motivated axioms: monotonicity under conditional majorization and additivity. We show that these two axioms provide…

Quantum Physics · Physics 2021-10-29 Sarah Brandsen , Isabelle J. Geng , Mark M. Wilde , Gilad Gour

We design efficient online scheduling policies to maximize the freshness of information delivered to the users in a cellular network under both adversarial and stochastic channel and mobility assumptions. The information freshness achieved…

Information Theory · Computer Science 2022-06-14 Abhishek Sinha , Rajarshi Bhattacharjee

Symmetries are of fundamental interest in many areas of science. In quantum information theory, if a quantum state is invariant under permutations of its subsystems, it is a well-known and widely used result that its marginal can be…

Quantum Physics · Physics 2024-03-19 Paula Belzig

While autonomous agents often surpass humans in their ability to handle vast and complex data, their potential misalignment (i.e., lack of transparency regarding their true objective) has thus far hindered their use in critical applications…

Artificial Intelligence · Computer Science 2024-12-03 Frédéric Berdoz , Roger Wattenhofer

Information theory is gaining popularity as a tool to characterize performance of biological systems. However, information is commonly quantified without reference to whether or how a system could extract and use it; as a result,…

Molecular Networks · Quantitative Biology 2016-11-28 Mikhail Tikhonov , Shawn C. Little , Thomas Gregor

Quantum entanglement of pure states of a bipartite system is defined as the amount of local or marginal ({\em i.e.}referring to the subsystems) entropy. For mixed states this identification vanishes, since the global loss of information…

Quantum Physics · Physics 2007-05-23 Gerardo Adesso , Alessio Serafini , Fabrizio Illuminati

Clarke and Barron analysed the relative entropy between an i.i.d. source and a Bayesian mixture over a continuous class containing that source. In this paper a comparable result is obtained when the source is permitted to be both…

Information Theory · Computer Science 2014-11-13 Tor Lattimore , Marcus Hutter

Although quantum entanglement has already been verified experimentally and applied in quantum computing, quantum sensing and quantum networks, most of the existing measures cannot characterize the entanglement faithfully. In this work, by…

Quantum Physics · Physics 2023-01-10 Zhi-Xiang Jin , Shao-Ming Fei , Xianqing Li-Jost , Cong-Feng Qiao

There has been increasing interest in the integrated information theory (IIT) ofconsciousness, which hypothesizes that consciousness is integrated information withinneuronal dynamics. However, the current formulation of IIT poses both…

Neurons and Cognition · Quantitative Biology 2017-07-04 Satohiro Tajima , Ryota Kanai

Specialization and hierarchical organization are important features of efficient collaboration in economical, artificial, and biological systems. Here, we investigate the hypothesis that both features can be explained by the fact that each…

Multiagent Systems · Computer Science 2018-09-19 Sebastian Gottwald , Daniel A. Braun

Adaptive importance sampling (AIS) uses past samples to update the \textit{sampling policy} $q_t$ at each stage $t$. Each stage $t$ is formed with two steps : (i) to explore the space with $n_t$ points according to $q_t$ and (ii) to exploit…

Statistics Theory · Mathematics 2018-10-04 Bernard Delyon , François Portier

Abstract dynamic programming models are used to analyze $\lambda$-policy iteration with randomization algorithms. Particularly, contractive models with infinite policies are considered and it is shown that well-posedness of the…

Systems and Control · Electrical Eng. & Systems 2020-06-12 Yuchao Li , Karl H. Johansson , Jonas Mårtensson

We explore entanglement as a resource to distinguish locally indistinguishable orthogonal quantum states. Specifically, we consider sets which contain states from an unextendible product basis along with a pure entangled state. We establish…

Quantum Physics · Physics 2025-09-30 Abhay Srivastav , Saronath Halder

We study asymptotic state transformations in continuous variable quantum resource theories. In particular, we prove that monotones displaying lower semicontinuity and strong superadditivity can be used to bound asymptotic transformation…

Quantum Physics · Physics 2023-04-27 Giovanni Ferrari , Ludovico Lami , Thomas Theurer , Martin B. Plenio

Entropy governs molecular self-assembly, phase transitions, and material stability, yet remains challenging to quantify and directly control in molecular systems. Here, we demonstrate that the computable information density (CID), a data…

Statistical Mechanics · Physics 2026-02-27 Ashley Z. Guo , Kaelyn Chang , Nicholas J. Corrente

The first step in quantum information theory is the identification of entanglement as a valuable resource. The next step is learning how to exploit this resource efficiently. We learn how to exploit entanglement efficiently by applying…

Quantum Physics · Physics 2009-11-07 Daniel Rohrlich

Obtaining meaningful quantitative descriptions of the statistical dependence within multivariate systems is a difficult open problem. Recently, the Partial Information Decomposition (PID) was proposed to decompose mutual information (MI)…

Information Theory · Computer Science 2017-02-21 Robin A. A. Ince