English
Related papers

Related papers: An Algorithmic Information Theory Critique of Stat…

200 papers

Many biological phenomena or social events critically depend on how information evolves in complex networks. However, a general theory to characterize information evolution is yet absent. Consequently, numerous unknowns remain about the…

Biological Physics · Physics 2022-07-20 Yang Tian , Guoqi Li , Pei Sun

Data Science and Machine learning have been growing strong for the past decade. We argue that to make the most of this exciting field we should resist the temptation of assuming that forecasting can be reduced to brute-force data analytics.…

Artificial Intelligence · Computer Science 2020-05-12 Hykel Hosni , Angelo Vulpiani

Encoding and decoding are the two key steps in information processing. In this work we study the encoding and decoding capabilities of operational theories in the context of information-storability game, where the task is to freely choose a…

Quantum Physics · Physics 2024-07-19 Teiko Heinosaari , Leevi Leppäjärvi , Martin Plávala

In this paper, we study arbitrary infinite binary information systems each of which consists of an infinite set called universe and an infinite set of two-valued functions (attributes) defined on the universe. We consider the notion of a…

Computational Complexity · Computer Science 2023-11-30 Kerven Durdymyradov , Mikhail Moshkov

We review with a tutorial scope the information theory foundations of quantum statistical physics. Only a small proportion of the variables that characterize a system at the microscopic scale can be controlled, for both practical and…

Statistical Mechanics · Physics 2007-05-23 R. Balian

In recent papers, Zurek has objected to the decision-theoretic approach of Deutsch and Wallace to deriving the Born rule for quantum probabilities on the grounds that it courts circularity. Deutsch and Wallace assume that the many worlds…

Quantum Physics · Physics 2008-11-22 Alan Forrester

These lectures deal with the problem of inductive inference, that is, the problem of reasoning under conditions of incomplete information. Is there a general method for handling uncertainty? Or, at least, are there rules that could in…

Data Analysis, Statistics and Probability · Physics 2016-09-08 Ariel Caticha

The aim of this paper is twofold. First, three theoretical principles are formalized: randomization, overrepresentation and restriction. We develop these principles and give a rationale for their use in choosing the sampling design in a…

Methodology · Statistics 2016-12-16 Yves Tillé , Matthieu Wilhelm

A central paradigm behind process semantics based on observability and testing is that the exact moment of occurring of an internal nondeterministic choice is unobservable. It is natural, therefore, for this property to hold when the…

Logic in Computer Science · Computer Science 2009-07-10 Sonja Georgievska , Suzana Andova

Generalized Probabilistic Theories (GPTs) provide a unified framework for describing probabilistic physical theories, encompassing classical and quantum theories as well as hypothetical theories beyond quantum mechanics. Since most GPTs are…

Quantum Physics · Physics 2026-05-14 Koki Ono , Shun Umekawa , Hiroyasu Tajima

Do completely unpredictable events exist in nature? Classical theory, being fully deterministic, completely excludes fundamental randomness. On the contrary, quantum theory allows for randomness within its axiomatic structure. Yet, the fact…

Matching mechanisms play a central role in operations management across diverse fields including education, healthcare, and online platforms. However, experimentally comparing a new matching algorithm against a status quo presents some…

Methodology · Statistics 2026-01-30 Chonghuan Wang

Instead of static entropy we assert that the Kolmogorov complexity of a static structure such as a solid is the proper measure of disorder (or chaoticity). A static structure in a surrounding perfectly-random universe acts as an interfering…

Computational Complexity · Computer Science 2015-05-13 Joel Ratsaby

We live in a world brimming with uncertainty, where we constantly have to make a lot of decisions under incomplete information. We are firm believers that our subjective belief cannot be computed by rigorous mathematical formula; instead…

Physics and Society · Physics 2023-02-08 Lizhi Xin , Kevin Xin , Houwen Xin

There are many ways we can not know. Even in systems that we created ourselves, as, for example, systems in mathematical logic, Go\"edel and Tarski's theorems impose limits on what we can know. As we try to speak of the real world, things…

History and Philosophy of Physics · Physics 2020-06-04 André C. R. Martins

In combinatorics, the probabilistic method is a very powerful tool to prove the existence of combinatorial objects with interesting and useful properties. Explicit constructions of objects with such properties are often very difficult, or…

Computational Complexity · Computer Science 2007-05-23 Luca Trevisan

On the one hand, the dissipated heat of a thermodynamic work extraction process upper bounds the non-predictive information, which the associated system encodes about its environment. Thus, emergent information processing capabilities can…

Neurons and Cognition · Quantitative Biology 2020-09-10 Kai Ueltzhöffer

We formulate a geometric framework in which physical laws emerge from restricted access to microscopic information. Measurement constraints are modeled as a gauge symmetry acting on density operators, inducing a gauge-reduced space of…

Quantum Physics · Physics 2026-05-19 Tiago Pernambuco , Lucas Chibebe Céleri

The sure thing principle and the law of total probability are basic laws in classic probability theory. A disjunction fallacy leads to the violation of these two classical probability laws. In this paper, a new quantum dynamic belief…

Artificial Intelligence · Computer Science 2017-03-08 Zichang He , Wen Jiang

Perfectly rational decision-makers maximize expected utility, but crucially ignore the resource costs incurred when determining optimal actions. Here we propose an information-theoretic formalization of bounded rational decision-making…

Statistics Theory · Mathematics 2015-06-04 Pedro A. Ortega , Daniel A. Braun