English
Related papers

Related papers: Bounds for Algorithmic Mutual Information and a Un…

200 papers

Using recent machine learning results that present an information-theoretic perspective on underfitting and overfitting, we prove that deciding whether an encodable learning algorithm will always underfit a dataset, even if given unlimited…

Machine Learning · Computer Science 2021-02-11 Sonia Sehra , David Flores , George D. Montanez

Four estimators of the directed information rate between a pair of jointly stationary ergodic finite-alphabet processes are proposed, based on universal probability assignments. The first one is a Shannon--McMillan--Breiman type estimator,…

Information Theory · Computer Science 2016-11-15 Jiantao Jiao , Haim H. Permuter , Lei Zhao , Young-Han Kim , Tsachy Weissman

We observe an infinite sequence of independent identically distributed random variables $X_1,X_2,\ldots$ drawn from an unknown distribution $p$ over $[n]$, and our goal is to estimate the entropy $H(p)=-\mathbb{E}[\log p(X)]$ within an…

Information Theory · Computer Science 2025-04-24 Tomer Berg , Or Ordentlich , Ofer Shayevitz

Online bidding is a classical problem in online decision-making, with applications in resource allocation, hierarchical clustering, and the analysis of approximation algorithms. We study its randomized learning-augmented variant, where an…

Data Structures and Algorithms · Computer Science 2026-05-15 Mathis Degryse , Imrane Saakour , Christoph Dürr , Spyros Angelopoulos

While natural languages differ widely in both canonical word order and word order flexibility, their word orders still follow shared cross-linguistic statistical patterns, often attributed to functional pressures. In the effort to identify…

Computation and Language · Computer Science 2023-07-11 Thomas Hikaru Clark , Clara Meister , Tiago Pimentel , Michael Hahn , Ryan Cotterell , Richard Futrell , Roger Levy

The widely considered assertion is that the unitarity of quantum mechanical evolution assures the preservation of information. It is even promoted in popular literature as an established fact. (Susskind, 2008) Yet, a simple chain of…

Quantum Physics · Physics 2013-11-27 Peter B. Lerner

We extend algorithmic conservation inequalities to probability measures. The amount of self information of a probability measure cannot increase when submitted to randomized processing. This includes (potentially non-computable) measures…

Computational Complexity · Computer Science 2024-09-12 Samuel Epstein

When a variety of anomalous features motivate flagging different samples as outliers, Algorithmic Information Theory (AIT) offers a principled way to unify them in terms of a sample's randomness deficiency. Subject to the algorithmic Markov…

Machine Learning · Computer Science 2025-07-08 Aram Ebtekar , Yuhao Wang , Dominik Janzing

Suppose we observe an invertible linear process with independent mean-zero innovations and with coefficients depending on a finite-dimensional parameter, and we want to estimate the expectation of some function under the stationary…

Statistics Theory · Mathematics 2007-06-13 Anton Schick , Wolfgang Wefelmeyer

In a standard possibilistic logic, prioritized information are encoded by means of weighted knowledge base. This paper proposes an extension of possibilistic logic for dealing with partially ordered information. We Show that all basic…

Artificial Intelligence · Computer Science 2012-12-12 Salem Benferhat , Sylvain Lagrue , Odile Papini

Consider a channel with a given input alphabet size and a given input distribution. Our aim is to degrade or upgrade it to a channel with at most L output letters. The paper contains four main results. The first result, from which the paper…

Information Theory · Computer Science 2017-03-16 Assaf Kartowsky , Ido Tal

While learning in an unknown Markov Decision Process (MDP), an agent should trade off exploration to discover new information about the MDP, and exploitation of the current knowledge to maximize the reward. Although the agent will…

Machine Learning · Computer Science 2020-07-16 Evrard Garcelon , Mohammad Ghavamzadeh , Alessandro Lazaric , Matteo Pirotta

We study the online list update problem under the advice model of computation. Under this model, an online algorithm receives partial information about the unknown parts of the input in the form of some bits of advice generated by a…

Data Structures and Algorithms · Computer Science 2016-06-07 Joan Boyar , Shahin Kamali , Kim S. Larsen , Alejandro López-Ortiz

The interaction between an artificial agent and its environment is bi-directional. The agent extracts relevant information from the environment, and affects the environment by its actions in return to accumulate high expected reward.…

Systems and Control · Computer Science 2018-06-06 Stas Tiomkin , Naftali Tishby

We discuss inequalities holding between the vocabulary size, i.e., the number of distinct nonterminal symbols in a grammar-based compression for a string, and the excess length of the respective universal code, i.e., the code-based analog…

Information Theory · Computer Science 2020-03-11 Lukasz Debowski

We present an information-theoretic framework for understanding overfitting and underfitting in machine learning and prove the formal undecidability of determining whether an arbitrary classification algorithm will overfit a dataset.…

Machine Learning · Computer Science 2020-11-10 Daniel Bashir , George D. Montanez , Sonia Sehra , Pedro Sandoval Segura , Julius Lauw

With artificial intelligence systems becoming ubiquitous in our society, its designers will soon have to start to consider its social dimension, as many of these systems will have to interact among them to work efficiently. With this in…

Artificial Intelligence · Computer Science 2020-06-23 Santiago Cuervo , Marco Alzate

We characterize the algorithmic dimensions (i.e., the lower and upper asymptotic densities of information) of infinite binary sequences in terms of the inability of learning functions having an algorithmic constraint to detect patterns in…

Information Theory · Computer Science 2024-07-03 Jack H. Lutz , Andrei N. Migunov

In this paper, under mild assumptions, we derive a law of large numbers, a central limit theorem with an error estimate, an almost sure invariance principle and a variant of Chernoff bound in finite-state hidden Markov models. These limit…

Information Theory · Computer Science 2012-04-13 Guangyue Han

In the problem of online unweighted interval selection, the objective is to maximize the number of non-conflicting intervals accepted by the algorithm. In the conventional online model of irrevocable decisions, there is an Omega(n) lower…

Data Structures and Algorithms · Computer Science 2025-06-03 Allan Borodin , Christodoulos Karavasilis