English
Related papers

Related papers: Predictability and Randomness

200 papers

We introduce a notion of computable randomness for infinite sequences that generalises the classical version in two important ways. First, our definition of computable randomness is associated with imprecise probability models, in the sense…

Probability · Mathematics 2020-09-23 Floris Persiau , Jasper De Bock , Gert de Cooman

Solomonoff sequence prediction is a scheme to predict digits of binary strings without knowing the underlying probability distribution. We call a prediction scheme informed when it knows the true probability distribution of the sequence.…

Artificial Intelligence · Computer Science 2007-05-23 Marcus Hutter

Consider the following prediction problem. Assume that there is a block box that produces bits according to some unknown computable distribution on the binary tree. We know first $n$ bits $x_1 x_2 \ldots x_n$. We want to know the…

Information Theory · Computer Science 2023-08-25 Alexey Milovanov

The predictability of a sequence is defined as the asymptotic performance of the best performing predictor in a given class. The value of the predictability of a sequence will in general depend on the choice of this predictor class. The…

Statistics Theory · Mathematics 2009-04-15 Finn Macleod , Alexei Pokrovskii , Dima Rachinskii

In the theory of algorithmic randomness, several notions of random sequence are defined via a game-theoretic approach, and the notions that received most attention are perhaps Martin-Loef randomness and computable randomness. The latter…

Computational Complexity · Computer Science 2009-07-15 Laurent Bienvenu , Rupert Hoelzl , Thorsten Kraling , Wolfgang Merkle

An infinite binary sequence is deemed to be random if it has all definable properties that hold almost surely for the usual probability measure on the set of infinite binary sequences. There are only countably many such properties, so it…

Probability · Mathematics 2011-03-18 Peter G. Doyle

Solomonoff unified Occam's razor and Epicurus' principle of multiple explanations to one elegant, formal, universal theory of inductive inference, which initiated the field of algorithmic information theory. His central result is that the…

Machine Learning · Computer Science 2008-06-26 Marcus Hutter

Conformal predictors provide set or functional predictions that are valid under the assumption of randomness, i.e., under the assumption of independent and identically distributed data. The question asked in this paper is whether there are…

Machine Learning · Computer Science 2025-06-10 Vladimir Vovk

There are many randomness notions. On the classical account, many of them are about whether a given infinite binary sequence is random for some given probability. If so, this probability turns out to be the same for all these notions, so…

Probability · Mathematics 2021-07-19 Floris Persiau , Jasper De Bock , Gert de Cooman

Solomonoff unified Occam's razor and Epicurus' principle of multiple explanations to one elegant, formal, universal theory of inductive inference, which initiated the field of algorithmic information theory. His central result is that the…

Machine Learning · Computer Science 2011-11-09 Marcus Hutter

We use the martingale-theoretic approach of game-theoretic probability to incorporate imprecision into the study of randomness. In particular, we define several notions of randomness associated with interval, rather than precise,…

Probability · Mathematics 2021-06-24 Gert de Cooman , Jasper De Bock

Randomness (in the sense of being generated in an IID fashion) and exchangeability are standard assumptions in nonparametric statistics and machine learning, and relations between them have been a popular topic of research. This short paper…

Statistics Theory · Mathematics 2026-01-21 Vladimir Vovk

The notion of probability plays an important role in almost all areas of science and technology. In modern mathematics, however, probability theory means nothing other than measure theory, and the operational characterization of the notion…

Probability · Mathematics 2019-09-09 Kohtaro Tadaki

In this paper we propose an optimal predictor of a random variable that has either an infinite mean or an infinite variance. The method consists of transforming the random variable such that the transformed variable has a finite mean and…

Statistics Theory · Mathematics 2023-03-28 Victor de la Pena , Henryk Gzyl , Silvia Mayoral , Haolin Zou , Demissie Alemayehu

In a prequential approach to algorithmic randomness, probabilities for the next outcome can be forecast `on the fly' without the need for fully specifying a probability measure on all possible sequences of outcomes, as is the case in the…

Probability · Mathematics 2023-04-26 Floris Persiau , Gert de Cooman

The outcome of all time series cannot be forecast, e.g. the flipping of a fair coin. Others, like the repeated {01} sequence {010101...} can be forecast exactly. Algorithmic information theory can provide a measure of forecastability that…

Information Theory · Computer Science 2023-12-04 Glauco Amigo , Daniel Andrés Díaz-Pachón , Robert J. Marks , Charles Baylis

Randomness is a crucial resource for a broad range of important applications, such as Monte Carlo simulation and computation, generative artificial intelligence and cryptography. But what is randomness? A widely accepted definition has…

Quantum Physics · Physics 2024-10-01 Mario Stipčević

Various optimality properties of universal sequence predictors based on Bayes-mixtures in general, and Solomonoff's prediction scheme in particular, will be studied. The probability of observing $x_t$ at time $t$, given past observations…

Machine Learning · Computer Science 2007-05-23 Marcus Hutter

We obtain an index of the complexity of a random sequence by allowing the role of the measure in classical probability theory to be played by a function we call the generating mechanism. Typically, this generating mechanism will be a finite…

Machine Learning · Statistics 2008-12-11 Finn Macleod , James Gleeson

Prediction algorithms assign numbers to individuals that are popularly understood as individual "probabilities" -- what is the probability of 5-year survival after cancer diagnosis? -- and which increasingly form the basis for life-altering…

Machine Learning · Computer Science 2020-11-30 Cynthia Dwork , Michael P. Kim , Omer Reingold , Guy N. Rothblum , Gal Yona
‹ Prev 1 2 3 10 Next ›