English
Related papers

Related papers: On the Foundations of Universal Sequence Predictio…

200 papers

Algorithmic theories of randomness can be related to theories of probabilistic sequence prediction through the notion of a predictor, defined as a function which supplies lower bounds on initial-segment probabilities of infinite sequences.…

Information Theory · Computer Science 2024-01-25 Lenhart K. Schubert

We introduce the $\Sigma_1$-definable universal finite sequence and prove that it exhibits the universal extension property amongst the countable models of set theory under end-extension. That is, (i) the sequence is $\Sigma_1$-definable…

Logic · Mathematics 2020-11-11 Joel David Hamkins , Kameryn J. Williams

We propose a new method for conducting Bayesian prediction that delivers accurate predictions without correctly specifying the unknown true data generating process. A prior is defined over a class of plausible predictive models. After…

Methodology · Statistics 2020-08-24 Ruben Loaiza-Maya , Gael M. Martin , David T. Frazier

Bayesian inference requires specification of a single, precise prior distribution, whereas frequentist inference only accommodates a vacuous prior. Since virtually every real-world application falls somewhere in between these two extremes,…

Methodology · Statistics 2023-09-26 Ryan Martin

We study the stability of posterior predictive inferences to the specification of the likelihood model and perturbations of the data generating process. In modern big data analyses, useful broad structural judgements may be elicited from…

Methodology · Statistics 2024-04-30 Jack Jewson , Jim Q. Smith , Chris Holmes

We extend the monumental result of Christodoulou-Klainerman on the global nonlinear stability of the Minkowski spacetime to the global nonlinear stability of a class of large dispersive spacetimes. More precisely, we show that any regular…

General Relativity and Quantum Cosmology · Physics 2022-06-29 Jonathan Luk , Sung-Jin Oh

We introduce new definitions of universal and superuniversal computable codes, which are based on a code's ability to approximate Kolmogorov complexity within the prescribed margin for all individual sequences from a given set. Such sets of…

Machine Learning · Statistics 2009-04-10 Łukasz Dębowski

The problem of sequential probability forecasting is considered in the most general setting: a model set C is given, and it is required to predict as well as possible if any of the measures (environments) in C is chosen to generate the…

Machine Learning · Computer Science 2019-10-25 Daniil Ryabko

We study connections between linear equations over various semigroups and recursively enumerable sets of positive integers. We give variants of the universal Diophantine representation of recursively enumerable sets of positive integers…

Formal Languages and Automata Theory · Computer Science 2024-06-04 Juha Honkala

We theoretically justify the recent empirical finding of [Teh et al., 2025] that a transformer pretrained on synthetically generated data achieves strong performance on empirical Bayes (EB) problems. We take an indirect approach to this…

Machine Learning · Statistics 2026-02-18 Nick Cannella , Anzo Teh , Yanjun Han , Yury Polyanskiy

We present a universal framework for constructing confidence sets based on sequential likelihood mixing. Building upon classical results from sequential analysis, we provide a unifying perspective on several recent lines of work, and…

Machine Learning · Statistics 2025-02-21 Johannes Kirschner , Andreas Krause , Michele Meziu , Mojmir Mutny

A Bayesian approach to the classification problem is proposed in which random partitions play a central role. It is argued that the partitioning approach has the capacity to take advantage of a variety of large-scale spatial structures, if…

Statistics Theory · Mathematics 2007-06-13 Marc A. Coram

When people learn mathematical patterns or sequences, they are able to identify the concepts (or rules) underlying those patterns. Having learned the underlying concepts, humans are also able to generalize those concepts to other numbers,…

Machine Learning · Computer Science 2020-01-14 Mohith Damarapati , Inavamsi B. Enaganti , Alfred Ajay Aureate Rajakumar

We propose an interdisciplinary framework that combines Bayesian predictive inference, a well-established tool in Machine Learning, with Formal Methods rooted in the computer science community. Bayesian predictive inference allows for…

Computation · Statistics 2025-08-21 Laura Vana , Ennio Visconti , Laura Nenzi , Annalisa Cadonna , Gregor Kastner

Identifying small subsets of features that are relevant for prediction and/or classification tasks is a central problem in machine learning and statistics. The feature selection task is especially important, and computationally difficult,…

Statistical Mechanics · Physics 2014-11-04 Charles K. Fisher , Pankaj Mehta

We give a new simple proof of boundedness of the family of semistable sheaves with fixed numerical invariants on a fixed smooth projective variety. In characteristic zero our method gives a quick proof of Bogomolov's inequality for…

Algebraic Geometry · Mathematics 2023-01-31 Adrian Langer

There are three principle paradigms of statistical inference: (i) Bayesian, (ii) information-based and (iii) frequentist inference. We describe an objective prior (the weighting or $w$-prior) which unifies objective Bayes and…

Machine Learning · Statistics 2015-06-26 Colin H. LaMont , Paul A. Wiggins

Conformal prediction is a powerful distribution-free framework for constructing prediction sets with coverage guarantees. Classical methods, such as split conformal prediction, provide marginal coverage, ensuring that the prediction set…

Machine Learning · Computer Science 2025-08-01 Konstantina Bairaktari , Jiayun Wu , Zhiwei Steven Wu

We propose a general framework for constructing powerful, sequential hypothesis tests for a large class of nonparametric testing problems. The null hypothesis for these problems is defined in an abstract form using the action of two known…

Machine Learning · Statistics 2023-10-31 Teodora Pandeva , Patrick Forré , Aaditya Ramdas , Shubhanshu Shekhar

In this paper we discuss the notion of universality for classes of candidate common Lyapunov functions of linear switched systems. On the one hand, we prove that a family of absolutely homogeneous functions is universal as soon as it…

Optimization and Control · Mathematics 2024-06-19 Paolo Mason , Yacine Chitour , Mario Sigalotti