English
Related papers

Related papers: On the Foundations of Universal Sequence Predictio…

200 papers

Learning an appropriate (dis)similarity function from the available data is a central problem in machine learning, since the success of many machine learning algorithms critically depends on the choice of a similarity function to compare…

Machine Learning · Computer Science 2013-08-30 Zheng-Chu Guo , Yiming Ying

$ $We study solutions of difference equations in the rings of sequences and, more generally, solutions of equations with a monoid action in the ring of sequences indexed by the monoid. This framework includes, for example, difference…

Algebraic Geometry · Mathematics 2020-03-19 Gleb Pogudin , Thomas Scanlon , Michael Wibmer

Bayesian neural networks have shown great promise in many applications where calibrated uncertainty estimates are crucial and can often also lead to a higher predictive performance. However, it remains challenging to choose a good prior…

Machine Learning · Statistics 2021-05-17 Vincent Fortuin , Adrià Garriga-Alonso , Mark van der Wilk , Laurence Aitchison

Bayesian inference is applied directly to the problem of unfolding. The outcome is a posterior probability density for the spectrum before smearing, defined in the multi-dimensional space of all possible spectra. Regularization consists in…

Data Analysis, Statistics and Probability · Physics 2012-06-01 Georgios Choudalakis

Sequential probability assignment and universal compression go hand in hand. We propose sequential probability assignment for non-binary (and large alphabet) sequences with empirical distributions whose parameters are known to be bounded…

Information Theory · Computer Science 2021-02-09 Michael Drmota , Gil Shamir , Wojciech Szpankowski

Classical Bayesian persuasion assumes that senders fully understand how receivers form beliefs and make decisions--an assumption that rarely holds when receivers possess private information or exhibit non-Bayesian behavior. In this paper,…

Systems and Control · Electrical Eng. & Systems 2025-11-11 Heeseung Bang , Andreas A. Malikopoulos

We consider generalized solutions of the Perona-Malik equation in dimension one, defined as all possible limits of solutions to the semi-discrete approximation in which derivatives with respect to the space variable are replaced by…

Analysis of PDEs · Mathematics 2023-04-11 Massimo Gobbino , Nicola Picenni

Understanding the uncertainty of a neural network's (NN) predictions is essential for many purposes. The Bayesian framework provides a principled approach to this, however applying it to NNs is challenging due to large numbers of parameters…

Machine Learning · Statistics 2020-02-27 Tim Pearce , Felix Leibfried , Alexandra Brintrup , Mohamed Zaki , Andy Neely

Basing on Picard-Vessiot theory of noncommutative differential equations and algebraic combinatorics on noncommutative formal series with holomorphic coefficients, various recursive constructions of sequences of grouplike series converging…

Mathematical Physics · Physics 2025-12-23 V. C. Bui , V. Hoang Ngoc Minh , V. Nguyen Dinh , Q. H. Ngo

Motivated by parametric models for which the likelihood is analytically unavailable, numerically unstable, or prohibitively expensive to compute or optimize, we develop a prior- and likelihood-free framework for fully probabilistic…

Methodology · Statistics 2026-03-17 Leonardo Cella , Emily C. Hector

Probabilities in eternal inflation are traditionally defined as limiting frequency distributions, but a unique and unambiguous probability measure remains elusive. In this paper, we present a different approach, based on Bayesian reasoning.…

High Energy Physics - Theory · Physics 2023-07-19 Justin Khoury , Sam S. C. Wong

We introduce a graphical framework for Bayesian inference that is sufficiently general to accommodate not just the standard case but also recent proposals for a theory of quantum Bayesian inference wherein one considers density operators…

Quantum Physics · Physics 2012-08-23 Bob Coecke , Robert W. Spekkens

This book is devoted to the problem of sequential probability forecasting, that is, predicting the probabilities of the next outcome of a growing sequence of observations given the past. This problem is considered in a very general setting…

Machine Learning · Computer Science 2025-04-22 Daniil Ryabko

Noninformative priors constructed for estimation purposes are usually not appropriate for model selection and testing. The methodology of integral priors was developed to get prior distributions for Bayesian model selection when comparing…

Methodology · Statistics 2026-03-05 Diego Salmerón , Juan Antonio Cano , Christian P. Robert

We prove the bulk universality of the $\beta$-ensembles with non-convex regular analytic potentials for any $\beta>0$. This removes the convexity assumption appeared in our earlier work. The convexity condition enabled us to use the…

Probability · Mathematics 2015-06-03 Paul Bourgade , Laszlo Erdos , Horng-Tzer Yau

Classical PAC generalization bounds on the prediction risk of a classifier are insufficient to provide theoretical guarantees on fairness when the goal is to learn models balancing predictive risk and fairness constraints. We propose a…

Conditional belief networks introduce stochastic binary variables in neural networks. Contrary to a classical neural network, a belief network can predict more than the expected value of the output $Y$ given the input $X$. It can predict a…

Machine Learning · Computer Science 2016-05-03 Yann N. Dauphin , David Grangier

In the long paper "Family Blowup formula, Admissible Graphs and the Enumeration of Singular Curves (I)" (appearing in JDG), the author solved the enumeration problem of nodal (or general singular) curve counting on algebraic surfaces by…

Algebraic Geometry · Mathematics 2007-05-23 Ai-Ko Liu

Diagonalization in the spirit of Cantor's diagonal arguments is a widely used tool in theoretical computer sciences to obtain structural results about computational problems and complexity classes by indirect proofs. The Uniform…

Computational Complexity · Computer Science 2019-02-22 Friederike Anna Dziemba

Using a diagrammatic reformulation of Bayes' theorem, we provide a necessary and sufficient condition for the existence of Bayesian inference in the setting of finite-dimensional $C^*$-algebras. In other words, we prove an analogue of…

Quantum Physics · Physics 2022-03-22 Arthur J. Parzygnat , Benjamin P. Russo