English
Related papers

Related papers: New Error Bounds for Solomonoff Prediction

200 papers

Conformal prediction provides a distribution-free framework for uncertainty quantification via prediction sets with exact finite-sample coverage. In low dimensions these sets are easy to interpret, but in high-dimensional or structured…

Machine Learning · Statistics 2026-05-08 Trevor Harris

Conformal prediction offers a distribution-free framework for constructing prediction sets with coverage guarantees. In practice, multiple valid conformal prediction sets may be available, arising from different models or methodologies.…

Machine Learning · Statistics 2025-06-26 Mahmoud Hegazy , Liviu Aolaritei , Michael I. Jordan , Aymeric Dieuleveut

We consider parametric Markov decision processes (pMDPs) that are augmented with unknown probability distributions over parameter values. The problem is to compute the probability to satisfy a temporal logic specification with any concrete…

Logic in Computer Science · Computer Science 2022-12-08 Thom Badings , Murat Cubuktepe , Nils Jansen , Sebastian Junges , Joost-Pieter Katoen , Ufuk Topcu

Conformal prediction is widely used to equip black-box machine learning models with uncertainty quantification, offering formal coverage guarantees under exchangeable data. However, these guarantees fail when faced with subpopulation…

Machine Learning · Computer Science 2025-11-10 Nien-Shao Wang , Duygu Nur Yaldiz , Yavuz Faruk Bakman , Sai Praneeth Karimireddy

We give a simple combinatorial algorithm to deterministically approximately count the number of satisfying assignments of general constraint satisfaction problems (CSPs). Suppose that the CSP has domain size $q=O(1)$, each constraint…

Data Structures and Algorithms · Computer Science 2023-03-10 Kun He , Chunyang Wang , Yitong Yin

Split conformal prediction has recently sparked great interest due to its ability to provide formally guaranteed uncertainty sets or intervals for predictions made by black-box neural models, ensuring a predefined probability of containing…

Machine Learning · Computer Science 2024-01-29 António Farinhas , Chrysoula Zerva , Dennis Ulmer , André F. T. Martins

Variational inference methods for latent variable statistical models have gained popularity because they are relatively fast, can handle large data sets, and have deterministic convergence guarantees. However, in practice it is unclear…

Methodology · Statistics 2017-03-22 Hachem Saddiki , Andrew C. Trapp , Patrick Flaherty

The major challenge in designing a discriminative learning algorithm for predicting structured data is to address the computational issues arising from the exponential size of the output space. Existing algorithms make different assumptions…

Machine Learning · Computer Science 2010-06-29 Shankar Vembu

Conformal inference has played a pivotal role in providing uncertainty quantification for black-box ML prediction algorithms with finite sample guarantees. Traditionally, conformal prediction inference requires a data-independent…

Methodology · Statistics 2023-07-04 Siddhaarth Sarkar , Arun Kumar Kuchibhotla

We analyze the forward error in the floating point summation of real numbers, for computations in low precision or extreme-scale problem dimensions that push the limits of the precision. We present a systematic recurrence for a martingale…

Numerical Analysis · Mathematics 2022-03-31 Eric Hallman , Ilse C. F. Ipsen

Conformal prediction is a learning framework controlling prediction coverage of prediction sets, which can be built on any learning algorithm for point prediction. This work proposes a learning framework named conformal loss-controlling…

Machine Learning · Computer Science 2024-01-24 Di Wang , Ping Wang , Zhong Ji , Xiaojun Yang , Hongyue Li

Conformal prediction provides a pivotal and flexible technique for uncertainty quantification by constructing prediction sets with a predefined coverage rate. Many online conformal prediction methods have been developed to address data…

Machine Learning · Statistics 2026-02-25 Dongjian Hu , Junxi Wu , Shu-Tao Xia , Changliang Zou

In this work, we study a new approach to optimizing the margin distribution realized by binary classifiers. The classical approach to this problem is simply maximization of the expected margin, while more recent proposals consider…

Machine Learning · Statistics 2018-10-12 Matthew J. Holland

The problem of sequential change diagnosis is considered, where observations are obtained on-line, an abrupt change occurs in their distribution, and the goal is to quickly detect the change and accurately identify the post-change…

Statistics Theory · Mathematics 2022-11-24 Austin Warner , Georgios Fellouris

We study decision dependent distributionally robust optimization models, where the ambiguity sets of probability distributions can depend on the decision variables. These models arise in situations with endogenous uncertainty. The developed…

Optimization and Control · Mathematics 2018-06-26 Fengqiao Luo , Sanjay Mehrotra

Opportunistic detection rules (ODRs) are variants of fixed-sample-size detection rules in which the statistician is allowed to make an early decision on the alternative hypothesis opportunistically based on the sequentially observed…

Information Theory · Computer Science 2016-02-15 Wenyi Zhang , George V. Moustakides , H. Vincent Poor

Conformal predictive systems allow forecasters to issue predictive distributions for real-valued future outcomes that have out-of-sample calibration guarantees. On a more abstract level, conformal prediction makes use of in-sample…

Methodology · Statistics 2025-03-07 Sam Allen , Georgios Gavrilopoulos , Alexander Henzi , Gian-Reto Kleger , Johanna Ziegel

Predictions are often probabilities; e.g., a prediction could be for precipitation tomorrow, but with only a 30% chance. Given such probabilistic predictions together with the actual outcomes, "reliability diagrams" help detect and diagnose…

Statistics Theory · Mathematics 2022-11-15 Imanol Arrieta-Ibarra , Paman Gujral , Jonathan Tannen , Mark Tygert , Cherie Xu

Probabilistic Logic Programming is an effective formalism for encoding problems characterized by uncertainty. Some of these problems may require the optimization of probability values subject to constraints among probability distributions…

Logic in Computer Science · Computer Science 2023-06-22 Damiano Azzolini , Fabrizio Riguzzi

We analyze the problem of sequential probability assignment for binary outcomes with side information and logarithmic loss, where regret---or, redundancy---is measured with respect to a (possibly infinite) class of experts. We provide upper…

Information Theory · Computer Science 2015-01-30 Alexander Rakhlin , Karthik Sridharan