English
Related papers

Related papers: Randomness is inherently imprecise

200 papers

Uncertainty sampling is a prevalent active learning algorithm that queries sequentially the annotations of data samples which the current prediction model is uncertain about. However, the usage of uncertainty sampling has been largely…

Machine Learning · Computer Science 2026-04-08 Shang Liu , Xiaocheng Li

This paper provides a systematic yet accessible presentation of the Contextuality-by-Default theory. The consideration is confined to finite systems of categorical random variables, which allows us to focus on the basics of the theory…

Probability · Mathematics 2016-05-30 Ehtibar N. Dzhafarov , Janne V. Kujala

Many state-of-the-art algorithms for solving hard combinatorial problems in artificial intelligence (AI) include elements of stochasticity that lead to high variations in runtime, even for a fixed problem instance. Knowledge about the…

Artificial Intelligence · Computer Science 2018-07-10 Katharina Eggensperger , Marius Lindauer , Frank Hutter

Conformal prediction, which makes no distributional assumptions about the data, has emerged as a powerful and reliable approach to uncertainty quantification in practical applications. The nonconformity measure used in conformal prediction…

Machine Learning · Computer Science 2024-10-15 Yuko Kato , David M. J. Tax , Marco Loog

We propose a rigorous decomposition of predictive error, highlighting that not all 'irreducible' error is genuinely immutable. Many domains stand to benefit from iterative enhancements in measurement, construct validity, and modeling. Our…

Machine Learning · Computer Science 2025-02-12 Jiani Yan , Charles Rahal

In the field of statistical learning and data analysis, estimating precision matrices (i.e., the inverse of covariance matrices) is a critical task, particularly for understanding dependency structures among variables. However, traditional…

Methodology · Statistics 2026-05-15 Zhongfeng Qin , Hao Xu , Wenhao Cui , Wan Tian

Distributional robustness is a central goal of prediction algorithms due to the prevalent distribution shifts in real-world data. The prediction model aims to minimize the worst-case risk among a class of distributions, a.k.a., an…

Machine Learning · Statistics 2025-05-20 Marin Šola , Peter Bühlmann , Xinwei Shen

Randomness (in the sense of being generated in an IID fashion) and exchangeability are standard assumptions in nonparametric statistics and machine learning, and relations between them have been a popular topic of research. This short paper…

Statistics Theory · Mathematics 2026-01-21 Vladimir Vovk

The use of algorithmic predictions in decision-making leads to a feedback loop where the models we deploy actively influence the data distributions we see, and later use to retrain on. This dynamic was formalized by Perdomo et al. 2020 in…

Machine Learning · Computer Science 2026-03-02 Gabriele Farina , Juan Carlos Perdomo

With the advent of high-performance computing, Bayesian methods are increasingly popular tools for the quantification of uncertainty throughout science and industry. Since these methods impact the making of sometimes critical decisions in…

Statistics Theory · Mathematics 2016-05-20 Houman Owhadi , Clint Scovel , Tim Sullivan

We introduce a framework for uncertainty estimation that both describes and extends many existing methods. We consider typical hyperparameters involved in classical training as random variables and marginalise them out to capture various…

Machine Learning · Computer Science 2021-07-07 Francesco Farina , Lawrence Phillips , Nicola J Richmond

Regression methods are fundamental for scientific and technological applications. However, fitted models can be highly unreliable outside of their training domain, and hence the quantification of their uncertainty is crucial in many of…

Machine Learning · Statistics 2024-03-05 Filippo Bigi , Sanggyu Chong , Michele Ceriotti , Federico Grasselli

Sparse and irregularly sampled multivariate time series are common in clinical, climate, financial and many other domains. Most recent approaches focus on classification, regression or forecasting tasks on such data. In forecasting, it is…

Machine Learning · Computer Science 2020-04-08 Shivam Srivastava , Prithviraj Sen , Berthold Reinwald

The problem of behaviour prediction for linear parameter-varying systems is considered in the interval framework. It is assumed that the system is subject to uncertain inputs and the vector of scheduling parameters is unmeasurable, but all…

Systems and Control · Computer Science 2019-08-13 Edouard Leurent , Denis Efimov , Tarek Raïssi , Wilfrid Perruquetti

Conformal prediction (CP) has become a cornerstone of distribution-free uncertainty quantification, conventionally evaluated by its coverage and interval length. This work critically examines the sufficiency of these standard metrics. We…

Machine Learning · Statistics 2026-01-30 Yizhou Min , Yizhou Lu , Lanqi Li , Zhen Zhang , Jiaye Teng

In regression problems where there is no known true underlying model, conformal prediction methods enable prediction intervals to be constructed without any assumptions on the distribution of the underlying data, except that the training…

Methodology · Statistics 2023-01-31 Wenyu Chen , Kelli-Jean Chun , Rina Foygel Barber

Matching is a widely used causal inference design that aims to approximate a randomized experiment using observational data by forming matched sets of treated and control units based on similarities in their covariates. Ideally, treated…

Methodology · Statistics 2026-04-06 Jianan Zhu , Jeffrey Zhang , Zijian Guo , Siyu Heng

Motivated by recently emerging problems in machine learning and statistics, we propose data models which relax the familiar i.i.d. assumption. In essence, we seek to understand what it means for data to come from a set of probability…

Statistics Theory · Mathematics 2025-01-08 Christian Fröhlich , Robert C. Williamson

We consider the goal of predicting how complex networks respond to chronic (press) perturbations when characterizations of their network topology and interaction strengths are associated with uncertainty. Our primary result is the…

Populations and Evolution · Quantitative Biology 2016-10-26 David Koslicki , Mark Novak

Stochastic dynamical systems consisting of non-invertible continuous maps on an interval are studied. It is proved that if they satisfy the recently introduced so-called $\mu$-injectivity and some mild assumptions, then proximality,…

Dynamical Systems · Mathematics 2025-12-11 Sander C. Hille , Katarzyna Horbacz , Hanna Oppelmayer , Tomasz Szarek