English
Related papers

Related papers: Plots of the cumulative differences between observ…

200 papers

Inference on vertex-aligned graphs is of wide theoretical and practical importance.There are, however, few flexible and tractable statistical models for correlated graphs, and even fewer comprehensive approaches to parametric inference on…

Statistics Theory · Mathematics 2021-04-01 Donniell E. Fishkind , Avanti Athreya , Lingyao Meng , Vince Lyzinski , Carey E. Priebe

This paper presents a comprehensive empirical analysis of conformal prediction methods on a challenging aerial image dataset featuring diverse events in unconstrained environments. Conformal prediction is a powerful post-hoc technique that…

Machine Learning · Computer Science 2025-04-25 Farhad Pourkamali-Anaraki

As neural networks become more popular, the need for accompanying uncertainty estimates increases. There are currently two main approaches to test the quality of these estimates. Most methods output a density. They can be compared by…

Machine Learning · Statistics 2024-06-05 Laurens Sluijterman , Eric Cator , Tom Heskes

Every student in statistics or data science learns early on that when the sample size largely exceeds the number of variables, fitting a logistic model produces estimates that are approximately unbiased. Every student also learns that there…

Statistics Theory · Mathematics 2022-06-08 Pragya Sur , Emmanuel J. Candes

The vulnerability of models to data aberrations and adversarial attacks influences their ability to demarcate distinct class boundaries efficiently. The network's confidence and uncertainty play a pivotal role in weight adjustments and the…

Machine Learning · Computer Science 2020-12-15 Utkarsh Uppal , Bharat Giddwani

Confidence intervals are an established means of portraying uncertainty about an inferred parameter and can be generated through the use of confidence distributions. For a confidence distribution to be ideal, it must maintain frequentist…

Methodology · Statistics 2022-06-16 Alexander Wimbush , Nicholas Gray , Scott Ferson

We address the problem of uncertainty quantification for graph-structured data, or, more specifically, the problem to quantify the predictive uncertainty in (semi-supervised) node classification. Key questions in this regard concern the…

Machine Learning · Computer Science 2024-06-07 Clemens Damke , Eyke Hüllermeier

We investigate the discrepancy principle for choosing smoothing parameters for kernel density estimation. The method is based on the distance between the empirical and estimated distribution functions. We prove some new positive and…

Statistics Theory · Mathematics 2015-03-19 Thoralf Mildenberger

In statistical modeling we strive to specify models that resemble data collected in studies or observed from processes. Consequently, distributional specification and parameter estimation are central to parametric models. Graphical…

Methodology · Statistics 2015-03-10 Adam Loy , Lendie Follett , Heike Hofmann

Conditional belief networks introduce stochastic binary variables in neural networks. Contrary to a classical neural network, a belief network can predict more than the expected value of the output $Y$ given the input $X$. It can predict a…

Machine Learning · Computer Science 2016-05-03 Yann N. Dauphin , David Grangier

We propose a multi-scale extension of conformal prediction, an approach that constructs prediction sets with finite-sample coverage guarantees under minimal statistical assumptions. Classic conformal prediction relies on a single notion of…

Statistics Theory · Mathematics 2025-02-11 Ali Baheri , Marzieh Amiri Shahbazi

The focus of this paper is on the quantification of sampling variation in frequentist probabilistic forecasts. We propose a method of constructing confidence sets that respects the functional nature of the forecast distribution, and use…

Methodology · Statistics 2017-08-09 David Harris , Gael M. Martin , Indeewara Perera , D. S. Poskitt

The problem of testing the reliability of ensemble forecasting systems is revisited. A popular tool to assess the reliability of ensemble forecasting systems (for scalar verifications) is the rank histogram, this histogram is expected to be…

Atmospheric and Oceanic Physics · Physics 2018-12-26 Jochen Bröcker

Prediction performance does not always reflect the estimation behaviour of a method. High error in estimation may necessarily not result in high prediction error, but can lead to an unreliable prediction if test data lie in a slightly…

Applications · Statistics 2020-09-22 Raju Rimal , Trygve Almøy , Solve Sæbø

This paper addresses the problem of estimating the containment and similarity between two sets using only random samples from each set, without relying on sketches of full sets. The study introduces a binomial model for predicting the…

Computation · Statistics 2025-07-22 Pranav Joshi

In regression analysis, associations between continuous predictors and the outcome are often assumed to be linear. However, modeling the associations as non-linear can improve model fit. Many flexible modeling techniques, like (fractional)…

Long-range ensemble forecasts are typically verified as anomalies with respect to a lead-time dependent climatological mean to remove the influence of systematic biases. However, common methods for calculating anomalies result in…

Atmospheric and Oceanic Physics · Physics 2025-06-11 Christopher D. Roberts , Martin Leutbecher

Given a family of pretrained models and a hold-out set, how can we construct a valid conformal prediction set while selecting a model that minimizes the width of the set? If we use the same hold-out data set both to select a model (the…

Methodology · Statistics 2026-04-20 Ruiting Liang , Wanrong Zhu , Rina Foygel Barber

Conformal prediction is a distribution-free uncertainty quantification method that has gained popularity in the machine learning community due to its finite-sample guarantees and ease of use. Its most common variant, dubbed split conformal…

Machine Learning · Computer Science 2025-10-27 Alvaro H. C. Correia , Christos Louizos

The study of multivariate extremes is dominated by multivariate regular variation, although it is well known that this approach does not provide adequate distinction between random vectors whose components are not always simultaneously…

Statistics Theory · Mathematics 2021-08-17 Natalia Nolde , Jennifer L. Wadsworth