English
Related papers

Related papers: Rank conditional coverage and confidence intervals…

200 papers

Classification is an important statistical learning tool. In real application, besides high prediction accuracy, it is often desirable to estimate class conditional probabilities for new observations. For traditional problems where the…

Statistics Theory · Mathematics 2025-03-18 Guo Xian Yau , Chong Zhang

Extant "fast" algorithms for Monte Carlo confidence sets are limited to univariate shift parameters for the one-sample and two-sample problems using the sample mean as the test statistic; moreover, some do not converge reliably and most do…

Computation · Statistics 2025-02-27 Amanda K. Glazer , Philip B. Stark

Scaling test-time computation with reinforcement learning (RL) has emerged as a reliable path to improve large language models (LLM) reasoning ability. Yet, outcome-based reward often incentivizes models to be overconfident, leading to…

Machine Learning · Computer Science 2026-04-28 Liaoyaqi Wang , Chunsheng Zuo , William Jurayj , Benjamin Van Durme , Anqi Liu

This short study presents an opportunistic approach to a (more) reliable validation method for prediction uncertainty average calibration. Considering that variance-based calibration metrics (ZMS, NLL, RCE...) are quite sensitive to the…

Machine Learning · Statistics 2024-08-27 Pascal Pernot

The ranking problem is to order a collection of units by some unobserved parameter, based on observations from the associated distribution. This problem arises naturally in a number of contexts, such as business, where we may want to rank…

Statistics Theory · Mathematics 2019-09-04 Toby Kenney

We consider the nonparametric multivariate isotonic regression problem, where the regression function is assumed to be nondecreasing with respect to each predictor. Our goal is to construct a Bayesian credible interval for the function…

Statistics Theory · Mathematics 2022-11-24 Kang Wang , Subhashis Ghosal

Several uncertainty estimation methods have been recently proposed for machine translation evaluation. While these methods can provide a useful indication of when not to trust model predictions, we show in this paper that the majority of…

Computation and Language · Computer Science 2023-06-13 Chrysoula Zerva , André F. T. Martins

In this paper, we formulate the interference alignment (IA) problem for a multiuser multiple-input multiple-output (MIMO) system in the presence of an eavesdropper as a rank constrained rank minimization (RCRM) problem. The aim of the…

Information Theory · Computer Science 2015-08-06 Tung T. Vu , Ha Hoang Kha , Trung Q. Duong

Ranking systems influence decision-making in high-stakes domains like health, education, and employment, where they can have substantial economic and social impacts. This makes the integration of safety mechanisms essential. One such…

Machine Learning · Computer Science 2025-05-30 Antonio Ferrara , Andrea Pugnana , Francesco Bonchi , Salvatore Ruggieri

We analyze the prediction error of principal component regression (PCR) and prove high probability bounds for the corresponding squared risk conditional on the design. Our first main result shows that PCR performs comparably to the oracle…

Statistics Theory · Mathematics 2024-01-03 Laura Hucker , Martin Wahl

The paper deals with the adaptation of a new measure for the unsupervised feature selection problems. The proposed measure is based on space filling concept and is called the coverage measure. This measure was used for judging the quality…

Machine Learning · Statistics 2017-06-28 Mohamed Laib , Mikhail Kanevski

A long-standing problem in the construction of asymptotically correct confidence bands for a regression function $m(x)=E[Y|X=x]$, where $Y$ is the response variable influenced by the covariate $X$, involves the situation where $Y$ values…

Statistics Theory · Mathematics 2018-12-10 Ali Al-Sharadqah , Majid Mojirsheibani

The accurate labeling of datasets is often both costly and time-consuming. Given an unlabeled dataset, programmatic weak supervision obtains probabilistic predictions for the labels by leveraging multiple weak labeling functions (LFs) that…

Machine Learning · Statistics 2025-08-07 Verónica Álvarez , Santiago Mazuelas , Steven An , Sanjoy Dasgupta

Matching algorithms are commonly used to predict matches between items in a collection. For example, in 1:1 face verification, a matching algorithm predicts whether two face images depict the same person. Accurately assessing the…

Methodology · Statistics 2024-04-30 Riccardo Fogliato , Pratik Patil , Pietro Perona

We consider the problem of sparsity-constrained $M$-estimation when both explanatory and response variables have heavy tails (bounded 4-th moments), or a fraction of arbitrary corruptions. We focus on the $k$-sparse, high-dimensional regime…

Machine Learning · Computer Science 2019-05-31 Liu Liu , Tianyang Li , Constantine Caramanis

We study the problem of learning a high-density region of an arbitrary distribution over $\mathbb{R}^d$. Given a target coverage parameter $\delta$, and sample access to an arbitrary distribution $D$, we want to output a confidence set $S…

Data Structures and Algorithms · Computer Science 2025-05-14 Chao Gao , Liren Shan , Vaidehi Srinivas , Aravindan Vijayaraghavan

Conformal prediction constructs a confidence set for an unobserved response of a feature vector based on previous identically distributed and exchangeable observations of responses and features. It has a coverage guarantee at any nominal…

Machine Learning · Statistics 2022-12-08 Eugene Ndiaye , Ichiro Takeuchi

Volumetry is one of the principal downstream applications of 3D medical image segmentation, for example, to detect abnormal tissue growth or for surgery planning. Conformal Prediction is a promising framework for uncertainty quantification,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Benjamin Lambert , Florence Forbes , Senan Doyle , Michel Dojat

This paper proposes an innovative method for constructing confidence intervals and assessing p-values in statistical inference for high-dimensional linear models. The proposed method has successfully broken the high-dimensional inference…

Methodology · Statistics 2020-10-20 Faming Liang , Jingnan Xue , Bochao Jia

We propose a likelihood ratio based inferential framework for high dimensional semiparametric generalized linear models. This framework addresses a variety of challenging problems in high dimensional data analysis, including incomplete…

Machine Learning · Statistics 2015-11-24 Yang Ning , Tianqi Zhao , Han Liu