English
Related papers

Related papers: Weighted Aggregation of Conformity Scores for Clas…

200 papers

We consider the functional regression model with multivariate response and functional predictors. Compared to fitting each individual response variable separately, taking advantage of the correlation between the response variables can…

Methodology · Statistics 2026-02-04 Ruiyan Luo , Xin Qi

Collaboration between different data centers is often challenged by heterogeneity across sites. To account for the heterogeneity, the state-of-the-art method is to re-weight the covariate distributions in each site to match the distribution…

Machine Learning · Statistics 2024-04-25 Tianyu Guo , Sai Praneeth Karimireddy , Michael I. Jordan

We introduce a method based on Conformal Prediction (CP) to quantify the uncertainty of full ranking algorithms. We focus on a specific scenario where $n+m$ items are to be ranked by some ``black box'' algorithm. It is assumed that the…

Machine Learning · Computer Science 2025-12-04 Jean-Baptiste Fermanian , Pierre Humbert , Gilles Blanchard

The expense of acquiring labels in large-scale statistical machine learning makes partially and weakly-labeled data attractive, though it is not always apparent how to leverage such data for model fitting or validation. We present a…

Machine Learning · Statistics 2022-02-10 Maxime Cauchois , Suyash Gupta , Alnur Ali , John Duchi

When the experimental objective is expressed by a set of estimable functions, and any eigenvalue-based optimality criterion is selected, we prove the equivalence of the recently introduced weighted optimality and the 'standard' optimality…

Statistics Theory · Mathematics 2016-10-21 Samuel Rosa

Conformal predictors are machine learning algorithms that output prediction sets that have a guarantee of marginal validity for finite samples with minimal distributional assumptions. This is a property that makes conformal predictors…

Machine Learning · Computer Science 2021-03-03 Anthony Bellotti

Conformal prediction (CP) provides a comprehensive framework to produce statistically rigorous uncertainty sets for black-box machine learning models. To further improve the efficiency of CP, conformal correction is proposed to fine-tune or…

Machine Learning · Computer Science 2025-12-03 Senrong Xu , Tianyu Wang , Zenan Li , Yuan Yao , Taolue Chen , Feng Xu , Xiaoxing Ma

This paper proposes probabilistic conformal prediction (PCP), a predictive inference algorithm that estimates a target variable by a discontinuous predictive set. Given inputs, PCP construct the predictive set based on random samples from…

Machine Learning · Statistics 2022-06-22 Zhendong Wang , Ruijiang Gao , Mingzhang Yin , Mingyuan Zhou , David M. Blei

We present an application of conformal prediction, a form of uncertainty quantification with guarantees, to the detection of railway signals. State-of-the-art architectures are tested and the most promising one undergoes the process of…

Machine Learning · Statistics 2023-01-27 Léo Andéol , Thomas Fel , Florence De Grancey , Luca Mossina

Conformal Prediction (CP) stands out as a robust framework for uncertainty quantification, which is crucial for ensuring the reliability of predictions. However, common CP methods heavily rely on data exchangeability, a condition often…

Conformal Predictive Systems (CPS) offer a versatile framework for constructing predictive distributions, allowing for calibrated inference and informative decision-making. However, their applicability has been limited to scenarios adhering…

Machine Learning · Computer Science 2024-10-17 Jef Jonkers , Glenn Van Wallendael , Luc Duchateau , Sofie Van Hoecke

We propose a weighted common subgraph (WCS) matching algorithm to find the most similar subgraphs in two labeled weighted graphs. WCS matching, as a natural generalization of the equal-sized graph matching or subgraph matching, finds wide…

Data Structures and Algorithms · Computer Science 2014-11-05 Xu Yang , Hong Qiao , Zhi-Yong Liu

One-shot prediction enables rapid adaptation of pretrained foundation models to new tasks using only one labeled example, but lacks principled uncertainty quantification. While conformal prediction provides finite-sample coverage…

Machine Learning · Statistics 2026-02-02 Maja Waldron

Supervised graph prediction addresses regression problems where the outputs are structured graphs. Although several approaches exist for graph-valued prediction, principled uncertainty quantification remains limited. We propose a conformal…

Machine Learning · Statistics 2026-03-30 Gabriel Melo , Thibaut de Saivre , Anna Calissano , Florence d'Alché-Buc

Every prediction is ultimately used in a downstream task. Consequently, evaluating prediction quality is more meaningful when considered in the context of its downstream use. Metrics based solely on predictive performance often diverge from…

Machine Learning · Computer Science 2025-08-26 Novin Shahroudi , Viacheslav Komisarenko , Meelis Kull

We introduce a framework for robust uncertainty quantification in situations where labeled training data are corrupted, through noisy or missing labels. We build on conformal prediction, a statistical tool for generating prediction sets…

Machine Learning · Computer Science 2026-02-27 Shai Feldman , Stephen Bates , Yaniv Romano

Decision support systems based on prediction sets have proven to be effective at helping human experts solve classification tasks. Rather than providing single-label predictions, these systems provide sets of label predictions constructed…

Machine Learning · Computer Science 2024-11-13 Giovanni De Toni , Nastaran Okati , Suhas Thejaswi , Eleni Straitouri , Manuel Gomez-Rodriguez

Conformal prediction (CP) provides powerful, distribution-free prediction sets, but its guarantees rely on the exchangeability of training and test data, which is often violated in practice due to covariate shifts. While weighted conformal…

Machine Learning · Computer Science 2026-05-05 James Wang , Surbhi Goel

If you are predicting the label $y$ of a new object with $\hat y$, how confident are you that $y = \hat y$? Conformal prediction methods provide an elegant framework for answering such question by building a $100 (1 - \alpha)\%$ confidence…

Machine Learning · Statistics 2019-11-11 Eugene Ndiaye , Ichiro Takeuchi

Scene graph generation is a structured prediction task aiming to explicitly model objects and their relationships via constructing a visually-grounded scene graph for an input image. Currently, the message passing neural network based mean…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Daqi Liu , Miroslaw Bober , Josef Kittler