English
Related papers

Related papers: Coverage Guarantees for Pseudo-Calibrated Conforma…

200 papers

Conformal prediction (CP) is a powerful framework for quantifying uncertainty in machine learning models, offering reliable predictions with finite-sample coverage guarantees. When applied to classification, CP produces a prediction set of…

Machine Learning · Computer Science 2025-08-20 Floris den Hengst , Inès Blin , Majid Mohammadi , Syed Ihtesham Hussain Shah , Taraneh Younesian

While existing depression prediction methods based on deep learning show promise, their practical application is hindered by the lack of trustworthiness, as these deep models are often deployed as black box models, leaving us uncertain on…

Machine Learning · Computer Science 2024-08-28 Yonghong Li , Xiuzhuang Zhou

We consider the problem of conformal prediction under covariate shift. Given labeled data from a source domain and unlabeled data from a covariate shifted target domain, we seek to construct prediction sets with valid marginal coverage in…

Machine Learning · Statistics 2025-07-02 Sunay Joshi , Shayan Kiyani , George Pappas , Edgar Dobriban , Hamed Hassani

We develop methods for forming prediction sets in an online setting where the data generating distribution is allowed to vary over time in an unknown fashion. Our framework builds on ideas from conformal inference to provide a general…

Methodology · Statistics 2021-12-10 Isaac Gibbs , Emmanuel Candès

To learn target discriminative representations, using pseudo-labels is a simple yet effective approach for unsupervised domain adaptation. However, the existence of false pseudo-labels, which may have a detrimental influence on learning…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Jaehoon Choi , Minki Jeong , Taekyung Kim , Changick Kim

Semi-supervised learning is attracting blooming attention, due to its success in combining unlabeled data. However, pseudo-labeling-based semi-supervised approaches suffer from two problems in image classification: (1) Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Xuerong Zhang , Li Huang , Jing Lv , Ming Yang

Domain adaptive semantic segmentation aims to learn a model with the supervision of source domain data, and produce satisfactory dense predictions on unlabeled target domain. One popular solution to this challenging task is self-training,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Ruihuang Li , Shuai Li , Chenhang He , Yabin Zhang , Xu Jia , Lei Zhang

Modern software-defined networks, such as Open Radio Access Network (O-RAN) systems, rely on artificial intelligence (AI)-powered applications running on controllers interfaced with the radio access network. To ensure that these AI…

Signal Processing · Electrical Eng. & Systems 2025-02-06 Seonghoon Yoo , Sangwoo Park , Petar Popovski , Joonhyuk Kang , Osvaldo Simeone

The standard closed-set domain adaptation approaches seek to mitigate distribution discrepancies between two domains under the constraint of both sharing identical label sets. However, in realistic scenarios, finding an optimal source…

Machine Learning · Computer Science 2022-12-06 Sandipan Choudhuri , Suli Adeniye , Arunabha Sen , Hemanth Venkateswara

Continual Learning (CL) is essential for enabling self-evolving large language models (LLMs) to adapt and remain effective amid rapid knowledge growth. Yet, despite its importance, little attention has been given to establishing statistical…

Machine Learning · Computer Science 2025-10-29 Xiaofan Zhou , Lu Cheng

Pseudo-labeling has emerged as a popular and effective approach for utilizing unlabeled data. However, in the context of semi-supervised multi-label learning (SSMLL), conventional pseudo-labeling methods encounter difficulties when dealing…

Machine Learning · Computer Science 2023-05-23 Ming-Kun Xie , Jia-Hao Xiao , Hao-Zhe Liu , Gang Niu , Masashi Sugiyama , Sheng-Jun Huang

Discrimination and calibration represent two important properties of survival analysis, with the former assessing the model's ability to accurately rank subjects and the latter evaluating the alignment of predicted outcomes with actual…

Machine Learning · Computer Science 2024-06-04 Shi-ang Qi , Yakun Yu , Russell Greiner

Conformal prediction is a framework for providing prediction intervals with distribution-free validity, guaranteeing predictive coverage for data drawn from any distribution. Its two main variants are full conformal prediction and split…

Methodology · Statistics 2026-05-29 Aabesh Bhattacharyya , Boxuan Zhang , Rina Foygel Barber

Conformal prediction provides distribution-free coverage guarantees, but in many-class classification it may still under-cover specific classes or subpopulations, preventing safe deployment in high-stakes applications. We propose Cluster…

Machine Learning · Computer Science 2026-05-26 Tomer Lavi , Bracha Shapira , Nadav Rappoport

Conformal prediction is a statistical framework that generates prediction sets containing ground-truth labels with a desired coverage guarantee. The predicted probabilities produced by machine learning models are generally miscalibrated,…

Machine Learning · Computer Science 2024-06-07 Jianguo Huang , Huajun Xi , Linjun Zhang , Huaxiu Yao , Yue Qiu , Hongxin Wei

We introduce a method based on Conformal Prediction (CP) to quantify the uncertainty of full ranking algorithms. We focus on a specific scenario where $n+m$ items are to be ranked by some ``black box'' algorithm. It is assumed that the…

Machine Learning · Computer Science 2025-12-04 Jean-Baptiste Fermanian , Pierre Humbert , Gilles Blanchard

We establish a new model-agnostic optimization framework for out-of-distribution generalization via multicalibration, a criterion that ensures a predictor is calibrated across a family of overlapping groups. Multicalibration is shown to be…

Machine Learning · Computer Science 2024-06-04 Jiayun Wu , Jiashuo Liu , Peng Cui , Zhiwei Steven Wu

Deploying deep visual models can lead to performance drops due to the discrepancies between source and target distributions. Several approaches leverage labeled source data to estimate target domain accuracy, but accessing labeled source…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 JoonHo Lee , Jae Oh Woo , Hankyu Moon , Kwonho Lee

Conformal predictive systems are sets of predictive distributions with theoretical out-of-sample calibration guarantees. The calibration guarantees are typically that the set of predictions contains a forecast distribution whose prediction…

Methodology · Statistics 2025-11-03 Sam Allen , Enrico Pescara , Johanna Ziegel

This paper focuses on the unsupervised domain adaptation of transferring the knowledge from the source domain to the target domain in the context of semantic segmentation. Existing approaches usually regard the pseudo label as the ground…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Zhedong Zheng , Yi Yang