English
Related papers

Related papers: Conformal Object Detection by Sequential Risk Cont…

200 papers

To evaluate a classification algorithm, it is common practice to plot the ROC curve using test data. However, the inherent randomness in the test data can undermine our confidence in the conclusions drawn from the ROC curve, necessitating…

Methodology · Statistics 2024-05-22 Zheshi Zheng , Bo Yang , Peter Song

Calibrated confidence estimates obtained from neural networks are crucial, particularly for safety-critical applications such as autonomous driving or medical image diagnosis. However, although the task of confidence calibration has been…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Fabian Küppers , Anselm Haselhoff , Jan Kronenberger , Jonas Schneider

Self-supervised pre-training and transformer-based networks have significantly improved the performance of object detection. However, most of the current self-supervised object detection methods are built on convolutional-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Guoqiang Jin , Fan Yang , Mingshan Sun , Ruyi Zhao , Yakun Liu , Wei Li , Tianpeng Bao , Liwei Wu , Xingyu Zeng , Rui Zhao

If you are predicting the label $y$ of a new object with $\hat y$, how confident are you that $y = \hat y$? Conformal prediction methods provide an elegant framework for answering such question by building a $100 (1 - \alpha)\%$ confidence…

Machine Learning · Statistics 2019-11-11 Eugene Ndiaye , Ichiro Takeuchi

In industrial settings, surface defects on steel can significantly compromise its service life and elevate potential safety risks. Traditional defect detection methods predominantly rely on manual inspection, which suffers from low…

Machine Learning · Computer Science 2025-04-25 Cheng Shen , Yuewei Liu

Conformal unlearning aims to ensure that a trained conformal predictor miscovers data points with specific shared characteristics, such as those from a particular label class, associated with a specific user, or belonging to a defined…

Machine Learning · Computer Science 2026-02-13 Yahya Alkhatib , Muhammad Ahmar Jamal , Wee Peng Tay

As human-machine interaction continues to evolve, the capacity for environmental perception is becoming increasingly crucial. Integrating the two most common types of sensory data, images, and point clouds, can enhance detection accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Kai Luo , Hao Wu , Kefu Yi , Kailun Yang , Wei Hao , Rongdong Hu

We propose a post-hoc, computationally lightweight method to quantify predictive uncertainty in semantic image segmentation. Our approach uses conformal prediction to generate statistically valid prediction sets that are guaranteed to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Luca Mossina , Joseba Dalmau , Léo andéol

Machine learning classification tasks often benefit from predicting a set of possible labels with confidence scores to capture uncertainty. However, existing methods struggle with the high-dimensional nature of the data and the lack of…

Machine Learning · Computer Science 2024-07-08 Rui Luo , Zhixin Zhou

Conformal predictors are machine learning algorithms that output prediction sets that have a guarantee of marginal validity for finite samples with minimal distributional assumptions. This is a property that makes conformal predictors…

Machine Learning · Computer Science 2021-03-03 Anthony Bellotti

Selecting the top-$m$ variables with the $m$ largest population parameters from a larger set of candidates is a fundamental problem in statistics. In this paper, we propose a novel methodology called Sequential Correct Screening (SCS),…

Methodology · Statistics 2025-08-21 Masaki Toyoda , Yoshimasa Uematsu

Standard conformal prediction offers a marginal guarantee on coverage, but for prediction sets to be truly useful, they should ideally ensure coverage conditional on each test point. Unfortunately, it is impossible to achieve exact,…

Machine Learning · Computer Science 2025-02-11 Jivat Neet Kaur , Michael I. Jordan , Ahmed Alaa

Conformal methods provide prediction sets for outcomes with confidence guarantees. We study their use in a selective inference setting, where inference is performed only when the prediction set is informative. The analyst may consider as…

Methodology · Statistics 2026-05-22 Israela Solomon , Etienne Roquain , Saharon Rosset , Ruth Heller

Conformal prediction has recently emerged as a promising strategy for quantifying the uncertainty of a predictive model; these algorithms modify the model to output sets of labels that are guaranteed to contain the true label with high…

Machine Learning · Computer Science 2025-03-11 Botong Zhang , Shuo Li , Osbert Bastani

The interest in using reinforcement learning (RL) controllers in safety-critical applications such as robot navigation around pedestrians motivates the development of additional safety mechanisms. Running RL-enabled systems among uncertain…

Robotics · Computer Science 2023-12-08 Kegan J. Strawn , Nora Ayanian , Lars Lindemann

Object detection and multiple object tracking (MOT) are essential components of self-driving systems. Accurate detection and uncertainty quantification are both critical for onboard modules, such as perception, prediction, and planning, to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Sanbao Su , Songyang Han , Yiming Li , Zhili Zhang , Chen Feng , Caiwen Ding , Fei Miao

We propose a framework for planning in unknown dynamic environments with probabilistic safety guarantees using conformal prediction. Particularly, we design a model predictive controller (MPC) that uses i) trajectory predictions of the…

Robotics · Computer Science 2023-06-09 Lars Lindemann , Matthew Cleaveland , Gihyun Shim , George J. Pappas

Rapid advances in perception have enabled large pre-trained models to be used out of the box for transforming high-dimensional, noisy, and partial observations of the world into rich occupancy representations. However, the reliability of…

Given that machine learning algorithms are increasingly being deployed to aid in high stakes decision-making, uncertainty quantification methods that wrap around these black box models such as conformal prediction have received much…

Machine Learning · Statistics 2026-02-09 Kayla E. Scharfstein , Arun Kumar Kuchibhotla

Score-based generative modeling, informally referred to as diffusion models, continue to grow in popularity across several important domains and tasks. While they provide high-quality and diverse samples from empirical distributions,…

Machine Learning · Statistics 2023-12-29 Jacopo Teneggi , Matthew Tivnan , J. Webster Stayman , Jeremias Sulam