English
Related papers

Related papers: Online Conformal Prediction with Corrupted Feedbac…

200 papers

Conformal Prediction (CP) stands out as a robust framework for uncertainty quantification, which is crucial for ensuring the reliability of predictions. However, common CP methods heavily rely on data exchangeability, a condition often…

Machine Learning models increasingly face data integrity challenges due to the use of large-scale training datasets drawn from the Internet. We study what model developers can do if they detect that some data was manipulated or incorrect.…

Machine Learning · Computer Science 2024-10-18 Shashwat Goel , Ameya Prabhu , Philip Torr , Ponnurangam Kumaraguru , Amartya Sanyal

Uncertainty estimates must be calibrated (i.e., accurate) and sharp (i.e., informative) in order to be useful. This has motivated a variety of methods for recalibration, which use held-out data to turn an uncalibrated model into a…

Machine Learning · Computer Science 2022-07-06 Charles Marx , Shengjia Zhao , Willie Neiswanger , Stefano Ermon

Conformal prediction can be used to construct prediction sets that cover the true outcome with a desired probability, but can sometimes lead to large prediction sets that are costly in practice. The most useful outcome is a singleton…

Machine Learning · Statistics 2026-02-05 Tao Wang , Yan Sun , Edgar Dobriban

In industrial commodity recommendation systems, the representation quality of Item-Id vocabularies directly impacts the scalability and generalization ability of recommendation models. A key challenge is that traditional Item-Id…

Machine Learning · Computer Science 2026-03-20 Chen Sun , Beilin Xu , Boheng Tan , Jiacheng Wang , Yuefeng Sun , Rite Bo , Ying He , Yaqiang Zang , Pinghua Gong

Conformal prediction is a model-agnostic approach to generating prediction sets that cover the true class with a high probability. Although its prediction set size is expected to capture aleatoric uncertainty, there is a lack of evidence…

Machine Learning · Computer Science 2025-11-24 Misgina Tsighe Hagos , Claes Lundström

Online feedback optimization (OFO) enables optimal steady-state operations of a physical system by employing an iterative optimization algorithm as a dynamic feedback controller. When the plant consists of several interconnected…

Optimization and Control · Mathematics 2024-09-13 Wenbin Wang , Zhiyu He , Giuseppe Belgioioso , Saverio Bolognani , Florian Dörfler

Uncertainty quantification is essential for deploying machine learning models in high-stakes domains such as scientific discovery and healthcare. Conformal Prediction (CP) provides finite-sample coverage guarantees under exchangeability, an…

Machine Learning · Computer Science 2026-03-30 Siddhartha Laghuvarapu , Rohan Deb , Jimeng Sun

Robust optimization safeguards decisions against uncertainty by optimizing against worst-case scenarios, yet their effectiveness hinges on a prespecified robustness level that is often chosen ad hoc, leading to either insufficient…

Machine Learning · Statistics 2026-02-02 Wenbin Zhou , Shixiang Zhu

Conformal Prediction (CP) is a widely used technique for quantifying uncertainty in machine learning models. In its standard form, CP offers probabilistic guarantees on the coverage of the true label, but it is agnostic to sensitive…

Machine Learning · Computer Science 2025-09-30 Anutam Srinivasan , Aditya T. Vadlamani , Amin Meghrazi , Srinivasan Parthasarathy

This paper introduces a conformal inference method to evaluate uncertainty in classification by generating prediction sets with valid coverage conditional on adaptively chosen features. These features are carefully selected to reflect…

Machine Learning · Statistics 2024-10-31 Yanfei Zhou , Matteo Sesia

Conformal prediction is a distribution-free uncertainty quantification method that has gained popularity in the machine learning community due to its finite-sample guarantees and ease of use. Its most common variant, dubbed split conformal…

Machine Learning · Computer Science 2025-10-27 Alvaro H. C. Correia , Christos Louizos

Deep neural network predictions are notoriously difficult to interpret. Feature attribution methods aim to explain these predictions by identifying the contribution of each input feature. Faithfulness, often evaluated using the area over…

Machine Learning · Computer Science 2025-05-26 Joakim Edin , Andreas Geert Motzfeldt , Casper L. Christensen , Tuukka Ruotsalo , Lars Maaløe , Maria Maistro

Predicting the output of a dynamical system from streaming data is fundamental to real-time feedback control and decision-making. We first derive an autoregressive representation that relates future local outputs to asynchronous past…

Systems and Control · Electrical Eng. & Systems 2026-03-09 Jiachen Qian , Yang Zheng

Evaluating and optimizing policies in the presence of unobserved confounders is a problem of growing interest in offline reinforcement learning. Using conventional methods for offline RL in the presence of confounding can not only lead to…

Machine Learning · Statistics 2023-11-08 Chinmaya Kausik , Yangyi Lu , Kevin Tan , Maggie Makar , Yixin Wang , Ambuj Tewari

Conformal prediction is a powerful tool for constructing prediction intervals for black-box models, providing a finite sample coverage guarantee for exchangeable data. However, this exchangeability is compromised when some entries of the…

Machine Learning · Statistics 2025-05-09 Qian Peng , Yajie Bao , Haojie Ren , Zhaojun Wang , Changliang Zou

Conformal Prediction (CP) is a principled framework for quantifying uncertainty in blackbox learning models, by constructing prediction sets with finite-sample coverage guarantees. Traditional approaches rely on scalar nonconformity scores,…

Machine Learning · Statistics 2025-05-07 Gauthier Thurin , Kimia Nadjahi , Claire Boyer

Greedy algorithms for feature selection are widely used for recovering sparse high-dimensional vectors in linear models. In classical procedures, the main emphasis was put on the sample complexity, with little or no consideration of the…

Machine Learning · Statistics 2021-02-11 El Mehdi Saad , Gilles Blanchard , Sylvain Arlot

Reliable uncertainty quantification is crucial for the trustworthiness of machine learning applications. Inductive Conformal Prediction (ICP) offers a distribution-free framework for generating prediction sets or intervals with…

Machine Learning · Computer Science 2025-06-25 A. A. Balinsky , A. D. Balinsky

While counterfactual fairness of point predictors is well studied, its extension to prediction sets--central to fair decision-making under uncertainty--remains underexplored. On the other hand, conformal prediction (CP) provides efficient,…

Machine Learning · Computer Science 2026-03-13 Ozgur Guldogan , Neeraj Sarna , Yuanyuan Li , Michael Berger