English
Related papers

Related papers: Utility-Directed Conformal Prediction: A Decision-…

200 papers

Data-driven modeling is useful for reconstructing nonlinear dynamical systems when the underlying process is unknown or too expensive to compute. Having reliable uncertainty assessment of the forecast enables tools to be deployed to predict…

Methodology · Statistics 2023-11-01 Mengyang Gu , Yizi Lin , Victor Chang Lee , Diana Qiu

Conformal prediction (CP) provides model-agnostic uncertainty quantification with guaranteed coverage, but conventional methods often produce overly conservative uncertainty sets, especially in multi-dimensional settings. This limitation…

Machine Learning · Computer Science 2025-02-12 Minxing Zheng , Shixiang Zhu

In this paper, we adopt conformal prediction, a distribution-free uncertainty quantification (UQ) framework, to obtain confidence prediction intervals with coverage guarantees for Deep Operator Network (DeepONet) regression. Initially, we…

Machine Learning · Computer Science 2024-02-26 Christian Moya , Amirhossein Mollaali , Zecheng Zhang , Lu Lu , Guang Lin

This paper aims to evaluate the suitability of current deep learning methods for clinical workflow especially by focusing on dermatology. Although deep learning methods have been attempted to get dermatologist level accuracy in several…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Sourav Mishra , Subhajit Chaudhury , Hideaki Imaizumi , Toshihiko Yamasaki

In modern process industries, data-driven models are important tools for real-time monitoring when key performance indicators are difficult to measure directly. While accurate predictions are essential, reliable uncertainty quantification…

Machine Learning · Computer Science 2026-04-07 Yiran Ma , Jerome Le Ny , Zhichao Chen , Zhihuan Song

Operator learning has been increasingly adopted in scientific and engineering applications, many of which require calibrated uncertainty quantification. Since the output of operator learning is a continuous function, quantifying uncertainty…

Machine Learning · Computer Science 2024-02-07 Ziqi Ma , Kamyar Azizzadenesheli , Anima Anandkumar

When machine learning systems meet real world applications, accuracy is only one of several requirements. In this paper, we assay a complementary perspective originating from the increasing availability of pre-trained and regularly…

This paper questions the effectiveness of a modern predictive uncertainty quantification approach, called \emph{evidential deep learning} (EDL), in which a single neural network model is trained to learn a meta distribution over the…

Machine Learning · Computer Science 2024-11-04 Maohao Shen , J. Jon Ryu , Soumya Ghosh , Yuheng Bu , Prasanna Sattigeri , Subhro Das , Gregory W. Wornell

In personalized medicine, the ability to predict and optimize treatment outcomes across various time frames is essential. Additionally, the ability to select cost-effective treatments within specific budget constraints is critical. Despite…

Machine Learning · Computer Science 2024-10-14 Thomas Schwarz , Cecilia Casolo , Niki Kilbertus

To take unit commitment (UC) decisions under uncertain net load, most studies utilize a stochastic UC (SUC) model that adopts a one-size-fits-all representation of uncertainty. Disregarding contextual information such as weather forecasts…

Optimization and Control · Mathematics 2022-12-01 Ogun Yurdakul , Feng Qiu , Sahin Albayrak

Modern machine learning methods including deep learning have achieved great success in predictive accuracy for supervised learning tasks, but may still fall short in giving useful estimates of their predictive {\em uncertainty}. Quantifying…

Prescriptive process monitoring methods seek to improve the performance of a process by selectively triggering interventions at runtime (e.g., offering a discount to a customer) to increase the probability of a desired case outcome (e.g., a…

Machine Learning · Computer Science 2022-12-08 Mahmoud Shoush , Marlon Dumas

We propose a post-hoc, computationally lightweight method to quantify predictive uncertainty in semantic image segmentation. Our approach uses conformal prediction to generate statistically valid prediction sets that are guaranteed to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Luca Mossina , Joseba Dalmau , Léo andéol

AI tools can be useful to address model deficits in the design of communication systems. However, conventional learning-based AI algorithms yield poorly calibrated decisions, unabling to quantify their outputs uncertainty. While Bayesian…

Signal Processing · Electrical Eng. & Systems 2024-05-02 Kfir M. Cohen , Sangwoo Park , Osvaldo Simeone , Shlomo Shamai

Accurate forecasting is critical for reliable power grid operations, particularly as the share of renewable generation, such as wind and solar, continues to grow. Given the inherent uncertainty and variability in renewable generation,…

Applications · Statistics 2025-10-20 Alireza Moradi , Mathieu Tanneau , Reza Zandehshahvar , Pascal Van Hentenryck

Deploying deep learning models in safety-critical applications remains a very challenging task, mandating the provision of assurances for the dependable operation of these models. Uncertainty quantification (UQ) methods estimate the model's…

Machine Learning · Computer Science 2024-01-23 Daniel Bethell , Simos Gerasimou , Radu Calinescu

Dynamic feature selection (DFS) addresses budget constraints in decision-making by sequentially acquiring features for each instance, making it appealing for resource-limited scenarios. However, existing DFS methods require models…

Machine Learning · Computer Science 2026-02-19 Javier Fumanal-Idocin , Raquel Fernandez-Peralta , Javier Andreu-Perez

Zero-inflated outcomes, where responses are zero with positive probability and otherwise continuous, are common in biomedical, environmental, and social science studies. We propose a conformal prediction based framework that provides…

Hyperdimensional Computing (HDC) offers a computationally efficient paradigm for neuromorphic learning. Yet, it lacks rigorous uncertainty quantification, leading to open decision boundaries and, consequently, vulnerability to outliers,…

Uncertainty quantification (UQ) is essential for safe deployment of generative AI models such as large language models (LLMs), especially in high stakes applications. Conformal prediction (CP) offers a principled uncertainty quantification…

Machine Learning · Computer Science 2025-06-09 Sima Noorani , Shayan Kiyani , George Pappas , Hamed Hassani