English
Related papers

Related papers: UTOPIA: Universally Trainable Optimal Prediction I…

200 papers

The forecasting of irregular multivariate time series (IMTS) is crucial in key areas such as healthcare, biomechanics, climate science, and astronomy. However, achieving accurate and practical predictions is challenging due to two main…

Machine Learning · Computer Science 2025-11-18 Xvyuan Liu , Xiangfei Qiu , Xingjian Wu , Zhengyu Li , Chenjuan Guo , Jilin Hu , Bin Yang

In regression, conformal prediction is a general methodology to construct prediction intervals in a distribution-free manner. Although conformal prediction guarantees strong statistical property for predictive inference, its inherent…

Statistics Theory · Mathematics 2016-12-01 Wenyu Chen , Zhaokai Wang , Wooseok Ha , Rina Foygel Barber

Conformal Prediction is a framework that produces prediction intervals based on the output from a machine learning algorithm. In this paper we explore the case when training data is made up of multiple parts available in different sources…

Machine Learning · Statistics 2019-08-16 Ola Spjuth , Robin Carrión Brännström , Lars Carlsson , Niharika Gauraha

Numerous studies have focused on learning and understanding the dynamics of physical systems from video data, such as spatial intelligence. Artificial intelligence requires quantitative assessments of the uncertainty of the model to ensure…

Machine Learning · Computer Science 2024-12-18 Aoming Liang , Qi Liu , Lei Xu , Fahad Sohrab , Weicheng Cui , Changhui Song , Moncef Gabbouj

Given that machine learning algorithms are increasingly being deployed to aid in high stakes decision-making, uncertainty quantification methods that wrap around these black box models such as conformal prediction have received much…

Machine Learning · Statistics 2026-02-09 Kayla E. Scharfstein , Arun Kumar Kuchibhotla

Conformal prediction is widely used to equip black-box machine learning models with uncertainty quantification, offering formal coverage guarantees under exchangeable data. However, these guarantees fail when faced with subpopulation…

Machine Learning · Computer Science 2025-11-10 Nien-Shao Wang , Duygu Nur Yaldiz , Yavuz Faruk Bakman , Sai Praneeth Karimireddy

We propose a new optimization framework for aleatoric uncertainty estimation in regression problems. Existing methods can quantify the error in the target estimation, but they tend to underestimate it. To obtain the predictive uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Takumi Kawashima , Qing Yu , Akari Asai , Daiki Ikami , Kiyoharu Aizawa

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

Reasoning about uncertainty is vital in many real-life autonomous systems. However, current state-of-the-art planning algorithms cannot either reason about uncertainty explicitly, or do so with a high computational burden. Here, we focus on…

Artificial Intelligence · Computer Science 2022-01-31 Moran Barenboim , Vadim Indelman

Panel data, in which multiple units are repeatedly observed over time, arise throughout science and engineering. Quantifying predictive uncertainty in such settings is challenging because conformal prediction, while distribution-free and…

Machine Learning · Statistics 2026-05-19 Daohong Tu , Kay Giesecke

Teleoperation is crucial for hazardous environment operations and serves as a key tool for collecting expert demonstrations in robot learning. However, existing methods face robotic hardware dependency and control frequency mismatches…

Robotics · Computer Science 2025-04-29 Shengjian Fang , Yixuan Zhou , Yu Zheng , Pengyu Jiang , Siyuan Liu , Hesheng Wang

We consider an unconstrained continuous optimization problem where, in each iteration, gradient estimates may be arbitrarily corrupted with a probability greater than 1/2. Additionally, function value estimates may exhibit heavy-tailed…

Optimization and Control · Mathematics 2025-11-25 Katya Scheinberg , Miaolan Xie

The bootstrap procedure has emerged as a general framework to construct prediction intervals for future observations in autoregressive time series models. Such models with outlying data points are standard in real data applications,…

Methodology · Statistics 2020-11-17 Ufuk Beyaztas , Han Lin Shang

Conformal prediction has emerged as a cutting-edge methodology in statistics and machine learning, providing prediction intervals with finite-sample frequentist coverage guarantees. Yet, its interplay with Bayesian statistics, often…

Methodology · Statistics 2026-03-27 Nina Deliu , Brunero Liseo

Sampling multiple responses improves language model reasoning, but uniform compute allocation is inefficient: easy questions are over-sampled while hard questions remain under-explored. We propose Uncertainty-Aware Budget Allocation (UAB),…

Computation and Language · Computer Science 2026-05-27 Manh Nguyen , Sunil Gupta , Hung Le

Conformal Prediction offers a powerful framework for quantifying uncertainty in machine learning models, enabling the construction of prediction sets with finite-sample validity guarantees. While easily adaptable to non-probabilistic…

Machine Learning · Statistics 2024-11-27 Eshant English , Christoph Lippert

Conformal prediction is a theoretically grounded framework for constructing predictive intervals. We study conformal prediction with missing values in the covariates -- a setting that brings new challenges to uncertainty quantification. We…

Machine Learning · Statistics 2023-06-06 Margaux Zaffran , Aymeric Dieuleveut , Julie Josse , Yaniv Romano

We develop a general framework for constructing distribution-free prediction intervals for time series. Theoretically, we establish explicit bounds on conditional and marginal coverage gaps of estimated prediction intervals, which…

Methodology · Statistics 2023-02-20 Chen Xu , Yao Xie

Conformal prediction (CP) has been a popular method for uncertainty quantification because it is distribution-free, model-agnostic, and theoretically sound. For forecasting problems in supervised learning, most CP methods focus on building…

Machine Learning · Statistics 2024-05-24 Chen Xu , Hanyang Jiang , Yao Xie

Trustworthy decision making in networked, dynamic environments calls for innovative uncertainty quantification substrates in predictive models for graph time series. Existing conformal prediction (CP) methods have been applied separately to…

Machine Learning · Computer Science 2025-10-14 Sonakshi Dua , Gonzalo Mateos , Sundeep Prabhakar Chepuri