English
Related papers

Related papers: Conformal Prediction: A Theoretical Note and Bench…

200 papers

Credal sets are sets of probability distributions that are considered as candidates for an imprecisely known ground-truth distribution. In machine learning, they have recently attracted attention as an appealing formalism for uncertainty…

Machine Learning · Statistics 2024-02-19 Alireza Javanmardi , David Stutz , Eyke Hüllermeier

Conformal predictors are machine learning algorithms developed in the 1990's by Gammerman, Vovk, and their research team, to provide set predictions with guaranteed confidence level. Over recent years, they have grown in popularity and have…

Machine Learning · Computer Science 2025-08-12 Anthony Bellotti , Xindi Zhao

Instability of trained models, i.e., the dependence of individual node predictions on random factors, can affect reproducibility, reliability, and trust in machine learning systems. In this paper, we systematically assess the prediction…

Machine Learning · Computer Science 2022-05-23 Max Klabunde , Florian Lemmerich

Conformal inference provides a rigorous statistical framework for uncertainty quantification in machine learning, enabling well-calibrated prediction sets with precise coverage guarantees for any classification model. However, its reliance…

Graph Neural Networks (GNNs) have emerged as potent tools for predicting outcomes in graph-structured data. Despite their efficacy, a significant drawback of GNNs lies in their limited ability to provide robust uncertainty estimates, posing…

Machine Learning · Computer Science 2025-03-26 S. Akansha

This paper presents a new conformal method for generating simultaneous forecasting bands guaranteed to cover the entire path of a new random trajectory with sufficiently high probability. Prompted by the need for dependable uncertainty…

Machine Learning · Statistics 2024-05-16 Yanfei Zhou , Lars Lindemann , Matteo Sesia

With the advent of end-to-end deep learning approaches in machine translation, interest in word alignments initially decreased; however, they have again become a focus of research more recently. Alignments are useful for typological…

Computation and Language · Computer Science 2021-09-15 Ayyoob Imani , Masoud Jalili Sabet , Lütfi Kerem Şenel , Philipp Dufter , François Yvon , Hinrich Schütze

Conformal prediction has emerged as an effective strategy for uncertainty quantification by modifying a model to output sets of labels instead of a single label. These prediction sets come with the guarantee that they contain the true label…

Machine Learning · Computer Science 2025-05-28 Haosen Ge , Hamsa Bastani , Osbert Bastani

In this work we provide a review of basic ideas and novel developments about Conformal Prediction -- an innovative distribution-free, non-parametric forecasting method, based on minimal assumptions -- that is able to yield in a very…

Machine Learning · Computer Science 2024-02-01 Matteo Fontana , Gianluca Zeni , Simone Vantini

This paper introduces multimodal conformal regression. Traditionally confined to scenarios with solely numerical input features, conformal prediction is now extended to multimodal contexts through our methodology, which harnesses internal…

Machine Learning · Computer Science 2026-05-15 Alexis Bose , Jonathan Ethier , Paul Guinand

Link prediction attempts to predict whether an unseen edge exists based on only a portion of edges of a graph. A flurry of methods have been introduced in recent years that attempt to make use of graph neural networks (GNNs) for this task.…

Machine Learning · Computer Science 2023-11-21 Juanhui Li , Harry Shomer , Haitao Mao , Shenglai Zeng , Yao Ma , Neil Shah , Jiliang Tang , Dawei Yin

Conformal prediction provides a principled framework for uncertainty quantification with finite-sample coverage guarantees. While recent work has extended conformal prediction to online and sequential settings, existing methods typically…

Machine Learning · Statistics 2026-05-14 Eduardo Ochoa Rivera , Ambuj Tewari

Numerous studies have focused on learning and understanding the dynamics of physical systems from video data, such as spatial intelligence. Artificial intelligence requires quantitative assessments of the uncertainty of the model to ensure…

Machine Learning · Computer Science 2024-12-18 Aoming Liang , Qi Liu , Lei Xu , Fahad Sohrab , Weicheng Cui , Changhui Song , Moncef Gabbouj

Recent advances in graph convolutional networks have significantly improved the performance of chemical predictions, raising a new research question: "how do we explain the predictions of graph convolutional networks?" A possible approach…

Machine Learning · Computer Science 2018-07-06 Hirotaka Akita , Kosuke Nakago , Tomoki Komatsu , Yohei Sugawara , Shin-ichi Maeda , Yukino Baba , Hisashi Kashima

We propose a multi-scale extension of conformal prediction, an approach that constructs prediction sets with finite-sample coverage guarantees under minimal statistical assumptions. Classic conformal prediction relies on a single notion of…

Statistics Theory · Mathematics 2025-02-11 Ali Baheri , Marzieh Amiri Shahbazi

Topology identification and inference of processes evolving over graphs arise in timely applications involving brain, transportation, financial, power, as well as social and information networks. This chapter provides an overview of graph…

Signal Processing · Electrical Eng. & Systems 2025-12-12 Gonzalo Mateos , Yanning Shen , Georgios B. Giannakis , Ananthram Swami

Conformal prediction has emerged as a widely used framework for constructing valid prediction sets in classification and regression tasks. In this work, we extend the split conformal prediction framework to hierarchical classification,…

Machine Learning · Statistics 2026-04-13 Thomas Mortier , Alireza Javanmardi , Yusuf Sale , Eyke Hüllermeier , Willem Waegeman

Interest has been growing in decision-focused machine learning methods which train models to account for how their predictions are used in downstream optimization problems. Doing so can often improve performance on subsequent decision…

Machine Learning · Computer Science 2025-03-03 Santiago Cortes-Gomez , Carlos Patiño , Yewon Byun , Steven Wu , Eric Horvitz , Bryan Wilder

Forecasting surgical instrument trajectories and predicting the next surgical action recently started to attract attention from the research community. Both these tasks are crucial for automation and assistance in endoscopy surgery. Given…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Sara Sangalli , Gary Sarwin , Ertunc Erdil , Alessandro Carretta , Victor Staartjes , Carlo Serra , Ender Konukoglu

Time series prediction underpins a broad range of downstream tasks across many scientific domains. Recent advances and increasing adoption of black-box machine learning models for time series prediction highlight the critical need for…

Machine Learning · Computer Science 2026-03-23 Junghwan Lee , Chen Xu , Yao Xie