English
Related papers

Related papers: Formal Verification and Control with Conformal Pre…

200 papers

Conformal methods provide prediction sets for outcomes with confidence guarantees. We study their use in a selective inference setting, where inference is performed only when the prediction set is informative. The analyst may consider as…

Methodology · Statistics 2026-05-22 Israela Solomon , Etienne Roquain , Saharon Rosset , Ruth Heller

Reliable uncertainty quantification is of critical importance in time series forecasting, yet traditional methods often rely on restrictive distributional assumptions. Conformal prediction (CP) has emerged as a promising distribution-free…

Machine Learning · Computer Science 2026-02-02 Andro Sabashvili

Large Language Models (LLMs) frequently hallucinate, limiting their reliability in critical applications. Conformal Prediction (CP) addresses this by calibrating error rates on held-out data to provide statistically valid confidence…

Machine Learning · Computer Science 2026-04-23 Nathan Hittesdorf , Marco Salzetta , Lu Cheng

The Super Learner (SL) is a widely used ensemble method that combines predictions from a library of learners based on their predictive performance. Interval predictions are of considerable practical interest because they allow uncertainty…

Machine Learning · Statistics 2026-04-27 Zhanli Wu , Fabrizio Leisen , Miguel-Angel Luque-Fernandez , F. Javier Rubio

Conformal prediction (CP) generates a set of predictions for a given test sample such that the prediction set almost always contains the true label (e.g., 99.5\% of the time). CP provides comprehensive predictions on possible labels of a…

Machine Learning · Computer Science 2023-09-12 Yizhe Zhang , Shuo Wang , Yejia Zhang , Danny Z. Chen

Conformal Prediction (CP) has emerged as a powerful statistical framework for high-stakes classification applications. Instead of predicting a single class, CP generates a prediction set, guaranteed to include the true label with a…

Machine Learning · Computer Science 2025-11-25 Ariel Fargion , Lahav Dabah , Tom Tirer

Cyber-Physical Systems (CPS) are complex systems that require powerful models for tasks like verification, diagnosis, or debugging. Often, suitable models are not available and manual extraction is difficult. Data-driven approaches then…

Artificial Intelligence · Computer Science 2025-08-21 Swantje Plambeck , Ali Salamati , Eyke Huellermeier , Goerschwin Fey

A novel learning Model Predictive Control technique is applied to the autonomous racing problem. The goal of the controller is to minimize the time to complete a lap. The proposed control strategy uses the data from previous laps to improve…

Machine Learning · Computer Science 2017-11-10 Ugo Rosolia , Ashwin Carvalho , Francesco Borrelli

Conformal prediction provides rigorous distribution-free finite-sample guarantees for marginal coverage under the assumption of exchangeability, but may exhibit systematic undercoverage or overcoverage for specific subpopulations. Assessing…

Methodology · Statistics 2026-04-24 Zheng Zhou , Xiangfei Zhang , Chongguang Tao , Yuhong Yang

This study introduces a significance testing-enhanced conformal prediction (CP) framework to improve trustworthiness of large language models (LLMs) in multiple-choice question answering (MCQA). While LLMs have been increasingly deployed in…

Computation and Language · Computer Science 2025-08-15 Yuanchang Ye

Dependability assurance of systems embedding machine learning(ML) components---so called learning-enabled systems (LESs)---is a key step for their use in safety-critical applications. In emerging standardization and guidance efforts, there…

Software Engineering · Computer Science 2023-01-11 Erfan Asaadi , Ewen Denney , Ganesh Pai

This paper introduces Fast Calibrated Explanations, a method designed for generating rapid, uncertainty-aware explanations for machine learning models. By incorporating perturbation techniques from ConformaSight - a global explanation…

Machine Learning · Computer Science 2024-10-29 Tuwe Löfström , Fatima Rabia Yapicioglu , Alessandra Stramiglio , Helena Löfström , Fabio Vitali

We study the problem of quantifying epistemic predictive uncertainty (EPU) -- that is, uncertainty faced at prediction time due to the existence of multiple plausible predictive models -- within the framework of conformal prediction (CP).…

Machine Learning · Computer Science 2026-02-03 Siu Lun Chau , Soroush H. Zargarbashi , Yusuf Sale , Michele Caprio

Large language models (LLMs) need reliable test-time control of hallucinations. Existing conformal methods for LLMs typically provide only \emph{marginal} guarantees and rely on a single global threshold, which can under-cover hard prompts,…

Machine Learning · Computer Science 2026-03-31 Kai Ye , Qingtao Pan , Shuo Li

Automated Essay Scoring (AES) systems now reach near human agreement on some public benchmarks, yet real-world adoption, especially in high-stakes examinations, remains limited. A principal obstacle is that most models output a single score…

Computation and Language · Computer Science 2025-09-22 Ahmed Karim , Qiao Wang , Zheng Yuan

Many systems contain latent variables that make their dynamics partially unidentifiable or cause distribution shifts in the observed statistics between offline and online data. However, existing control techniques often assume access to…

Systems and Control · Electrical Eng. & Systems 2025-06-24 Haoming Jing , Yorie Nakahira

This paper addresses the problem of risk-aware fixed-time stabilization of a class of uncertain, output-feedback nonlinear systems modeled via stochastic differential equations. First, novel classes of certificate functions, namely…

Optimization and Control · Mathematics 2024-04-01 Mitchell Black , Georgios Fainekos , Bardh Hoxha , Dimitra Panagou

Large Language and Vision-Language Models (LLMs/VLMs) are increasingly used in safety-critical applications, yet their opaque decision-making complicates risk assessment and reliability. Uncertainty quantification (UQ) helps assess…

Machine Learning · Computer Science 2025-02-12 Sina Tayebati , Divake Kumar , Nastaran Darabi , Dinithi Jayasuriya , Ranganath Krishnan , Amit Ranjan Trivedi

Risk-aware navigation in unknown environments is a fundamental challenge for autonomous vehicles operating in complex urban systems. To address this issue, this paper presents a differentiable optimization layered safety-critical control…

Systems and Control · Electrical Eng. & Systems 2026-05-19 Jinyang Dong , Shizhen Wu , Yongchun Fang

Uncertainty quantification is necessary for developers, physicians, and regulatory agencies to build trust in machine learning predictors and improve patient care. Beyond measuring uncertainty, it is crucial to express it in clinically…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Jacopo Teneggi , J Webster Stayman , Jeremias Sulam