English
Related papers

Related papers: API Is Enough: Conformal Prediction for Large Lang…

200 papers

In this paper, we focus on the problem of conformal prediction with conditional guarantees. Prior work has shown that it is impossible to construct nontrivial prediction sets with full conditional coverage guarantees. A wealth of research…

Machine Learning · Computer Science 2024-04-29 Shayan Kiyani , George Pappas , Hamed Hassani

A significant use case of instruction-finetuned Large Language Models (LLMs) is to solve question-answering tasks interactively. In this setting, an LLM agent is tasked with making a prediction by sequentially querying relevant information…

Machine Learning · Computer Science 2025-11-10 Kwan Ho Ryan Chan , Yuyan Ge , Edgar Dobriban , Hamed Hassani , René Vidal

Large Language Models (LLMs) have shown remarkable progress in multiple-choice question answering (MCQA), but their inherent unreliability, such as hallucination and overconfidence, limits their application in high-risk domains. To address…

Computation and Language · Computer Science 2025-08-08 Guang Yang , Xinyang Liu

Reliable uncertainty quantification is of critical importance in time series forecasting, yet traditional methods often rely on restrictive distributional assumptions. Conformal prediction (CP) has emerged as a promising distribution-free…

Machine Learning · Computer Science 2026-02-02 Andro Sabashvili

Reliable uncertainty quantification is critical for trustworthy AI. Conformal Prediction (CP) provides prediction sets with distribution-free coverage guarantees, but its two main variants face complementary limitations. Split CP (SCP)…

Machine Learning · Computer Science 2025-11-20 Weicao Deng , Sangwoo Park , Min Li , Osvaldo Simeone

Conformal Prediction (CP) is a popular method for uncertainty quantification with machine learning models. While conformal prediction provides probabilistic guarantees regarding the coverage of the true label, these guarantees are agnostic…

Machine Learning · Computer Science 2025-10-21 Aditya T. Vadlamani , Anutam Srinivasan , Pranav Maneriker , Ali Payani , Srinivasan Parthasarathy

Large language models (LLMs) are increasingly used in applications requiring factual accuracy, yet their outputs often contain hallucinated responses. While fact-checking can mitigate these errors, existing methods typically retrieve…

Computation and Language · Computer Science 2026-01-07 Haoran Wang , Maryam Khalid , Qiong Wu , Jian Gao , Cheng Cao

Precise estimation of predictive uncertainty in deep neural networks is a critical requirement for reliable decision-making in machine learning and statistical modeling, particularly in the context of medical AI. Conformal Prediction (CP)…

Machine Learning · Computer Science 2024-01-05 Hamed Karimi , Reza Samavi

Without writing a single line of code by a human, an example Monte Carlo simulation based application for stochastic dependence modeling with copulas is developed using a state-of-the-art large language model (LLM) fine-tuned for…

Computation and Language · Computer Science 2023-04-03 Jan Górecki

Causality is essential for understanding complex systems, such as the economy, the brain, and the climate. Constructing causal graphs often relies on either data-driven or expert-driven approaches, both fraught with challenges. The former…

Artificial Intelligence · Computer Science 2024-06-12 Kai-Hendrik Cohrs , Gherardo Varando , Emiliano Diaz , Vasileios Sitokonstantinou , Gustau Camps-Valls

While Conformal Prediction (CP) has proven to be a powerful framework for uncertainty quantification, guaranteeing conditional coverage remains a central challenge. Although finite-sample, distribution-free conditional validity is known to…

Methodology · Statistics 2026-05-27 Félix Laplante

Despite the impressive capability of large language models (LLMs), knowing when to trust their generations remains an open challenge. The recent literature on uncertainty quantification of natural language generation (NLG) utilises a…

Computation and Language · Computer Science 2024-06-06 Shuang Ao , Stefan Rueger , Advaith Siddharthan

Large Language Models (LLMs) increasingly rely on multi-turn reasoning and interaction, such as adaptive retrieval-augmented generation (RAG) and ReAct-style agents, to answer difficult questions. These methods improve accuracy by…

Computation and Language · Computer Science 2026-04-07 Xiaofan Zhou , Huy Nguyen , Bo Yu , Chenxi Liu , Lu Cheng

In this paper, we present a novel approach for conformal prediction (CP), in which we aim to identify a set of promising prediction candidates -- in place of a single prediction. This set is guaranteed to contain a correct answer with high…

Machine Learning · Computer Science 2021-02-03 Adam Fisch , Tal Schuster , Tommi Jaakkola , Regina Barzilay

Conformal prediction (CP), a distribution-free uncertainty quantification (UQ) framework, reliably provides valid predictive inference for black-box models. CP constructs prediction sets that contain the true output with a specified…

Machine Learning · Computer Science 2025-03-12 Xiaofan Zhou , Baiting Chen , Yu Gui , Lu Cheng

Large Language Models (LLMs) frequently hallucinate, limiting their reliability in critical applications. Conformal Prediction (CP) addresses this by calibrating error rates on held-out data to provide statistically valid confidence…

Machine Learning · Computer Science 2026-04-23 Nathan Hittesdorf , Marco Salzetta , Lu Cheng

Conformal prediction (CP) is an emerging uncertainty quantification framework that allows us to construct a prediction set to cover the true label with a pre-specified marginal or conditional probability. Although the valid coverage…

Machine Learning · Computer Science 2024-12-09 Yuanjie Shi , Subhankar Ghosh , Taha Belkhouja , Janardhan Rao Doppa , Yan Yan

Large Language Models (LLMs) exhibit strong performance across various natural language processing (NLP) tasks but remain vulnerable to hallucinations, generating factually incorrect or misleading outputs. Uncertainty estimation, often…

Machine Learning · Computer Science 2025-11-12 Manh Nguyen , Sunil Gupta , Hung Le

While Large Language Models (LLM) are able to accumulate and restore knowledge, they are still prone to hallucination. Especially when faced with factual questions, LLM cannot only rely on knowledge stored in parameters to guarantee…

Computation and Language · Computer Science 2024-01-04 Pierre Erbacher , Louis Falissar , Vincent Guigue , Laure Soulier

We introduce Longitudinal Predictive Conformal Inference (LPCI), a novel distribution-free conformal prediction algorithm for longitudinal data. Current conformal prediction approaches for time series data predominantly focus on the…

Machine Learning · Statistics 2023-10-05 Devesh Batra , Salvatore Mercuri , Raad Khraishi