English
Related papers

Related papers: Uncertainty Quantification of Large Language Model…

200 papers

Large Language Models (LLMs) are increasingly used to automate classification tasks in business, such as analyzing customer satisfaction from text. However, the inherent stochasticity of LLMs can create measurement error when the outcome is…

Methodology · Statistics 2026-04-24 Yichi Zhang , Ignacio Martinez

In the constantly changing field of data-driven decision making, accurately predicting future events is crucial for strategic planning in various sectors. The emergence of Large Language Models (LLMs) marks a significant advancement in this…

Computation and Language · Computer Science 2025-01-10 Tommaso Soru , Jim Marshall

Many scientifically well-motivated statistical models in natural, engineering, and environmental sciences are specified through a generative process. However, in some cases, it may not be possible to write down the likelihood for these…

Methodology · Statistics 2020-11-17 Sanjay Chaudhuri , Subhroshekhar Ghosh , David J. Nott , Kim Cuc Pham

Approximate Bayesian Computation (ABC) enables parameter inference for complex physical systems in cases where the true likelihood function is unknown, unavailable, or computationally too expensive. It relies on the forward simulation of…

Cosmology and Nongalactic Astrophysics · Physics 2019-08-13 E. E. O. Ishida , S. D. P. Vitenti , M. Penna-Lima , J. Cisewski , R. S. de Souza , A. M. M. Trindade , E. Cameron , V. C. Busti

Approximate Bayesian Computation (ABC) is a popular inference method when likelihoods are hard to come by. Practical bottlenecks of ABC applications include selecting statistics that summarize the data without losing too much information or…

Computation · Statistics 2026-05-15 Khanh N. Dinh , Cécile Liu , Zijin Xiang , Zhihan Liu , Simon Tavaré

Approximate Bayesian computation (ABC) and other likelihood-free inference methods have gained popularity in the last decade, as they allow rigorous statistical inference for complex models without analytically tractable likelihood…

Computation · Statistics 2019-06-21 Jukka Sirén , Samuel Kaski

Bayesian inference is a principled framework for dealing with uncertainty. The practitioner can perform an initial assumption for the physical phenomenon they want to model (prior belief), collect some data and then adjust the initial…

Machine Learning · Computer Science 2020-11-10 Vasileios Gkolemis , Michael Gutmann

Large language models (LLMs) are increasingly employed in information-seeking and decision-making tasks. Despite their broad utility, LLMs tend to generate information that conflicts with real-world facts, and their persuasive style can…

Computation and Language · Computer Science 2024-09-19 Arslan Chaudhry , Sridhar Thiagarajan , Dilan Gorur

Advances in the general capabilities of large language models (LLMs) have led to their use for information retrieval, and as components in automated decision systems. A faithful representation of probabilistic reasoning in these models may…

Artificial Intelligence · Computer Science 2025-04-21 Gabriel Freedman , Francesca Toni

By the nature of their construction, many statistical models for extremes result in likelihood functions that are computationally prohibitive to evaluate. This is consequently problematic for the purposes of likelihood-based inference. With…

Methodology · Statistics 2014-11-07 Robert Erhardt , Scott A. Sisson

Many modern statistical applications involve inference for complicated stochastic models for which the likelihood function is difficult or even impossible to calculate, and hence conventional likelihood-based inferential echniques cannot be…

Computation · Statistics 2013-05-29 Simon R. White , Theodore Kypraios , Simon P. Preston

We discuss an approach for deriving robust posterior distributions from $M$-estimating functions using Approximate Bayesian Computation (ABC) methods. In particular, we use $M$-estimating functions to construct suitable summary statistics…

Methodology · Statistics 2019-06-13 Erlis Ruli , Nicola Sartori , Laura Ventura

Large Language Models (LLMs) are known to produce very high-quality tests and responses to our queries. But how much can we trust this generated text? In this paper, we study the problem of uncertainty quantification in LLMs. We propose a…

Computation and Language · Computer Science 2025-04-28 Muhammad Mubashar , Shireen Kudukkil Manchingal , Fabio Cuzzolin

"Approximate Bayesian Computation" (ABC) represents a powerful methodology for the analysis of complex stochastic systems for which the likelihood of the observed data under an arbitrary set of input parameters may be entirely…

Instrumentation and Methods for Astrophysics · Physics 2015-06-04 E. Cameron , A. N. Pettitt

We present an automatic large language model (LLM) conversion approach that produces uncertainty-aware LLMs capable of estimating uncertainty with every prediction. Our approach is model- and data-agnostic, is computationally-efficient, and…

Approximate Bayesian computation (ABC) using a sequential Monte Carlo method provides a comprehensive platform for parameter estimation, model selection and sensitivity analysis in differential equations. However, this method, like other…

Machine Learning · Statistics 2015-07-21 Sanmitra Ghosh , Srinandan Dasmahapatra , Koushik Maharatna

The goal of this paper is to explore the basic Approximate Bayesian Computation (ABC) algorithm via the lens of information theory. ABC is a widely used algorithm in cases where the likelihood of the data is hard to work with or…

Methodology · Statistics 2019-08-14 Konstantinos Spiliopoulos

Approximate Bayesian Computation (ABC) methods rely on asymptotic arguments, implying that parameter inference can be systematically biased even when sufficient statistics are available. We propose to construct the ABC accept/reject step…

Methodology · Statistics 2014-01-24 Oliver Ratmann , Anton Camacho , Adam Meijer , Gé Donker

Background: When conducting a meta-analysis of a continuous outcome, estimated means and standard deviations from the selected studies are required in order to obtain an overall estimate of the mean effect and its confidence interval. If…

Methodology · Statistics 2020-04-07 Deukwoo Kwon , Isildinha M. Reis

Large language models (LLMs) often produce confident but incorrect answers in settings where abstention would be safer. Standard evaluation protocols, however, require a response and do not account for how confidence should guide decisions…

Computation and Language · Computer Science 2026-04-06 Sean Wu , Fredrik K. Gustafsson , Edward Phillips , Boyan Gao , Anshul Thakur , David A. Clifton