English
Related papers

Related papers: Uncertainty Quantification of Large Language Model…

200 papers

Approximate Bayesian computation (ABC) has become an essential tool for the analysis of complex stochastic models when the likelihood function is numerically unavailable. However, the well-established statistical method of empirical…

Computation · Statistics 2015-06-05 K. L. Mengersen , P. Pudlo , C. P. Robert

This paper introduces a simple, general framework for likelihood-free Bayesian reinforcement learning, through Approximate Bayesian Computation (ABC). The main advantage is that we only require a prior distribution on a class of simulators…

Machine Learning · Statistics 2013-07-01 Christos Dimitrakakis , Nikolaos Tziortziotis

Approximate Bayesian computation (ABC), also known as likelihood-free methods, have become a favourite tool for the analysis of complex stochastic models, primarily in population genetics but also in financial analyses. We advocated in…

Computation · Statistics 2015-03-18 Christian Robert , Jean-Michel Marin , Natesh S. Pillai

Approximate Bayesian computation (ABC) methods, which are applicable when the likelihood is difficult or impossible to calculate, are an active topic of current research. Most current ABC algorithms directly approximate the posterior…

Computation · Statistics 2012-12-10 Y. Fan , D. J. Nott , S. A. Sisson

Large language models (LLMs) exhibit probabilistic output characteristics, yet conventional evaluation frameworks rely on deterministic scalar metrics. This study introduces a Bayesian approach for LLM capability assessment that integrates…

Computation and Language · Computer Science 2025-05-01 Xiao Xiao , Yu Su , Sijing Zhang , Zhang Chen , Yadong Chen , Tian Liu

This study investigates uncertainty quantification in large language models (LLMs) for medical applications, emphasizing both technical innovations and philosophical implications. As LLMs become integral to clinical decision-making,…

Artificial Intelligence · Computer Science 2025-04-08 Zahra Atf , Seyed Amir Ahmad Safavi-Naini , Peter R. Lewis , Aref Mahjoubfar , Nariman Naderi , Thomas R. Savage , Ali Soroush

Approximate Bayesian computation (ABC) is a family of computational techniques in Bayesian statistics. These techniques allow to fi t a model to data without relying on the computation of the model likelihood. They instead require to…

Statistics Theory · Mathematics 2018-12-27 Maxime Lenormand , Franck Jabot , Guillaume Deffuant

Approximate Bayesian Computation (ABC) enables statistical inference in simulator-based models whose likelihoods are difficult to calculate but easy to simulate from. ABC constructs a kernel-type approximation to the posterior distribution…

Methodology · Statistics 2022-12-02 Yuexi Wang , Tetsuya Kaji , Veronika Ročková

Many models of interest in the natural and social sciences have no closed-form likelihood function, which means that they cannot be treated using the usual techniques of statistical inference. In the case where such models can be…

Computation · Statistics 2012-07-19 Simon Barthelmé , Nicolas Chopin

How can we precisely estimate a large language model's (LLM) accuracy on questions belonging to a specific topic within a larger question-answering dataset? The standard direct estimator, which averages the model's accuracy on the questions…

Machine Learning · Computer Science 2024-10-08 Riccardo Fogliato , Pratik Patil , Nil-Jana Akpinar , Mathew Monfort

This paper provides a review of Approximate Bayesian Computation (ABC) methods for carrying out Bayesian posterior inference, through the lens of density estimation. We describe several recent algorithms and make connection with traditional…

Computation · Statistics 2019-09-09 Clara Grazian , Yanan Fan

Performing exact posterior inference in complex generative models is often difficult or impossible due to an expensive to evaluate or intractable likelihood function. Approximate Bayesian computation (ABC) is an inference framework that…

Machine Learning · Statistics 2016-02-16 Jovana Mitrovic , Dino Sejdinovic , Yee Whye Teh

Approximate Bayesian computation (ABC) is a widely used inference method in Bayesian statistics to bypass the point-wise computation of the likelihood. In this paper we develop theoretical bounds for the distance between the statistics used…

Statistics Theory · Mathematics 2019-01-03 James Ridgway

Complicated generative models often result in a situation where computing the likelihood of observed data is intractable, while simulating from the conditional density given a parameter value is relatively easy. Approximate Bayesian…

Machine Learning · Statistics 2015-12-29 Mijung Park , Wittawat Jitkrittum , Dino Sejdinovic

Many modern statistical applications involve inference for complex stochastic models, where it is easy to simulate from the models, but impossible to calculate likelihoods. Approximate Bayesian computation (ABC) is a method of inference for…

Methodology · Statistics 2015-03-14 Paul Fearnhead , Dennis Prangle

Approximate Bayesian computation (ABC) is a method for Bayesian inference when the likelihood is unavailable but simulating from the model is possible. However, many ABC algorithms require a large number of simulations, which can be costly.…

Machine Learning · Statistics 2018-10-15 Marko Järvenpää , Michael U. Gutmann , Arijus Pleska , Aki Vehtari , Pekka Marttinen

Approximate Bayesian computation (ABC) is commonly used for parameter estimation and model comparison for intractable simulator-based models whose likelihood function cannot be evaluated. In this paper we instead investigate the feasibility…

Methodology · Statistics 2022-09-13 Marko Järvenpää , Jukka Corander

Approximate Bayesian Computation (ABC) methods are applicable to statistical models specified by generative processes with analytically intractable likelihoods. These methods try to approximate the posterior density of a model parameter by…

Methodology · Statistics 2024-03-11 Sanjay Chaudhuri , Subhroshekhar Ghosh , Kim Cuc Pham

Approximate Bayesian Computation (ABC) is a framework for performing likelihood-free posterior inference for simulation models. Stochastic Variational inference (SVI) is an appealing alternative to the inefficient sampling approaches…

Machine Learning · Statistics 2016-06-29 Alexander Moreno , Tameem Adel , Edward Meeds , James M. Rehg , Max Welling

Large Language Models (LLMs) have been widely employed in programming language analysis to enhance human productivity. Yet, their reliability can be compromised by various code distribution shifts, leading to inconsistent outputs. While…

Software Engineering · Computer Science 2024-02-12 Yufei Li , Simin Chen , Yanghong Guo , Wei Yang , Yue Dong , Cong Liu