English
Related papers

Related papers: Prior knowledge elicitation: The past, present, an…

200 papers

State-of-the-art multi-objective optimization often assumes a known utility function, learns it interactively, or computes the full Pareto front-each requiring costly expert input.~Real-world problems, however, involve implicit preferences…

Machine Learning · Computer Science 2025-10-01 Farha A. Khan , Tanmay Chakraborty , Jörg P. Dietrich , Christian Wirth

A desirable property of learning systems is to be both effective and interpretable. Towards this goal, recent models have been proposed that first generate an extractive explanation from the input text and then generate a prediction on just…

Computation and Language · Computer Science 2021-02-05 Zijian Zhang , Koustav Rudra , Avishek Anand

Bayesian neural networks attempt to combine the strong predictive performance of neural networks with formal quantification of uncertainty associated with the predictive output in the Bayesian framework. However, it remains unclear how to…

Machine Learning · Statistics 2022-01-12 Takuo Matsubara , Chris J. Oates , François-Xavier Briol

In Bayesian meta-analysis, the specification of prior probabilities for the between-study heterogeneity is commonly required, and is of particular benefit in situations where only few studies are included. Among the considerations in the…

Methodology · Statistics 2023-06-02 Christian Röver , Sibylle Sturtz , Jona Lilienthal , Ralf Bender , Tim Friede

Modern predictive systems encode beliefs that can act as useful prior information for statistical inference in data-limited settings. Using them for prior construction introduces a tradeoff: an informative prior built from a predictive…

Machine Learning · Statistics 2026-05-12 Jongwoo Choi , Sean O'Hagan

Datasets are rarely a realistic approximation of the target population. Say, prevalence is misrepresented, image quality is above clinical standards, etc. This mismatch is known as sampling bias. Sampling biases are a major hindrance for…

In this note, the practical use of priors for Bayes estimators, of the two parameters of the Weibull reliability model, is discussed in a technological context. The meaning of the priors as expression of virtual data samples is analyzed.…

Statistics Theory · Mathematics 2013-10-29 Pasquale Erto , Massimiliano Giorgio

Modeling complex conditional distributions is critical in a variety of settings. Despite a long tradition of research into conditional density estimation, current methods employ either simple parametric forms or are difficult to learn in…

Machine Learning · Statistics 2018-02-15 Brian L Trippe , Richard E Turner

Total probability and Bayes formula are two basic tools for using prior information in the Bayesian statistics. In this paper we introduce an alternative tool for using prior information. This new toold enables us to improve some…

Mathematical Physics · Physics 2009-11-10 Adel Mohammadpour , Ali Mohammad-Djafari

What is the best way to exploit extra data -- be it unlabeled data from the same task, or labeled data from a related task -- to learn a given task? This paper formalizes the question using the theory of reference priors. Reference priors…

Machine Learning · Statistics 2022-06-17 Yansong Gao , Rahul Ramesh , Pratik Chaudhari

Optimising black-box functions is important in many disciplines, such as tuning machine learning models, robotics, finance and mining exploration. Bayesian optimisation is a state-of-the-art technique for the global optimisation of…

Machine Learning · Computer Science 2015-03-05 John-Alexander M. Assael , Ziyu Wang , Bobak Shahriari , Nando de Freitas

We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks. The approach is more scalable to large data than Markov Chain Monte Carlo, it embraces more expressive models than…

Machine Learning · Statistics 2022-09-07 Joel Janek Dabrowski , Daniel Edward Pagendam

Inferring the value of a property of a large stochastic system is a difficult task when the number of samples is insufficient to reliably estimate the probability distribution. The Bayesian estimator of the property of interest requires the…

Data Analysis, Statistics and Probability · Physics 2022-01-26 Damián G. Hernández , Inés Samengo

Bayesian design can be used for efficient data collection over time when the process can be described by the solution to an ordinary differential equation (ODE). Typically, Bayesian designs in such settings are obtained by maximising the…

Methodology · Statistics 2024-07-10 Nushrath Najimuddin , David J. Warne , Helen Thompson , James M. McGree

The widely applicable information criterion (WAIC) has been used as a model selection criterion for Bayesian statistics in recent years. It is an asymptotically unbiased estimator of the Kullback-Leibler divergence between a Bayesian…

Methodology · Statistics 2022-08-09 Yoshiyuki Ninomiya

In Bayesian analysis, the selection of a prior distribution is typically done by considering each parameter in the model. While this can be convenient, in many scenarios it may be desirable to place a prior on a summary measure of the model…

Methodology · Statistics 2024-01-17 Eric Yanchenko , Howard D. Bondell , Brian J. Reich

Uncertainty quantification is essential when dealing with ill-conditioned inverse problems due to the inherent nonuniqueness of the solution. Bayesian approaches allow us to determine how likely an estimation of the unknown parameters is…

Machine Learning · Statistics 2020-01-16 Ali Siahkoohi , Gabrio Rizzuti , Felix J. Herrmann

Bayes' rule has enabled innumerable powerful algorithms of statistical signal processing and statistical machine learning. However, when model misspecifications exist in prior and/or data distributions, the direct application of Bayes' rule…

Signal Processing · Electrical Eng. & Systems 2026-02-13 Shixiong Wang

Recent decades have seen an interest in prediction problems for which Bayesian methodology has been used ubiquitously. Sampling from or approximating the posterior predictive distribution in a Bayesian model allows one to make inferential…

Machine Learning · Statistics 2017-09-12 Giri Gopalan

Bayesian methods have proven themselves to be successful across a wide range of scientific problems and have many well-documented advantages over competing methods. However, these methods run into difficulties for two major and prevalent…

Methodology · Statistics 2022-07-29 John R. Lewis , Steven N. MacEachern , Yoonkyung Lee