English
Related papers

Related papers: Empirical Bayes for Data Integration

200 papers

The key distinguishing property of a Bayesian approach is marginalization instead of optimization, not the prior, or Bayes rule. Bayesian inference is especially compelling for deep neural networks. (1) Neural networks are typically…

Machine Learning · Computer Science 2020-01-30 Andrew Gordon Wilson

Especially when facing reliability data with limited information (e.g., a small number of failures), there are strong motivations for using Bayesian inference methods. These include the option to use information from physics-of-failure or…

Methodology · Statistics 2022-10-27 Qinglong Tian , Colin Lewis-Beck , Jarad Niemi , William Meeker

The vast majority of the literature on learning dynamical systems or stochastic processes from time series has focused on stable or ergodic systems, for both Bayesian and frequentist inference procedures. However, most real-world systems…

Machine Learning · Statistics 2025-07-02 Zachary P Adams , Sayan Mukherjee

We propose a meta-learning approach that learns from multiple tasks in a transductive setting, by leveraging the unlabeled query set in addition to the support set to generate a more powerful model for each task. To develop our framework,…

Machine Learning · Computer Science 2020-04-28 Shell Xu Hu , Pablo G. Moreno , Yang Xiao , Xi Shen , Guillaume Obozinski , Neil D. Lawrence , Andreas Damianou

In Bayesian meta-analysis, the specification of prior probabilities for the between-study heterogeneity is commonly required, and is of particular benefit in situations where only few studies are included. Among the considerations in the…

Methodology · Statistics 2023-06-02 Christian Röver , Sibylle Sturtz , Jona Lilienthal , Ralf Bender , Tim Friede

It is recognised that the Bayesian approach to inference can not adequately cope with all the types of pre-data beliefs about population quantities of interest that are commonly held in practice. In particular, it generally encounters…

Methodology · Statistics 2021-04-16 Russell J. Bowater

The authors propose a robust semi-parametric empirical likelihood method to integrate all available information from multiple samples with a common center of measurements. Two different sets of estimating equations are used to improve the…

Methodology · Statistics 2012-10-03 Hsiao-Hsuan Wang , Yuehua Wu , Yuejiao Fu , Xiaogang Wang

Bayesian models provide recursive inference naturally because they can formally reconcile new data and existing scientific information. However, popular use of Bayesian methods often avoids priors that are based on exact posterior…

Methodology · Statistics 2019-04-29 Mevin B. Hooten , Devin S. Johnson , Brian M. Brost

There is significant growth and interest in the use of synthetic data as an enabler for machine learning in environments where the release of real data is restricted due to privacy or availability constraints. Despite a large number of…

Machine Learning · Computer Science 2020-11-25 Harrison Wilde , Jack Jewson , Sebastian Vollmer , Chris Holmes

We propose a general formalism of iterated random functions with semigroup property, under which exact and approximate Bayesian posterior updates can be viewed as specific instances. A convergence theory for iterated random functions is…

Machine Learning · Statistics 2013-11-05 Arash A. Amini , XuanLong Nguyen

Bayesian predictive inference analyzes a dataset to make predictions about new observations. When a model does not match the data, predictive accuracy suffers. We develop population empirical Bayes (POP-EB), a hierarchical framework that…

Machine Learning · Statistics 2015-06-10 Alp Kucukelbir , David M. Blei

When prior information is lacking, the go-to strategy for probabilistic inference is to combine a "default prior" and the likelihood via Bayes's theorem. Objective Bayes, (generalized) fiducial inference, etc. fall under this umbrella. This…

Methodology · Statistics 2026-01-05 Ryan Martin

Estimating personalized treatment effects from high-dimensional observational data is essential in situations where experimental designs are infeasible, unethical, or expensive. Existing approaches rely on fitting deep models on outcomes…

Machine Learning · Computer Science 2022-02-02 Andrew Jesson , Panagiotis Tigas , Joost van Amersfoort , Andreas Kirsch , Uri Shalit , Yarin Gal

Bayesian nonparametric models offer a flexible and powerful framework for statistical model selection, enabling the adaptation of model complexity to the intricacies of diverse datasets. This survey intends to delve into the significance of…

Machine Learning · Computer Science 2024-04-02 Bahman Moraffah

We investigate the data distribution valuation problem, which aims to quantify the values of data distributions from their samples. This is a recently proposed problem that is related to but different from classical data valuation and can…

Machine Learning · Computer Science 2026-04-08 Cuong N. Nguyen , Cuong V. Nguyen

Practical Bayesian learning often requires (1) online inference, (2) dynamic models, and (3) ensembling over multiple different models. Recent advances have shown how to use random feature approximations to achieve scalable, online…

Machine Learning · Computer Science 2024-05-03 Daniel Waxman , Petar M. Djurić

Transfer learning is a machine learning paradigm where knowledge from one problem is utilized to solve a new but related problem. While conceivable that knowledge from one task could be useful for solving a related task, if not executed…

Machine Learning · Computer Science 2021-10-01 Xuetong Wu , Jonathan H. Manton , Uwe Aickelin , Jingge Zhu

In order to improve classification accuracy different image representations are usually combined. This can be done by using two different fusing schemes. In feature level fusion schemes, image representations are combined before the…

Computer Vision and Pattern Recognition · Computer Science 2012-07-17 Can Demirkesen , Hocine Cherifi

The use of Bayesian information criterion (BIC) in the model selection procedure is under the assumption that the observations are independent and identically distributed (i.i.d.). However, in practice, we do not always have i.i.d. samples.…

Applications · Statistics 2021-05-03 Nan Shen , Bárbara González

Survey data are often collected under multistage sampling designs where units are binned to clusters that are sampled in a first stage. The unit-indexed population variables of interest are typically dependent within cluster. We propose a…

Methodology · Statistics 2021-08-26 Luis G. Leon-Novelo , Terrance D. Savitsky