English
Related papers

Related papers: Classical vs. Bayesian methods for linear system i…

200 papers

We propose a principled framework for nonparametric empirical Bayes (EB) estimation, based on the idea that the prior should be consistent with the observed posterior and that Bayesian updating should be stable. Focusing on discretized…

Methodology · Statistics 2025-07-14 Valentino Dardanoni , Stefano Demichelis

This paper offers a comprehensive introduction to Bayesian inference, combining historical context, theoretical foundations, and core analytical examples. Beginning with Bayes' theorem and the philosophical distinctions between Bayesian and…

Methodology · Statistics 2025-12-08 Juan Sosa , Carlos A. Martínez , Danna Cruz

We demonstrate how data fission, a method for creating synthetic replicates from single observations, can be applied to empirical Bayes estimation. This extends recent work on empirical Bayes with multiple replicates to the classical…

Methodology · Statistics 2024-10-17 Nikolaos Ignatiadis , Dennis L. Sun

In many instances, the application of approximate Bayesian methods is hampered by two practical features: 1) the requirement to project the data down to low-dimensional summary, including the choice of this projection, which ultimately…

Methodology · Statistics 2020-06-26 David T. Frazier

The idea to distinguish and quantify two important types of uncertainty, often referred to as aleatoric and epistemic, has received increasing attention in machine learning research in the last couple of years. In this paper, we consider…

Machine Learning · Computer Science 2021-12-13 Mohammad Hossein Shaker , Eyke Hüllermeier

Empirical Bayes methods are widely used for large-scale inference, yet most classical approaches assume homoscedastic observations and focus primarily on posterior mean estimation. We develop a nonparametric empirical Bayes framework for…

Methodology · Statistics 2026-04-24 Zhigen Zhao , Shonosuke Sugaasawa

We present a Bayesian methodology for infinite as well as finite dimensional parameter identification for partial differential equation models. The Bayesian framework provides a rigorous mathematical framework for incorporating prior…

Quantitative Methods · Quantitative Biology 2016-05-17 Eduard Campillo-Funollet , Chandrasekhar Venkataraman , Anotida Madzvamuse

Regularized system identification has become a significant complement to more classical system identification. It has been numerically shown that kernel-based regularized estimators often perform better than the maximum likelihood estimator…

Machine Learning · Statistics 2025-03-18 Yue Ju , Bo Wahlberg , Håkan Hjalmarsson

Empirical Bayes is a versatile approach to `learn from a lot' in two ways: first, from a large number of variables and second, from a potentially large amount of prior information, e.g. stored in public repositories. We review applications…

Methodology · Statistics 2018-03-19 Mark A. van de Wiel , Dennis E. te Beest , Magnus Münch

We describe two different approaches for incorporating systematics into analyses for parameter determination in the physical sciences. We refer to these as the Pragmatic and the Full methods, with the latter coming in two variants: Full…

High Energy Physics - Experiment · Physics 2023-06-09 David van Dyk , Louis Lyons

This report introduces general ideas and some basic methods of the Bayesian probability theory applied to physics measurements. Our aim is to make the reader familiar, through examples rather than rigorous formalism, with concepts such as:…

Data Analysis, Statistics and Probability · Physics 2009-11-10 G. D'Agostini

Empirical analysis serves as an important complement to theoretical analysis for studying practical Bayesian optimization. Often empirical insights expose strengths and weaknesses inaccessible to theoretical analysis. We define two metrics…

Machine Learning · Computer Science 2016-04-01 Ian Dewancker , Michael McCourt , Scott Clark , Patrick Hayes , Alexandra Johnson , George Ke

Bayesian estimation is a powerful theoretical paradigm for the operation of quantum sensors. However, the Bayesian method for statistical inference generally suffers from demanding calibration requirements that have so far restricted its…

Quantum Physics · Physics 2021-09-22 Samuel P. Nolan , Augusto Smerzi , Luca Pezzè

Solving symmetric Bayesian decision problems is a computationally intensive task to perform regardless of the algorithm used. In this paper we propose a method for improving the efficiency of algorithms for solving Bayesian decision…

Artificial Intelligence · Computer Science 2013-01-30 Anders L. Madsen , Finn Verner Jensen

This paper considers the problem of making statistical inferences about a parameter when a narrow interval centred at a given value of the parameter is considered special, which is interpreted as meaning that there is a substantial degree…

Statistics Theory · Mathematics 2018-09-07 Russell J. Bowater , Ludmila E. Guzmán-Pantoja

We discuss the use of empirical Bayes for data integration, in the sense of transfer learning. Our main interest is in settings where one wishes to learn structure (e.g. feature selection) and one only has access to incomplete data from…

Methodology · Statistics 2026-02-06 Paul Rognon-Vael , David Rossell

The Bayesian Classification represents a supervised learning method as well as a statistical method for classification. Assumes an underlying probabilistic model and it allows us to capture uncertainty about the model in a principled way by…

Machine Learning · Computer Science 2014-04-04 Vikramkumar , Vijaykumar B , Trilochan

We provide a brief overview of both Bayes and classical model selection. We argue tentatively that model selection has at least two major goals, that of finding the correct model or predicting well, and that in general both these goals may…

Statistics Theory · Mathematics 2015-10-05 Ritabrata Dutta , Malgortaza Bogdan , Jayanta K. Ghosh

The application of Bayesian methods in cosmology and astrophysics has flourished over the past decade, spurred by data sets of increasing size and complexity. In many respects, Bayesian methods have proven to be vastly superior to more…

Astrophysics · Physics 2009-06-23 Roberto Trotta

Fueled by the call for formative assessments, diagnostic classification models (DCMs) have recently gained popularity in psychometrics. Despite their potential for providing diagnostic information that aids in classroom instruction and…

Computation · Statistics 2022-08-26 Motonori Oka , Kensuke Okada