English
Related papers

Related papers: On Bayesian Exponentially Embedded Family for Mode…

200 papers

Multistage ranking models, including the popular Plackett-Luce distribution (PL), rely on the assumption that the ranking process is performed sequentially, by assigning the positions from the top to the bottom one (forward order). A recent…

Methodology · Statistics 2020-03-17 Cristina Mollica , Luca Tardella

A Bayesian filtering algorithm is developed for a class of state-space systems that can be modelled via Gaussian mixtures. In general, the exact solution to this filtering problem involves an exponential growth in the number of mixture…

Machine Learning · Statistics 2023-07-03 Adrian G. Wills , Johannes Hendriks , Christopher Renton , Brett Ninness

Prior distributions elicited for modelling the natural fluctuations or the uncertainty on parameters of Bayesian fishery population models, can be chosen among a vast range of statistical laws. Since the statistical framework is defined by…

Statistics Theory · Mathematics 2010-10-12 Nicolas Bousquet

In this paper we develop and study adaptive empirical Bayesian smoothing splines. These are smoothing splines with both smoothing parameter and penalty order determined via the empirical Bayes method from the marginal likelihood of the…

Statistics Theory · Mathematics 2015-11-18 Paulo Serra , Tatyana Krivobokova

Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their…

Machine Learning · Computer Science 2022-02-23 Andrew Wood , Moshik Hershcovitch , Daniel Waddington , Sarel Cohen , Peter Chin

We propose an efficient family of algorithms to learn the parameters of a Bayesian network from incomplete data. In contrast to textbook approaches such as EM and the gradient method, our approach is non-iterative, yields closed form…

Machine Learning · Computer Science 2014-11-26 Guy Van den Broeck , Karthika Mohan , Arthur Choi , Judea Pearl

Mixture model-based clustering has become an increasingly popular data analysis technique since its introduction over fifty years ago, and is now commonly utilized within a family setting. Families of mixture models arise when the component…

Methodology · Statistics 2019-11-11 Sanjeena Subedi , Paul D. McNicholas

Bayesian Likelihood-Free Inference (LFI) approaches allow to obtain posterior distributions for stochastic models with intractable likelihood, by relying on model simulations. In Approximate Bayesian Computation (ABC), a popular LFI method,…

Methodology · Statistics 2022-02-08 Lorenzo Pacchiardi , Ritabrata Dutta

We propose an interdisciplinary framework that combines Bayesian predictive inference, a well-established tool in Machine Learning, with Formal Methods rooted in the computer science community. Bayesian predictive inference allows for…

Computation · Statistics 2025-08-21 Laura Vana , Ennio Visconti , Laura Nenzi , Annalisa Cadonna , Gregor Kastner

We consider penalized regression models under a unified framework where the particular method is determined by the form of the penalty term. We propose a fully Bayesian approach that incorporates both sparse and dense settings and show how…

Methodology · Statistics 2019-07-25 Ding Xiang , Galin L. Jones

Nested error regression models are useful tools for analysis of grouped data, especially in the case of small area estimation. This paper suggests a nested error regression model using uncertain random effects in which the random effect in…

Methodology · Statistics 2017-02-28 Shonosuke Sugasawa , Tatsuya Kubokawa

Inferring the causal structure of a system typically requires interventional data, rather than just observational data. Since interventional experiments can be costly, it is preferable to select interventions that yield the maximum amount…

Methodology · Statistics 2021-03-30 Michele Zemplenyi , Jeffrey W. Miller

Inference and estimation are fundamental in statistics, system identification, and machine learning. When prior knowledge about the system is available, Bayesian analysis provides a natural framework for encoding it through a prior…

Systems and Control · Electrical Eng. & Systems 2025-08-29 Yibo Shi , Braghadeesh Lakshminarayanan , Cristian R. Rojas

Identifying small subsets of features that are relevant for prediction and/or classification tasks is a central problem in machine learning and statistics. The feature selection task is especially important, and computationally difficult,…

Statistical Mechanics · Physics 2014-11-04 Charles K. Fisher , Pankaj Mehta

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2020-09-01 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

We derive a novel generative model from iterative Gaussian posterior inference. By treating the generated sample as an unknown variable, we can formulate the sampling process in the language of Bayesian probability. Our model uses a…

Machine Learning · Computer Science 2026-01-28 Marten Lienen , Marcel Kollovieh , Stephan Günnemann

We describe a new method for evaluating Bayes factors. The key idea is to introduce a hypermodel in which the competing models are components of a mixture distribution. Inference for the mixing probabilities then yields estimates of the…

Methodology · Statistics 2016-02-16 Philip D. O'Neill , Theodore Kypraios

This paper presents a study of the large-sample behavior of the posterior distribution of a structural parameter which is partially identified by moment inequalities. The posterior density is derived based on the limited information…

Statistics Theory · Mathematics 2010-01-13 Yuan Liao , Wenxin Jiang

This thesis responds to the challenges of using a large number, such as thousands, of features in regression and classification problems. There are two situations where such high dimensional features arise. One is when high dimensional…

Machine Learning · Statistics 2007-09-20 Longhai Li

We study model selection by the Bayesian information criterion (BIC) in fixed-dimensional exploratory factor analysis over a fixed finite family of compact covariance classes. Our main result shows that the BIC is strongly consistent for…

Statistics Theory · Mathematics 2026-04-10 Hien Duy Nguyen , Kei Hirose