English
Related papers

Related papers: Divide, Conquer, Combine Bayesian Decision Tree Sa…

200 papers

Specifying a full Bayesian model that integrates multiple data sources can be challenging. One natural approach is to specify each individual model separately and join them afterwards. This is the approach adopted in Markov melding.…

Methodology · Statistics 2026-05-22 Yixuan Liu , Robert J. B. Goudie

Bayesian analysis often concerns an evaluation of models with different dimensionality as is necessary in, for example, model selection or mixture models. To facilitate this evaluation, transdimensional Markov chain Monte Carlo (MCMC)…

Methodology · Statistics 2018-08-13 Daniel W. Heck , Antony M. Overstall , Quentin F. Gronau , Eric-Jan Wagenmakers

Decision Trees are some of the most popular machine learning models today due to their out-of-the-box performance and interpretability. Often, Decision Trees models are constructed greedily in a top-down fashion via heuristic search…

Machine Learning · Computer Science 2023-02-16 Colin Sullivan , Mo Tiwari , Sebastian Thrun , Chris Piech

A new Bayesian modelling framework is introduced for piece-wise homogeneous variable-memory Markov chains, along with a collection of effective algorithmic tools for change-point detection and segmentation of discrete time series. Building…

Methodology · Statistics 2025-01-14 Valentinian Lungu , Ioannis Papageorgiou , Ioannis Kontoyiannis

Few problems in statistics are as perplexing as variable selection in the presence of very many redundant covariates. The variable selection problem is most familiar in parametric environments such as the linear model or additive variants…

Methodology · Statistics 2021-02-25 Yi Liu , Veronika Ročková , Yuexi Wang

We present a novel Bayesian inference tool that uses a neural network to parameterise efficient Markov Chain Monte-Carlo (MCMC) proposals. The target distribution is first transformed into a diagonal, unit variance Gaussian by a series of…

Cosmology and Nongalactic Astrophysics · Physics 2020-06-03 Adam Moss

Markov chain Monte Carlo (MCMC) is the predominant tool used in Bayesian parameter estimation for hierarchical models. When the model expands due to an increasing number of hierarchical levels, number of groups at a particular level, or…

Computation · Statistics 2016-06-22 Will Landau , Jarad Niemi

Phylogenetic analyses which include fossils or molecular sequences that are sampled through time require models that allow one sample to be a direct ancestor of another sample. As previously available phylogenetic inference tools assume…

Populations and Evolution · Quantitative Biology 2014-12-08 Alexandra Gavryushkina , David Welch , Tanja Stadler , Alexei Drummond

Bayesian inference in deep neural networks is challenging due to the high-dimensional, strongly multi-modal parameter posterior density landscape. Markov chain Monte Carlo approaches asymptotically recover the true posterior but are…

In Bayesian phylogenetics, our goal is to estimate the posterior distribution over phylogenetic trees. Markov chain Monte Carlo methods are widely used to approximate the phylogenetic posterior distributions. For large-scale sequence data,…

Methodology · Statistics 2026-05-12 Wentao Yu , Shijia Wang

For Bayesian computation in big data contexts, the divide-and-conquer MCMC concept splits the whole data set into batches, runs MCMC algorithms separately over each batch to produce samples of parameters, and combines them to produce an…

Computation · Statistics 2019-11-25 Wu Changye , Christian P. Robert

Monte-Carlo Tree Search (MCTS) methods are drawing great interest after yielding breakthrough results in computer Go. This paper proposes a Bayesian approach to MCTS that is inspired by distributionfree approaches such as UCT [13], yet…

Machine Learning · Computer Science 2012-03-19 Gerald Tesauro , V T Rajan , Richard Segal

Markov chain Monte Carlo (MCMC) has transformed Bayesian model inference over the past three decades: mainly because of this, Bayesian inference is now a workhorse of applied scientists. Under general conditions, MCMC sampling converges…

Methodology · Statistics 2020-11-20 Ben Lambert , Aki Vehtari

We consider the analysis of sets of categorical sequences consisting of piecewise homogeneous Markov segments. The sequences are assumed to be governed by a common underlying process with segments occurring in the same order for each…

Methodology · Statistics 2015-04-08 Petter Arnesen , Tracy Holsclaw , Padhraic Smyth

Bayesian inference is a popular and widely-used approach to infer phylogenies (evolutionary trees). However, despite decades of widespread application, it remains difficult to judge how well a given Bayesian Markov chain Monte Carlo (MCMC)…

Methodology · Statistics 2022-09-07 Andrew F. Magee , Michael D. Karcher , Frederick A. Matsen , Vladimir N. Minin

Bayesian hierarchical modeling is a popular approach to capturing unobserved heterogeneity across individual units. However, standard estimation methods such as Markov chain Monte Carlo (MCMC) can be impracticable for modeling outcomes from…

Methodology · Statistics 2014-11-04 Michael Braun , Paul Damien

We present a comprehensive comparison of different Markov Chain Monte Carlo (MCMC) sampling methods, evaluating their performance on both standard test problems and cosmological parameter estimation. Our analysis includes traditional…

Cosmology and Nongalactic Astrophysics · Physics 2025-02-28 Denitsa Staicova

This paper introduces a Bayesian framework that combines Markov chain Monte Carlo (MCMC) sampling, dimensionality reduction, and neural density estimation to efficiently handle inverse problems that (i) must be solved multiple times, and…

Computational Engineering, Finance, and Science · Computer Science 2026-02-24 Giacomo Bottacini , Matteo Torzoni , Andrea Manzoni

The combinatorial sequential Monte Carlo (CSMC) has been demonstrated to be an efficient complementary method to the standard Markov chain Monte Carlo (MCMC) for Bayesian phylogenetic tree inference using biological sequences. It is…

Computation · Statistics 2020-08-12 Shijia Wang , Liangliang Wang

Markov chain Monte Carlo (MCMC) methods have not been broadly adopted in Bayesian neural networks (BNNs). This paper initially reviews the main challenges in sampling from the parameter posterior of a neural network via MCMC. Such…

Machine Learning · Statistics 2021-10-05 Theodore Papamarkou , Jacob Hinkle , M. Todd Young , David Womble