English
Related papers

Related papers: On Mixing Rates for Bayesian CART

200 papers

Tree-based regression and classification has become a standard tool in modern data science. Bayesian Additive Regression Trees (BART) has in particular gained wide popularity due its flexibility in dealing with interactions and non-linear…

Computation · Statistics 2022-09-13 Alan Inglis , Andrew Parnell , Catherine Hurley

The Bayesian additive regression trees (BART) model is an ensemble method extensively and successfully used in regression tasks due to its consistently strong predictive performance and its ability to quantify uncertainty. BART combines…

Methodology · Statistics 2023-09-18 Mateus Maia , Keefe Murphy , Andrew C. Parnell

In Bayesian learning of Gaussian graphical model structure, it is common to restrict attention to certain classes of graphs and approximate the posterior distribution by repeatedly moving from one graph to another, using MCMC or methods…

Machine Learning · Statistics 2021-09-01 Edmund Jones

Variable selection remains a fundamental challenge in statistics, especially in nonparametric settings where model complexity can obscure interpretability. Bayesian tree ensembles, particularly the popular Bayesian additive regression trees…

Methodology · Statistics 2025-09-10 Shengbin Ye , Meng Li

Bayesian Additive Regression Trees (BART) is a nonparametric Bayesian regression technique based on an ensemble of decision trees. It is part of the toolbox of many statisticians. The overall statistical quality of the regression is…

Machine Learning · Statistics 2025-07-10 Giacomo Petrillo

Although it is an extremely effective, easy-to-use, and increasingly popular tool for nonparametric regression, the Bayesian Additive Regression Trees (BART) model is limited by the fact that it can only produce discontinuous output.…

Methodology · Statistics 2025-08-08 Ryan Yee , Soham Ghosh , Sameer K. Deshpande

We perform Bayesian optimization using a Gaussian process perspective on Bayesian Additive Regression Trees (BART). Our BART Kernel (BARK) uses tree agreement to define a posterior over piecewise-constant functions, and we explore the space…

Machine Learning · Computer Science 2025-06-09 Toby Boyne , Jose Pablo Folch , Robert M Lee , Behrang Shafei , Ruth Misener

Current implementations of Bayesian Additive Regression Trees (BART) are based on axis-aligned decision rules that recursively partition the feature space using a single feature at a time. Several authors have demonstrated that oblique…

Machine Learning · Statistics 2024-11-14 Paul-Hieu V. Nguyen , Ryan Yee , Sameer K. Deshpande

For the discovery of regression relationships between Y and a large set of p potential predictors x 1 , . . . , x p , the flexible nonparametric nature of BART (Bayesian Additive Regression Trees) allows for a much richer set of…

Other Statistics · Statistics 2021-10-11 Hugh A. Chipman , Edward I. George , Robert E. McCulloch , Thomas S. Shively

Bayesian phylogenetic inference is currently done via Markov chain Monte Carlo (MCMC) with simple proposal mechanisms. This hinders exploration efficiency and often requires long runs to deliver accurate posterior estimates. In this paper,…

Machine Learning · Statistics 2024-05-24 Cheng Zhang , Frederick A. Matsen

Accuracy and interpretability of a (non-life) insurance pricing model are essential qualities to ensure fair and transparent premiums for policy-holders, that reflect their risk. In recent years, the classification and regression trees…

Machine Learning · Statistics 2023-12-04 Yaojun Zhang , Lanpeng Ji , Georgios Aivaliotis , Charles Taylor

Bayesian Additive Regression Trees (BART) is a fully Bayesian approach to modeling with ensembles of trees. BART can uncover complex regression functions with high dimensional regressors in a fairly automatic way and provide Bayesian…

Machine Learning · Statistics 2018-07-11 Edward George , Prakash Laud , Brent Logan , Robert McCulloch , Rodney Sparapani

Since their inception in the 1980's, regression trees have been one of the more widely used non-parametric prediction methods. Tree-structured methods yield a histogram reconstruction of the regression surface, where the bins correspond to…

Statistics Theory · Mathematics 2019-06-17 Veronika Rockova , Stephanie van der Pas

Bayesian additive regression trees (BART) is a flexible prediction model/machine learning approach that has gained widespread popularity in recent years. As BART becomes more mainstream, there is an increased need for a paper that walks…

Applications · Statistics 2025-09-18 Yaoyuan Vincent Tan , Jason Roy

Bayesian Additive Regression Trees (BART) is a powerful statistical model that leverages the strengths of Bayesian inference and regression trees. It has received significant attention for capturing complex non-linear relationships and…

Machine Learning · Statistics 2026-04-01 Seokhun Park , Insung Kong , Yongdai Kim

Decision trees are flexible models that are well suited for many statistical regression problems. In a Bayesian framework for regression trees, Markov Chain Monte Carlo (MCMC) search algorithms are required to generate samples of tree…

Machine Learning · Statistics 2020-10-27 Reza Mohammadi , Matthew Pratola , Maurits Kaptein

This paper develops a novel stochastic tree ensemble method for nonlinear regression, which we refer to as XBART, short for Accelerated Bayesian Additive Regression Trees. By combining regularization and stochastic search strategies from…

Machine Learning · Statistics 2021-06-04 Jingyu He , P. Richard Hahn

We develop a semiparametric framework for inference on the mean response in missing-data settings using a corrected posterior distribution. Our approach is tailored to Bayesian Additive Regression Trees (BART), which is a powerful…

Methodology · Statistics 2025-10-21 Christoph Breunig , Ruixuan Liu , Zhengfei Yu

Motivated by the remarkable success of Bayesian additive regression trees (BART) in regression modelling, we propose a novel nonparametric Bayesian method, termed Functional BART (FBART), tailored specifically for function-on-scalar…

Methodology · Statistics 2025-06-03 Jiahao Cao , Shiyuan He , Bohai Zhang

Bayesian Decision Trees (DTs) are generally considered a more advanced and accurate model than a regular Decision Tree (DT) because they can handle complex and uncertain data. Existing work on Bayesian DTs uses Markov Chain Monte Carlo…

Machine Learning · Computer Science 2023-05-31 Efthyvoulos Drousiotis , Alexander M. Phillips , Paul G. Spirakis , Simon Maskell