English
Related papers

Related papers: Functional BART with Shape Priors: A Bayesian Tree…

200 papers

Flexibly modeling how an entire density changes with covariates is an important but challenging generalization of mean and quantile regression. While existing methods for density regression primarily consist of covariate-dependent discrete…

Methodology · Statistics 2021-12-24 Vittorio Orlandi , Jared Murray , Antonio Linero , Alexander Volfovsky

Bayesian Additive Regression Trees (BART) is a nonparametric Bayesian regression technique of rising fame. It is a sum-of-decision-trees model, and is in some sense the Bayesian version of boosting. In the limit of infinite trees, it…

Machine Learning · Statistics 2025-07-14 Giacomo Petrillo

Many asymptotically minimax procedures for function estimation often rely on somewhat arbitrary and restrictive assumptions such as isotropy or spatial homogeneity. This work enhances the theoretical understanding of Bayesian additive…

Statistics Theory · Mathematics 2023-12-05 Seonghyun Jeong , Veronika Rockova

Ensemble decision tree methods such as XGBoost, Random Forest, and Bayesian Additive Regression Trees (BART) have gained enormous popularity in data science for their superior performance in machine learning regression and classification…

Methodology · Statistics 2025-09-10 Shuren He , Huiyan Sang , Quan Zhou

We propose a simple yet powerful extension of Bayesian Additive Regression Trees which we name Hierarchical Embedded BART (HE-BART). The model allows for random effects to be included at the terminal node level of a set of regression trees,…

Methodology · Statistics 2023-04-25 Bruna Wundervald , Andrew Parnell , Katarina Domijan

This article proposes a novel framework that integrates Bayesian Additive Regression Trees (BART) into a Factor-Augmented Vector Autoregressive (FAVAR) model to forecast macro-financial variables and examine asymmetries in the transmission…

Econometrics · Economics 2025-06-16 Sofia Velasco

Medical prediction applications often need to deal with small sample sizes compared to the number of covariates. Such data pose problems for prediction and variable selection, especially when the covariate-response relationship is…

Machine Learning · Statistics 2024-11-05 Jeroen M. Goedhart , Thomas Klausch , Jurriaan Janssen , Mark A. van de Wiel

In the era of precision medicine, genome-wide epigenetic modifications offer rich data that could inform risk prediction. However, these data are high-dimensional and exhibit complex dependence structures, which makes it difficult to…

Applications · Statistics 2026-05-25 Saurabh Bhandari , Parveen Bhatti , Brian C. -H. Chiu , Yuan Ji

Bayesian additive regression trees have seen increased interest in recent years due to their ability to combine machine learning techniques with principled uncertainty quantification. The Bayesian backfitting algorithm used to fit BART…

Machine Learning · Statistics 2022-02-22 Antonio R. Linero

The effectiveness of Bayesian Additive Regression Trees (BART) has been demonstrated in a variety of contexts including non-parametric regression and classification. A BART scheme for estimating the intensity of inhomogeneous Poisson…

Statistics Theory · Mathematics 2022-11-15 Stamatina Lamprinakou , Mauricio Barahona , Seth Flaxman , Sarah Filippi , Axel Gandy , Emma McCoy

Bayesian Additive Regression Trees (BART) is a statistical sum of trees model. It can be considered a Bayesian version of machine learning tree ensemble methods where the individual trees are the base learners. However for data sets where…

Prediction is a classic challenge in spatial statistics and the inclusion of spatial covariates can greatly improve predictive performance when incorporated into a model with latent spatial effects. It is desirable to develop flexible…

Methodology · Statistics 2025-02-24 Alex Ziyu Jiang , Jon Wakefield

In recent years, theoretical results and simulation evidence have shown Bayesian additive regression trees to be a highly-effective method for nonparametric regression. Motivated by cost-effectiveness analyses in health economics, where…

We present a new package in R implementing Bayesian additive regression trees (BART). The package introduces many new features for data analysis using BART such as variable selection, interaction detection, model diagnostic plots,…

Machine Learning · Statistics 2014-11-25 Adam Kapelner , Justin Bleich

Measurement error is prevalent across all domains of scientific research where only imprecise observations, rather than the true underlying values, can be obtained. For example, estimates of human microbiome diversity are based on small…

Methodology · Statistics 2026-03-10 Kevin McCoy , Zachary Wooten , Christine B. Peterson

Many time-to-event studies are complicated by the presence of competing risks. Such data are often analyzed using Cox models for the cause specific hazard function or Fine-Gray models for the subdistribution hazard. In practice regression…

Methodology · Statistics 2018-07-02 Rodney Sparapani , Brent R. Logan , Robert E. McCulloch , Purushottam W. Laud

We present a novel prior for tree topology within Bayesian Additive Regression Trees (BART) models. This approach quantifies the hypothetical loss in information and the loss due to complexity associated with choosing the wrong tree…

Methodology · Statistics 2024-12-30 F. Serafini , F. Leisen , C. Villa , K. Wilson

We apply Bayesian Additive Regression Tree (BART) principles to training an ensemble of small neural networks for regression tasks. Using Markov Chain Monte Carlo, we sample from the posterior distribution of neural networks that have a…

Machine Learning · Statistics 2024-04-09 Danielle Van Boxel

This paper develops a novel stochastic tree ensemble method for nonlinear regression, which we refer to as XBART, short for Accelerated Bayesian Additive Regression Trees. By combining regularization and stochastic search strategies from…

Machine Learning · Statistics 2021-06-04 Jingyu He , P. Richard Hahn

We incorporate heteroskedasticity into Bayesian Additive Regression Trees (BART) by modeling the log of the error variance parameter as a linear function of prespecified covariates. Under this scheme, the Gibbs sampling procedure for the…

Methodology · Statistics 2014-02-24 Justin Bleich , Adam Kapelner