English
Related papers

Related papers: Variable Selection Using Bayesian Additive Regress…

200 papers

We provide a new flexible framework for inference with the instrumental variable model. Rather than using linear specifications, functions characterizing the effects of instruments and other explanatory variables are estimated using machine…

Machine Learning · Statistics 2021-02-03 Robert E. McCulloch , Rodney A. Sparapani , Brent R. Logan , Purushottam W. Laud

BCART (Bayesian Classification and Regression Trees) and BART (Bayesian Additive Regression Trees) are popular Bayesian regression models widely applicable in modern regression problems. Their popularity is intimately tied to the ability to…

Methodology · Statistics 2023-05-19 Matthew T. Pratola , Edward I. George , Robert E. McCulloch

We present a new package in R implementing Bayesian additive regression trees (BART). The package introduces many new features for data analysis using BART such as variable selection, interaction detection, model diagnostic plots,…

Machine Learning · Statistics 2014-11-25 Adam Kapelner , Justin Bleich

Current implementations of Bayesian Additive Regression Trees (BART) are based on axis-aligned decision rules that recursively partition the feature space using a single feature at a time. Several authors have demonstrated that oblique…

Machine Learning · Statistics 2024-11-14 Paul-Hieu V. Nguyen , Ryan Yee , Sameer K. Deshpande

In modern computer experiment applications, one often encounters the situation where various models of a physical system are considered, each implemented as a simulator on a computer. An important question in such a setting is determining…

Methodology · Statistics 2023-05-08 John C. Yannotty , Thomas J. Santner , Richard J. Furnstahl , Matthew T. Pratola

Motivated by the remarkable success of Bayesian additive regression trees (BART) in regression modelling, we propose a novel nonparametric Bayesian method, termed Functional BART (FBART), tailored specifically for function-on-scalar…

Methodology · Statistics 2025-06-03 Jiahao Cao , Shiyuan He , Bohai Zhang

Medical prediction applications often need to deal with small sample sizes compared to the number of covariates. Such data pose problems for prediction and variable selection, especially when the covariate-response relationship is…

Machine Learning · Statistics 2024-11-05 Jeroen M. Goedhart , Thomas Klausch , Jurriaan Janssen , Mark A. van de Wiel

In the era of precision medicine, genome-wide epigenetic modifications offer rich data that could inform risk prediction. However, these data are high-dimensional and exhibit complex dependence structures, which makes it difficult to…

Applications · Statistics 2026-05-25 Saurabh Bhandari , Parveen Bhatti , Brian C. -H. Chiu , Yuan Ji

The effectiveness of Bayesian Additive Regression Trees (BART) has been demonstrated in a variety of contexts including non-parametric regression and classification. A BART scheme for estimating the intensity of inhomogeneous Poisson…

Statistics Theory · Mathematics 2022-11-15 Stamatina Lamprinakou , Mauricio Barahona , Seth Flaxman , Sarah Filippi , Axel Gandy , Emma McCoy

In recent years, theoretical results and simulation evidence have shown Bayesian additive regression trees to be a highly-effective method for nonparametric regression. Motivated by cost-effectiveness analyses in health economics, where…

In this paper we develop the randomized Sharded Bayesian Additive Regression Trees (SBT) model. We introduce a randomization auxiliary variable and a sharding tree to decide partitioning of data, and fit each partition component to a…

Machine Learning · Statistics 2023-06-02 Hengrui Luo , Matthew T. Pratola

We present a Bayesian approach to model cohort-level retention rates and revenue over time. We use Bayesian additive regression trees (BART) to model the retention component which we couple with a linear model for the revenue component.…

Applications · Statistics 2025-04-24 Juan Camilo Orduz

Nonparametric regression models such as Bayesian Additive Regression Trees (BART) can be useful in fitting flexible functions of a set of covariates to a response, while accounting for nonlinearities and interactions. However, they are…

Methodology · Statistics 2018-07-02 Bonifride Tuyishimire , Brent R Logan , Purushottam W Laud

Regression discontinuity designs (RDD) are widely used for causal inference. In many empirical applications, treatment effects vary substantially with covariates, and ignoring such heterogeneity can lead to misleading conclusions, which…

Methodology · Statistics 2026-03-05 Daisuke Kondo , Shonosuke Sugasawa

Bayesian additive regression trees (BART) is a semi-parametric regression model offering state-of-the-art performance on out-of-sample prediction. Despite this success, standard implementations of BART typically provide inaccurate…

Methodology · Statistics 2023-02-27 Meijiang Wang , Jingyu He , P. Richard Hahn

Ensembles of decision trees are a useful tool for obtaining for obtaining flexible estimates of regression functions. Examples of these methods include gradient boosted decision trees, random forests, and Bayesian CART. Two potential…

Methodology · Statistics 2018-09-18 Antonio Ricardo Linero , Yun Yang

Variable selection has played a critical role in modern statistical learning and scientific discoveries. Numerous regularization and Bayesian variable selection methods have been developed in the past two decades for variable selection, but…

Methodology · Statistics 2024-03-04 Travis Canida , Hongjie Ke , Shuo Chen , Zhenayo Ye , Tianzhou Ma

Prediction is a classic challenge in spatial statistics and the inclusion of spatial covariates can greatly improve predictive performance when incorporated into a model with latent spatial effects. It is desirable to develop flexible…

Methodology · Statistics 2025-02-24 Alex Ziyu Jiang , Jon Wakefield

Distribution regression, where the goal is to predict a scalar response from a distribution-valued predictor, arises naturally in settings where observations are grouped and outcomes depend on group-level characteristics rather than on…

Methodology · Statistics 2026-03-09 Antonio R. Linero , Soumyabrata Bose , Jared Murray

This article proposes Multinomial Probit Bayesian Additive Regression Trees (MPBART) as a multinomial probit extension of BART - Bayesian Additive Regression Trees (Chipman et al (2010)). MPBART is flexible to allow inclusion of predictors…

Machine Learning · Statistics 2016-02-09 Bereket P. Kindo , Hao Wang , Edsel A. Peña