English
Related papers

Related papers: XBART: Accelerated Bayesian Additive Regression Tr…

200 papers

Additive regression trees are flexible non-parametric models and popular off-the-shelf tools for real-world non-linear regression. In application domains, such as bioinformatics, where there is also demand for probabilistic predictions with…

Machine Learning · Statistics 2015-02-17 Balaji Lakshminarayanan , Daniel M. Roy , Yee Whye Teh

We present a Bayesian nonparametric model for conditional distribution estimation using Bayesian additive regression trees (BART). The generative model we use is based on rejection sampling from a base model. Typical of BART models, our…

Methodology · Statistics 2022-02-02 Yinpu Li , Antonio R. Linero , Jared S. Murray

There is currently a dearth of appropriate methods to estimate the causal effects of multiple treatments when the outcome is binary. For such settings, we propose the use of nonparametric Bayesian modeling, Bayesian Additive Regression…

Methodology · Statistics 2020-03-02 Chenyang Gu , Michael J. Lopez , Liangyuan Hu

We incorporate heteroskedasticity into Bayesian Additive Regression Trees (BART) by modeling the log of the error variance parameter as a linear function of prespecified covariates. Under this scheme, the Gibbs sampling procedure for the…

Methodology · Statistics 2014-02-24 Justin Bleich , Adam Kapelner

In this paper we develop the randomized Sharded Bayesian Additive Regression Trees (SBT) model. We introduce a randomization auxiliary variable and a sharding tree to decide partitioning of data, and fit each partition component to a…

Machine Learning · Statistics 2023-06-02 Hengrui Luo , Matthew T. Pratola

Distribution regression, where the goal is to predict a scalar response from a distribution-valued predictor, arises naturally in settings where observations are grouped and outcomes depend on group-level characteristics rather than on…

Methodology · Statistics 2026-03-09 Antonio R. Linero , Soumyabrata Bose , Jared Murray

In the era of precision medicine, genome-wide epigenetic modifications offer rich data that could inform risk prediction. However, these data are high-dimensional and exhibit complex dependence structures, which makes it difficult to…

Applications · Statistics 2026-05-25 Saurabh Bhandari , Parveen Bhatti , Brian C. -H. Chiu , Yuan Ji

We present a method for incorporating missing data in non-parametric statistical learning without the need for imputation. We focus on a tree-based method, Bayesian Additive Regression Trees (BART), enhanced with "Missingness Incorporated…

Machine Learning · Statistics 2014-02-14 Adam Kapelner , Justin Bleich

Medical prediction applications often need to deal with small sample sizes compared to the number of covariates. Such data pose problems for prediction and variable selection, especially when the covariate-response relationship is…

Machine Learning · Statistics 2024-11-05 Jeroen M. Goedhart , Thomas Klausch , Jurriaan Janssen , Mark A. van de Wiel

Techniques to reduce the energy burden of an industrial ecosystem often require solving a multiobjective optimization problem. However, collecting experimental data can often be either expensive or time-consuming. In such cases, statistical…

Machine Learning · Computer Science 2021-09-07 Akira Horiguchi , Thomas J. Santner , Ying Sun , Matthew T. Pratola

We develop a semiparametric framework for inference on the mean response in missing-data settings using a corrected posterior distribution. Our approach is tailored to Bayesian Additive Regression Trees (BART), which is a powerful…

Methodology · Statistics 2025-10-21 Christoph Breunig , Ruixuan Liu , Zhengfei Yu

For the discovery of regression relationships between Y and a large set of p potential predictors x 1 , . . . , x p , the flexible nonparametric nature of BART (Bayesian Additive Regression Trees) allows for a much richer set of…

Other Statistics · Statistics 2021-10-11 Hugh A. Chipman , Edward I. George , Robert E. McCulloch , Thomas S. Shively

Bayesian Additive Regression Trees (BART) has gained widespread popularity, inspiring numerous extensions across diverse applications. However, relatively little attention has been given to modeling dependent data. To fill this gap, we…

Methodology · Statistics 2025-09-17 Xuetao Lu a , Robert E. McCulloch

Bayesian Additive Regression Trees (BART) is a popular Bayesian non-parametric regression algorithm. The posterior is a distribution over sums of decision trees, and predictions are made by averaging approximate samples from the posterior.…

Machine Learning · Statistics 2022-10-19 Omer Ronen , Theo Saarinen , Yan Shuo Tan , James Duncan , Bin Yu

We apply Bayesian Additive Regression Tree (BART) principles to training an ensemble of small neural networks for regression tasks. Using Markov Chain Monte Carlo, we sample from the posterior distribution of neural networks that have a…

Machine Learning · Statistics 2024-04-09 Danielle Van Boxel

This article proposes Multinomial Probit Bayesian Additive Regression Trees (MPBART) as a multinomial probit extension of BART - Bayesian Additive Regression Trees (Chipman et al (2010)). MPBART is flexible to allow inclusion of predictors…

Machine Learning · Statistics 2016-02-09 Bereket P. Kindo , Hao Wang , Edsel A. Peña

Vector autoregressive (VAR) models assume linearity between the endogenous variables and their lags. This assumption might be overly restrictive and could have a deleterious impact on forecasting accuracy. As a solution, we propose…

Econometrics · Economics 2021-03-10 Florian Huber , Luca Rossini

In recent years, theoretical results and simulation evidence have shown Bayesian additive regression trees to be a highly-effective method for nonparametric regression. Motivated by cost-effectiveness analyses in health economics, where…

We consider the task of discovering gene regulatory networks, which are defined as sets of genes and the corresponding transcription factors which regulate their expression levels. This can be viewed as a variable selection problem,…

Methodology · Statistics 2014-12-04 Justin Bleich , Adam Kapelner , Edward I. George , Shane T. Jensen

Flexibly modeling how an entire density changes with covariates is an important but challenging generalization of mean and quantile regression. While existing methods for density regression primarily consist of covariate-dependent discrete…

Methodology · Statistics 2021-12-24 Vittorio Orlandi , Jared Murray , Antonio Linero , Alexander Volfovsky