English
Related papers

Related papers: GS-BART: Bayesian Additive Regression Trees with G…

200 papers

We develop a semiparametric framework for inference on the mean response in missing-data settings using a corrected posterior distribution. Our approach is tailored to Bayesian Additive Regression Trees (BART), which is a powerful…

Methodology · Statistics 2025-10-21 Christoph Breunig , Ruixuan Liu , Zhengfei Yu

Decision trees are prized for their interpretability and strong performance on tabular data. Yet, their reliance on simple axis-aligned linear splits often forces deep, complex structures to capture non-linear feature effects, undermining…

Machine Learning · Computer Science 2025-10-23 Nakul Upadhya , Eldan Cohen

We show how to construct the implied copula process of response values from a Bayesian additive regression tree (BART) model with prior on the leaf node variances. This copula process, defined on the covariate space, can be paired with any…

Methodology · Statistics 2026-01-14 Jan Martin Wenkel , Michael Stanley Smith , Nadja Klein

Bayesian regression trees are flexible non-parametric models that are well suited to many modern statistical regression problems. Many such tree models have been proposed, from the simple single- tree model to more complex tree ensembles.…

Computation · Statistics 2013-12-09 M. T. Pratola

Bayesian Additive Regression Trees (BART) is a popular Bayesian non-parametric regression algorithm. The posterior is a distribution over sums of decision trees, and predictions are made by averaging approximate samples from the posterior.…

Machine Learning · Statistics 2022-10-19 Omer Ronen , Theo Saarinen , Yan Shuo Tan , James Duncan , Bin Yu

Count-compositional data arise in many different fields, including high-throughput sequencing experiments, ecological surveys, and palaeoclimate studies, where a common, important goal is to understand how covariates relate to the observed…

Methodology · Statistics 2026-04-10 André F. B. Menezes , Andrew C. Parnell , Keefe Murphy

This paper introduces BART-RDD, a sum-of-trees regression model built around a novel regression tree prior, which incorporates the special covariate structure of regression discontinuity designs. Specifically, the tree splitting process is…

Methodology · Statistics 2024-07-22 Rafael Alcantara , Meijia Wang , P. Richard Hahn , Hedibert Lopes

Prediction is a classic challenge in spatial statistics and the inclusion of spatial covariates can greatly improve predictive performance when incorporated into a model with latent spatial effects. It is desirable to develop flexible…

Methodology · Statistics 2025-02-24 Alex Ziyu Jiang , Jon Wakefield

The study of dependence between random variables under external influences is a challenging problem in multivariate analysis. We address this by proposing a novel semi-parametric approach for conditional copula models using Bayesian…

Methodology · Statistics 2026-03-11 Tathagata Basu , Fabrizio Leisen , Cristiano Villa , Kevin Wilson

Ensemble learning is a statistical paradigm built on the premise that many weak learners can perform exceptionally well when deployed collectively. The BART method of Chipman et al. (2010) is a prominent example of Bayesian ensemble…

Machine Learning · Statistics 2018-10-08 Veronika Rockova , Enakshi Saha

This article proposes Multinomial Probit Bayesian Additive Regression Trees (MPBART) as a multinomial probit extension of BART - Bayesian Additive Regression Trees (Chipman et al (2010)). MPBART is flexible to allow inclusion of predictors…

Machine Learning · Statistics 2016-02-09 Bereket P. Kindo , Hao Wang , Edsel A. Peña

Regression trees are a popular machine learning algorithm that fit piecewise constant models by recursively partitioning the predictor space. This paper focuses on statistical inference for a data-dependent model obtained from a fitted…

Methodology · Statistics 2025-12-17 Soham Bakshi , Yiling Huang , Snigdha Panigrahi , Walter Dempsey

In longitudinal observational studies with time-to-event outcomes, a common objective in causal analysis is to estimate the causal survival curve under hypothetical intervention scenarios. The g-formula is a useful tool for this analysis.…

Methodology · Statistics 2025-04-14 Xinyuan Chen , Liangyuan Hu , Fan Li

Most clinical trials involve the comparison of a new treatment to a control arm (e.g., the standard of care) and the estimation of a treatment effect. External data, including historical clinical trial data and real-world observational…

Methodology · Statistics 2021-03-17 Tianjian Zhou , Yuan Ji

When dealing with tabular data, models based on decision trees are a popular choice due to their high accuracy on these data types, their ease of application, and explainability properties. However, when it comes to graph-structured data,…

Machine Learning · Computer Science 2024-02-27 Maya Bechler-Speicher , Amir Globerson , Ran Gilad-Bachrach

There is a dearth of robust methods to estimate the causal effects of multiple treatments when the outcome is binary. This paper uses two unique sets of simulations to propose and evaluate the use of Bayesian Additive Regression Trees…

Methodology · Statistics 2020-01-22 Liangyuan Hu , Chenyang Gu , Michael Lopez , Jiayi Ji , Juan Wisnivesky

Many asymptotically minimax procedures for function estimation often rely on somewhat arbitrary and restrictive assumptions such as isotropy or spatial homogeneity. This work enhances the theoretical understanding of Bayesian additive…

Statistics Theory · Mathematics 2023-12-05 Seonghyun Jeong , Veronika Rockova

We perform Bayesian optimization using a Gaussian process perspective on Bayesian Additive Regression Trees (BART). Our BART Kernel (BARK) uses tree agreement to define a posterior over piecewise-constant functions, and we explore the space…

Machine Learning · Computer Science 2025-06-09 Toby Boyne , Jose Pablo Folch , Robert M Lee , Behrang Shafei , Ruth Misener

The success of Bayesian inference with MCMC depends critically on Markov chains rapidly reaching the posterior distribution. Despite the plentitude of inferential theory for posteriors in Bayesian non-parametrics, convergence properties of…

Statistics Theory · Mathematics 2023-06-02 Jungeum Kim , Veronika Rockova

Gradient Boosted Decision Trees (GBDT) is a very successful ensemble learning algorithm widely used across a variety of applications. Recently, several variants of GBDT training algorithms and implementations have been designed and heavily…

Machine Learning · Computer Science 2019-06-27 Yu Shi , Jian Li , Zhize Li