English
Related papers

Related papers: On the Gaussian process limit of Bayesian Additive…

200 papers

Flexibly modeling how an entire density changes with covariates is an important but challenging generalization of mean and quantile regression. While existing methods for density regression primarily consist of covariate-dependent discrete…

Methodology · Statistics 2021-12-24 Vittorio Orlandi , Jared Murray , Antonio Linero , Alexander Volfovsky

Ensemble learning is a statistical paradigm built on the premise that many weak learners can perform exceptionally well when deployed collectively. The BART method of Chipman et al. (2010) is a prominent example of Bayesian ensemble…

Machine Learning · Statistics 2018-10-08 Veronika Rockova , Enakshi Saha

For the discovery of regression relationships between Y and a large set of p potential predictors x 1 , . . . , x p , the flexible nonparametric nature of BART (Bayesian Additive Regression Trees) allows for a much richer set of…

Other Statistics · Statistics 2021-10-11 Hugh A. Chipman , Edward I. George , Robert E. McCulloch , Thomas S. Shively

Vector autoregressive (VAR) models assume linearity between the endogenous variables and their lags. This assumption might be overly restrictive and could have a deleterious impact on forecasting accuracy. As a solution, we propose…

Econometrics · Economics 2021-03-10 Florian Huber , Luca Rossini

In the era of precision medicine, genome-wide epigenetic modifications offer rich data that could inform risk prediction. However, these data are high-dimensional and exhibit complex dependence structures, which makes it difficult to…

Applications · Statistics 2026-05-25 Saurabh Bhandari , Parveen Bhatti , Brian C. -H. Chiu , Yuan Ji

We present a novel prior for tree topology within Bayesian Additive Regression Trees (BART) models. This approach quantifies the hypothetical loss in information and the loss due to complexity associated with choosing the wrong tree…

Methodology · Statistics 2024-12-30 F. Serafini , F. Leisen , C. Villa , K. Wilson

Many asymptotically minimax procedures for function estimation often rely on somewhat arbitrary and restrictive assumptions such as isotropy or spatial homogeneity. This work enhances the theoretical understanding of Bayesian additive…

Statistics Theory · Mathematics 2023-12-05 Seonghyun Jeong , Veronika Rockova

This paper introduces a generalized ps-BART model for the estimation of Average Treatment Effect (ATE) and Conditional Average Treatment Effect (CATE) in continuous treatments, addressing limitations of the Bayesian Causal Forest (BCF)…

Machine Learning · Statistics 2024-09-11 Hugo Gobato Souto , Francisco Louzada Neto

In light of widespread evidence of parameter instability in macroeconomic models, many time-varying parameter (TVP) models have been proposed. This paper proposes a nonparametric TVP-VAR model using Bayesian additive regression trees (BART)…

Econometrics · Economics 2023-05-08 Niko Hauzenberger , Florian Huber , Gary Koop , James Mitchell

Prediction is a classic challenge in spatial statistics and the inclusion of spatial covariates can greatly improve predictive performance when incorporated into a model with latent spatial effects. It is desirable to develop flexible…

Methodology · Statistics 2025-02-24 Alex Ziyu Jiang , Jon Wakefield

Most implementations of Bayesian additive regression trees (BART) one-hot encode categorical predictors, replacing each one with several binary indicators, one for every level or category. Regression trees built with these indicators…

Methodology · Statistics 2024-08-14 Sameer K. Deshpande

The success of Bayesian inference with MCMC depends critically on Markov chains rapidly reaching the posterior distribution. Despite the plentitude of inferential theory for posteriors in Bayesian non-parametrics, convergence properties of…

Statistics Theory · Mathematics 2023-06-02 Jungeum Kim , Veronika Rockova

We perform Bayesian optimization using a Gaussian process perspective on Bayesian Additive Regression Trees (BART). Our BART Kernel (BARK) uses tree agreement to define a posterior over piecewise-constant functions, and we explore the space…

Machine Learning · Computer Science 2025-06-09 Toby Boyne , Jose Pablo Folch , Robert M Lee , Behrang Shafei , Ruth Misener

In this paper we develop the randomized Sharded Bayesian Additive Regression Trees (SBT) model. We introduce a randomization auxiliary variable and a sharding tree to decide partitioning of data, and fit each partition component to a…

Machine Learning · Statistics 2023-06-02 Hengrui Luo , Matthew T. Pratola

Vector autoregression (VAR) models are widely used for forecasting and macroeconomic analysis, yet they remain limited by their reliance on a linear parameterization. Recent research has introduced nonparametric alternatives, such as…

Methodology · Statistics 2025-03-19 Pedro A. Lima , Carlos M. Carvalho , Hedibert F. Lopes , Andrew Herren

Most clinical trials involve the comparison of a new treatment to a control arm (e.g., the standard of care) and the estimation of a treatment effect. External data, including historical clinical trial data and real-world observational…

Methodology · Statistics 2021-03-17 Tianjian Zhou , Yuan Ji

Distribution regression, where the goal is to predict a scalar response from a distribution-valued predictor, arises naturally in settings where observations are grouped and outcomes depend on group-level characteristics rather than on…

Methodology · Statistics 2026-03-09 Antonio R. Linero , Soumyabrata Bose , Jared Murray

Recognizing the successes of treed Gaussian process (TGP) models as an interpretable and thrifty model for nonparametric regression, we seek to extend the model to classification. Both treed models and Gaussian processes (GPs) have,…

Methodology · Statistics 2010-09-28 Tamara Broderick , Robert B. Gramacy

We present a Bayesian approach to model cohort-level retention rates and revenue over time. We use Bayesian additive regression trees (BART) to model the retention component which we couple with a linear model for the revenue component.…

Applications · Statistics 2025-04-24 Juan Camilo Orduz

This paper introduces BART-RDD, a sum-of-trees regression model built around a novel regression tree prior, which incorporates the special covariate structure of regression discontinuity designs. Specifically, the tree splitting process is…

Methodology · Statistics 2024-07-22 Rafael Alcantara , Meijia Wang , P. Richard Hahn , Hedibert Lopes