English
Related papers

Related papers: XBART: Accelerated Bayesian Additive Regression Tr…

200 papers

In modern computer experiment applications, one often encounters the situation where various models of a physical system are considered, each implemented as a simulator on a computer. An important question in such a setting is determining…

Methodology · Statistics 2023-05-08 John C. Yannotty , Thomas J. Santner , Richard J. Furnstahl , Matthew T. Pratola

Ensemble learning is a statistical paradigm built on the premise that many weak learners can perform exceptionally well when deployed collectively. The BART method of Chipman et al. (2010) is a prominent example of Bayesian ensemble…

Machine Learning · Statistics 2018-10-08 Veronika Rockova , Enakshi Saha

Many asymptotically minimax procedures for function estimation often rely on somewhat arbitrary and restrictive assumptions such as isotropy or spatial homogeneity. This work enhances the theoretical understanding of Bayesian additive…

Statistics Theory · Mathematics 2023-12-05 Seonghyun Jeong , Veronika Rockova

The development of driverless vehicles has spurred the need to predict human driving behavior to facilitate interaction between driverless and human-driven vehicles. Predicting human driving movements can be challenging, and poor prediction…

Applications · Statistics 2025-09-16 Yaoyuan Vincent Tan , Carol A. C. Flannagan , Michael R. Elliott

The study of dependence between random variables under external influences is a challenging problem in multivariate analysis. We address this by proposing a novel semi-parametric approach for conditional copula models using Bayesian…

Methodology · Statistics 2026-03-11 Tathagata Basu , Fabrizio Leisen , Cristiano Villa , Kevin Wilson

This paper develops a performant Bayesian approach to conditional average treatment effect (CATE) estimation in regression discontinuity designs (RDD), an increasingly prevalent form of quasi-experiment that facilitates causal inference.…

Methodology · Statistics 2026-05-18 Rafael Alcantara , P. Richard Hahn , Hedibert F. Lopes

Prediction is a classic challenge in spatial statistics and the inclusion of spatial covariates can greatly improve predictive performance when incorporated into a model with latent spatial effects. It is desirable to develop flexible…

Methodology · Statistics 2025-02-24 Alex Ziyu Jiang , Jon Wakefield

General circulation models (GCMs) are essential tools for climate studies. Such climate models may have varying accuracy across the input domain, but no model is uniformly best. One can improve climate model prediction performance by…

Methodology · Statistics 2026-01-27 John C. Yannotty , Thomas J. Santner , Bo Li , Matthew T. Pratola

BCART (Bayesian Classification and Regression Trees) and BART (Bayesian Additive Regression Trees) are popular Bayesian regression models widely applicable in modern regression problems. Their popularity is intimately tied to the ability to…

Methodology · Statistics 2023-05-19 Matthew T. Pratola , Edward I. George , Robert E. McCulloch

We show how to construct the implied copula process of response values from a Bayesian additive regression tree (BART) model with prior on the leaf node variances. This copula process, defined on the covariate space, can be paired with any…

Methodology · Statistics 2026-01-14 Jan Martin Wenkel , Michael Stanley Smith , Nadja Klein

Most clinical trials involve the comparison of a new treatment to a control arm (e.g., the standard of care) and the estimation of a treatment effect. External data, including historical clinical trial data and real-world observational…

Methodology · Statistics 2021-03-17 Tianjian Zhou , Yuan Ji

Ensembles of decision trees are a useful tool for obtaining for obtaining flexible estimates of regression functions. Examples of these methods include gradient boosted decision trees, random forests, and Bayesian CART. Two potential…

Methodology · Statistics 2018-09-18 Antonio Ricardo Linero , Yun Yang

We present a novel prior for tree topology within Bayesian Additive Regression Trees (BART) models. This approach quantifies the hypothetical loss in information and the loss due to complexity associated with choosing the wrong tree…

Methodology · Statistics 2024-12-30 F. Serafini , F. Leisen , C. Villa , K. Wilson

Frequentist and Bayesian methods differ in many aspects, but share some basic optimal properties. In real-life classification and regression problems, situations exist in which a model based on one of the methods is preferable based on some…

Methodology · Statistics 2023-08-29 Tanujit Chakraborty , Gauri Kamat , Ashis Kumar Chakraborty

Vector autoregression (VAR) models are widely used for forecasting and macroeconomic analysis, yet they remain limited by their reliance on a linear parameterization. Recent research has introduced nonparametric alternatives, such as…

Methodology · Statistics 2025-03-19 Pedro A. Lima , Carlos M. Carvalho , Hedibert F. Lopes , Andrew Herren

The linear varying coefficient models posits a linear relationship between an outcome and covariates in which the covariate effects are modeled as functions of additional effect modifiers. Despite a long history of study and use in…

Methodology · Statistics 2024-09-26 Sameer K. Deshpande , Ray Bai , Cecilia Balocchi , Jennifer E. Starling , Jordan Weiss

Bayesian quadrature (BQ) is a method for solving numerical integration problems in a Bayesian manner, which allows users to quantify their uncertainty about the solution. The standard approach to BQ is based on a Gaussian process (GP)…

Methodology · Statistics 2021-12-03 Harrison Zhu , Xing Liu , Ruya Kang , Zhichao Shen , Seth Flaxman , François-Xavier Briol

Random Forests (RF) and Extreme Gradient Boosting (XGBoost) are two of the most widely used and highly performing classification and regression models. They aggregate equally weighted CART trees, generated randomly in RF or sequentially in…

Machine Learning · Computer Science 2025-10-28 Dimitris Bertsimas , Yubing Cui

This paper introduces Type 2 Tobit Bayesian Additive Regression Trees (TOBART-2). BART can produce accurate individual-specific treatment effect estimates. However, in practice estimates are often biased by sample selection. We extend the…

Econometrics · Economics 2025-11-04 Eoghan O'Neill

We perform Bayesian optimization using a Gaussian process perspective on Bayesian Additive Regression Trees (BART). Our BART Kernel (BARK) uses tree agreement to define a posterior over piecewise-constant functions, and we explore the space…

Machine Learning · Computer Science 2025-06-09 Toby Boyne , Jose Pablo Folch , Robert M Lee , Behrang Shafei , Ruth Misener