English
Related papers

Related papers: Very fast Bayesian Additive Regression Trees on GP…

200 papers

In this paper we develop the randomized Sharded Bayesian Additive Regression Trees (SBT) model. We introduce a randomization auxiliary variable and a sharding tree to decide partitioning of data, and fit each partition component to a…

Machine Learning · Statistics 2023-06-02 Hengrui Luo , Matthew T. Pratola

The success of Bayesian inference with MCMC depends critically on Markov chains rapidly reaching the posterior distribution. Despite the plentitude of inferential theory for posteriors in Bayesian non-parametrics, convergence properties of…

Statistics Theory · Mathematics 2023-06-02 Jungeum Kim , Veronika Rockova

In recent years, theoretical results and simulation evidence have shown Bayesian additive regression trees to be a highly-effective method for nonparametric regression. Motivated by cost-effectiveness analyses in health economics, where…

Individualized treatment rules (ITR) can improve health outcomes by recognizing that patients may respond differently to treatment and assigning therapy with the most desirable predicted outcome for each individual. Flexible and efficient…

Methodology · Statistics 2017-09-25 Brent R. Logan , Rodney Sparapani , Robert E. McCulloch , Purushottam W. Laud

This article proposes Multinomial Probit Bayesian Additive Regression Trees (MPBART) as a multinomial probit extension of BART - Bayesian Additive Regression Trees (Chipman et al (2010)). MPBART is flexible to allow inclusion of predictors…

Machine Learning · Statistics 2016-02-09 Bereket P. Kindo , Hao Wang , Edsel A. Peña

Vector autoregressive (VAR) models assume linearity between the endogenous variables and their lags. This assumption might be overly restrictive and could have a deleterious impact on forecasting accuracy. As a solution, we propose…

Econometrics · Economics 2021-03-10 Florian Huber , Luca Rossini

The study of dependence between random variables under external influences is a challenging problem in multivariate analysis. We address this by proposing a novel semi-parametric approach for conditional copula models using Bayesian…

Methodology · Statistics 2026-03-11 Tathagata Basu , Fabrizio Leisen , Cristiano Villa , Kevin Wilson

Frequentist and Bayesian methods differ in many aspects, but share some basic optimal properties. In real-life classification and regression problems, situations exist in which a model based on one of the methods is preferable based on some…

Methodology · Statistics 2023-08-29 Tanujit Chakraborty , Gauri Kamat , Ashis Kumar Chakraborty

Medical prediction applications often need to deal with small sample sizes compared to the number of covariates. Such data pose problems for prediction and variable selection, especially when the covariate-response relationship is…

Machine Learning · Statistics 2024-11-05 Jeroen M. Goedhart , Thomas Klausch , Jurriaan Janssen , Mark A. van de Wiel

Distribution regression, where the goal is to predict a scalar response from a distribution-valued predictor, arises naturally in settings where observations are grouped and outcomes depend on group-level characteristics rather than on…

Methodology · Statistics 2026-03-09 Antonio R. Linero , Soumyabrata Bose , Jared Murray

The development of driverless vehicles has spurred the need to predict human driving behavior to facilitate interaction between driverless and human-driven vehicles. Predicting human driving movements can be challenging, and poor prediction…

Applications · Statistics 2025-09-16 Yaoyuan Vincent Tan , Carol A. C. Flannagan , Michael R. Elliott

Ensemble learning is a statistical paradigm built on the premise that many weak learners can perform exceptionally well when deployed collectively. The BART method of Chipman et al. (2010) is a prominent example of Bayesian ensemble…

Machine Learning · Statistics 2018-10-08 Veronika Rockova , Enakshi Saha

This paper develops a performant Bayesian approach to conditional average treatment effect (CATE) estimation in regression discontinuity designs (RDD), an increasingly prevalent form of quasi-experiment that facilitates causal inference.…

Methodology · Statistics 2026-05-18 Rafael Alcantara , P. Richard Hahn , Hedibert F. Lopes

There is a dearth of robust methods to estimate the causal effects of multiple treatments when the outcome is binary. This paper uses two unique sets of simulations to propose and evaluate the use of Bayesian Additive Regression Trees…

Methodology · Statistics 2020-01-22 Liangyuan Hu , Chenyang Gu , Michael Lopez , Jiayi Ji , Juan Wisnivesky

In this paper, we present a novel massively parallel algorithm for accelerating the decision tree building procedure on GPUs (Graphics Processing Units), which is a crucial step in Gradient Boosted Decision Tree (GBDT) and random forests…

Machine Learning · Statistics 2017-06-27 Huan Zhang , Si Si , Cho-Jui Hsieh

In modern computer experiment applications, one often encounters the situation where various models of a physical system are considered, each implemented as a simulator on a computer. An important question in such a setting is determining…

Methodology · Statistics 2023-05-08 John C. Yannotty , Thomas J. Santner , Richard J. Furnstahl , Matthew T. Pratola

Ensembles of decision trees are a useful tool for obtaining for obtaining flexible estimates of regression functions. Examples of these methods include gradient boosted decision trees, random forests, and Bayesian CART. Two potential…

Methodology · Statistics 2018-09-18 Antonio Ricardo Linero , Yun Yang

Flow network models can capture the underlying physics and operational constraints of many networked systems including the power grid and transportation and water networks. However, analyzing reliability of systems using computationally…

Machine Learning · Computer Science 2021-09-14 Nariman L. Dehghani , Soroush Zamanian , Abdollah Shafieezadeh

We present a Bayesian approach to model cohort-level retention rates and revenue over time. We use Bayesian additive regression trees (BART) to model the retention component which we couple with a linear model for the revenue component.…

Applications · Statistics 2025-04-24 Juan Camilo Orduz

We show how to construct the implied copula process of response values from a Bayesian additive regression tree (BART) model with prior on the leaf node variances. This copula process, defined on the covariate space, can be paired with any…

Methodology · Statistics 2026-01-14 Jan Martin Wenkel , Michael Stanley Smith , Nadja Klein