English
Related papers

Related papers: StochTree: BART-based modeling in R and Python

200 papers

Decision trees are a commonly used class of machine learning models valued for their interpretability and versatility, capable of both classification and regression. We propose ZTree, a novel decision tree learning framework that replaces…

Machine Learning · Computer Science 2025-09-17 Eric Cheng , Jie Cheng

Most implementations of Bayesian additive regression trees (BART) one-hot encode categorical predictors, replacing each one with several binary indicators, one for every level or category. Regression trees built with these indicators…

Methodology · Statistics 2024-08-14 Sameer K. Deshpande

Additive regression trees are flexible non-parametric models and popular off-the-shelf tools for real-world non-linear regression. In application domains, such as bioinformatics, where there is also demand for probabilistic predictions with…

Machine Learning · Statistics 2015-02-17 Balaji Lakshminarayanan , Daniel M. Roy , Yee Whye Teh

Bayesian Causal Forests (BCF) is a causal inference machine learning model based on a highly flexible non-parametric regression and classification tool called Bayesian Additive Regression Trees (BART). Motivated by data from the Trends in…

Machine Learning · Statistics 2023-03-10 Nathan McJames , Andrew Parnell , Yong Chen Goh , Ann O'Shea

Bayesian Additive Regression Trees (BART) is a popular Bayesian non-parametric regression model that is commonly used in causal inference and beyond. Its strong predictive performance is supported by well-developed estimation theory,…

Machine Learning · Statistics 2026-02-10 Yan Shuo Tan , Omer Ronen , Theo Saarinen , Bin Yu

We present a Bayesian nonparametric model for conditional distribution estimation using Bayesian additive regression trees (BART). The generative model we use is based on rejection sampling from a base model. Typical of BART models, our…

Methodology · Statistics 2022-02-02 Yinpu Li , Antonio R. Linero , Jared S. Murray

Bayesian Additive Regression Trees (BART) is a fully Bayesian approach to modeling with ensembles of trees. BART can uncover complex regression functions with high dimensional regressors in a fairly automatic way and provide Bayesian…

Machine Learning · Statistics 2018-07-11 Edward George , Prakash Laud , Brent Logan , Robert McCulloch , Rodney Sparapani

Many ecological and spatial processes are complex in nature and are not accurately modeled by linear models. Regression trees promise to handle the high-order interactions that are present in ecological and spatial datasets, but fail to…

Quantitative Methods · Quantitative Biology 2021-01-22 Ethan Ancell , Brennan Bean

Bayesian Additive Regression Trees (BART) of Chipman et al. (2010) has proven to be a powerful tool for nonparametric modeling and prediction. Monotone BART (Chipman et al., 2022) is a recent development that allows BART to be more precise…

Machine Learning · Statistics 2025-09-03 Jared D. Fisher

We perform Bayesian optimization using a Gaussian process perspective on Bayesian Additive Regression Trees (BART). Our BART Kernel (BARK) uses tree agreement to define a posterior over piecewise-constant functions, and we explore the space…

Machine Learning · Computer Science 2025-06-09 Toby Boyne , Jose Pablo Folch , Robert M Lee , Behrang Shafei , Ruth Misener

Bayesian Additive Regression Trees (BART) is a nonparametric Bayesian regression technique of rising fame. It is a sum-of-decision-trees model, and is in some sense the Bayesian version of boosting. In the limit of infinite trees, it…

Machine Learning · Statistics 2025-07-14 Giacomo Petrillo

stagedtrees is an R package which includes several algorithms for learning the structure of staged trees and chain event graphs from data. Score-based and clustering-based algorithms are implemented, as well as various functionalities to…

Methodology · Statistics 2020-11-03 Federico Carli , Manuele Leonelli , Eva Riccomagno , Gherardo Varando

In many longitudinal studies, the covariate and response are often intermittently observed at irregular, mismatched and subject-specific times. How to deal with such data when covariate and response are observed asynchronously is an often…

Methodology · Statistics 2021-08-27 Hao Ran , Yang Bai

Current implementations of Bayesian Additive Regression Trees (BART) are based on axis-aligned decision rules that recursively partition the feature space using a single feature at a time. Several authors have demonstrated that oblique…

Machine Learning · Statistics 2024-11-14 Paul-Hieu V. Nguyen , Ryan Yee , Sameer K. Deshpande

Determining subgroups that respond especially well (or poorly) to specific interventions (medical or policy) requires new supervised learning methods tailored specifically for causal inference. Bayesian Causal Forest (BCF) is a recent…

Machine Learning · Statistics 2022-09-16 Nikolay Krantsevich , Jingyu He , P. Richard Hahn

StocHy is a software tool for the quantitative analysis of discrete-time stochastic hybrid systems (SHS). StocHy accepts a high-level description of stochastic models and constructs an equivalent SHS model. The tool allows to (i) simulate…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Nathalie Cauchi , Kurt Degiorgio , Alessandro Abate

In recent years, theoretical results and simulation evidence have shown Bayesian additive regression trees to be a highly-effective method for nonparametric regression. Motivated by cost-effectiveness analyses in health economics, where…

Many asymptotically minimax procedures for function estimation often rely on somewhat arbitrary and restrictive assumptions such as isotropy or spatial homogeneity. This work enhances the theoretical understanding of Bayesian additive…

Statistics Theory · Mathematics 2023-12-05 Seonghyun Jeong , Veronika Rockova

Bayesian Additive Regression Trees (BART) is a popular Bayesian non-parametric regression algorithm. The posterior is a distribution over sums of decision trees, and predictions are made by averaging approximate samples from the posterior.…

Machine Learning · Statistics 2022-10-19 Omer Ronen , Theo Saarinen , Yan Shuo Tan , James Duncan , Bin Yu

Ensemble learning is a statistical paradigm built on the premise that many weak learners can perform exceptionally well when deployed collectively. The BART method of Chipman et al. (2010) is a prominent example of Bayesian ensemble…

Machine Learning · Statistics 2018-10-08 Veronika Rockova , Enakshi Saha