English
Related papers

Related papers: Context-tree weighting and Bayesian Context Trees:…

200 papers

Determining subgroups that respond especially well (or poorly) to specific interventions (medical or policy) requires new supervised learning methods tailored specifically for causal inference. Bayesian Causal Forest (BCF) is a recent…

Machine Learning · Statistics 2022-09-16 Nikolay Krantsevich , Jingyu He , P. Richard Hahn

We present a Bayesian nonparametric model for conditional distribution estimation using Bayesian additive regression trees (BART). The generative model we use is based on rejection sampling from a base model. Typical of BART models, our…

Methodology · Statistics 2022-02-02 Yinpu Li , Antonio R. Linero , Jared S. Murray

Bayesian inference provides a natural way of incorporating prior beliefs and assigning a probability measure to the space of hypotheses. Current solutions rely on iterative routines like Markov Chain Monte Carlo (MCMC) sampling and…

Machine Learning · Computer Science 2025-02-11 Sarthak Mittal , Niels Leif Bracher , Guillaume Lajoie , Priyank Jaini , Marcus Brubaker

Bayesian Additive Regression Trees (BART) is a popular Bayesian non-parametric regression model that is commonly used in causal inference and beyond. Its strong predictive performance is supported by well-developed estimation theory,…

Machine Learning · Statistics 2026-02-10 Yan Shuo Tan , Omer Ronen , Theo Saarinen , Bin Yu

We propose a general method to carry out a valid Bayesian analysis of a finite-dimensional `targeted' parameter in the presence of a finite-dimensional nuisance parameter. We apply our methods to causal inference based on estimating…

Methodology · Statistics 2026-02-03 Magid Sabbagh , David A. Stephens

We describe an adaptive context tree weighting (ACTW) algorithm, as an extension to the standard context tree weighting (CTW) algorithm. Unlike the standard CTW algorithm, which weights all observations equally regardless of the depth, ACTW…

Information Theory · Computer Science 2012-01-11 Alexander O'Neill , Marcus Hutter , Wen Shao , Peter Sunehag

Bayesian averaging over classification models allows the uncertainty of classification outcomes to be evaluated, which is of crucial importance for making reliable decisions in applications such as financial in which risks have to be…

Many asymptotically minimax procedures for function estimation often rely on somewhat arbitrary and restrictive assumptions such as isotropy or spatial homogeneity. This work enhances the theoretical understanding of Bayesian additive…

Statistics Theory · Mathematics 2023-12-05 Seonghyun Jeong , Veronika Rockova

In this work, we develop the Batch Belief Trees (BBT) algorithm for motion planning under motion and sensing uncertainties. The algorithm interleaves between batch sampling, building a graph of nominal trajectories in the state space, and…

Robotics · Computer Science 2023-04-24 Dongliang Zheng , Panagiotis Tsiotras

Recent developments in statistical regression methodology shift away from pure mean regression towards distributional regression models. One important strand thereof is that of conditional transformation models (CTMs). CTMs infer the entire…

Methodology · Statistics 2022-05-24 Manuel Carlan , Thomas Kneib , Nadja Klein

In this paper, we propose Belief Behavior Trees (BBTs), an extension to Behavior Trees (BTs) that allows to automatically create a policy that controls a robot in partially observable environments. We extend the semantic of BTs to account…

Robotics · Computer Science 2020-08-24 Evgenii Safronov , Michele Colledanchise , Lorenzo Natale

Understanding how "black-box" models arrive at their predictions has sparked significant interest from both within and outside the AI community. Our work focuses on doing this by generating local explanations about individual predictions…

Machine Learning · Computer Science 2019-07-08 Ana Lucic , Hinda Haned , Maarten de Rijke

We propose a novel "tree-averaging" model that utilizes the ensemble of classification and regression trees (CART). Each constituent tree is estimated with a subset of similar data. We treat this grouping of subsets as Bayesian ensemble…

Machine Learning · Statistics 2014-08-20 Leo L. Duan , John P. Clancy , Rhonda D. Szczesniak

Time-series data classification is central to the analysis and control of autonomous systems, such as robots and self-driving cars. Temporal logic-based learning algorithms have been proposed recently as classifiers of such data. However,…

Machine Learning · Computer Science 2022-07-08 Erfan Aasi , Cristian Ioan Vasile , Mahroo Bahreinian , Calin Belta

Bayesian networks provide a language for qualitatively representing the conditional independence properties of a distribution. This allows a natural and compact representation of the distribution, eases knowledge acquisition, and supports…

Artificial Intelligence · Computer Science 2013-02-18 Craig Boutilier , Nir Friedman , Moises Goldszmidt , Daphne Koller

The uncertainty of classification outcomes is of crucial importance for many safety critical applications including, for example, medical diagnostics. In such applications the uncertainty of classification can be reliably estimated within a…

Artificial Intelligence · Computer Science 2007-05-23 V. Schetinin , J. E. Fieldsend , D. Partridge , W. J. Krzanowski , R. M. Everson , T. C. Bailey , A. Hernandez

We derive tractable criteria for the consistency of Bayesian tree reconstruction procedures, which constitute a central class of algorithms for inferring common ancestry among DNA sequence samples in phylogenetics. Our results encompass…

Statistics Theory · Mathematics 2025-08-05 Alisa Kirichenko , Luke J. Kelly , Jere Koskela

We propose a fully Bayesian approach for causal inference with multivariate categorical data based on staged tree models, a class of probabilistic graphical models capable of representing asymmetric and context-specific dependencies. To…

Methodology · Statistics 2025-11-06 Andrea Cremaschi , Manuele Leonelli , Gherardo Varando

In the field of decision trees, most previous studies have difficulty ensuring the statistical optimality of a prediction of new data and suffer from overfitting because trees are usually used only to represent prediction functions to be…

Machine Learning · Computer Science 2023-06-13 Yuta Nakahara , Shota Saito , Naoki Ichijo , Koki Kazama , Toshiyasu Matsushima

We define a context-sensitive temporal probability logic for representing classes of discrete-time temporal Bayesian networks. Context constraints allow inference to be focused on only the relevant portions of the probabilistic knowledge.…

Artificial Intelligence · Computer Science 2013-02-21 Liem Ngo , Peter Haddawy , James Helwig