English
Related papers

Related papers: Low Tree-Rank Bayesian Vector Autoregression Model

200 papers

Regression trees are one of the oldest forms of AI models, and their predictions can be made without a calculator, which makes them broadly useful, particularly for high-stakes applications. Within the large literature on regression trees,…

Machine Learning · Computer Science 2023-04-11 Rui Zhang , Rui Xin , Margo Seltzer , Cynthia Rudin

Bayesian Additive Regression Trees (BART) is a tree-based machine learning method that has been successfully applied to regression and classification problems. BART assumes regularisation priors on a set of trees that work as weak learners…

Machine Learning · Statistics 2022-06-07 Estevão B. Prado , Rafael A. Moral , Andrew C. Parnell

This paper develops a sparsity-inducing version of Bayesian Causal Forests, a recently proposed nonparametric causal regression model that employs Bayesian Additive Regression Trees and is specifically designed to estimate heterogeneous…

Methodology · Statistics 2021-11-17 Alberto Caron , Gianluca Baio , Ioanna Manolopoulou

Dependency trees convey rich structural information that is proven useful for extracting relations among entities in text. However, how to effectively make use of relevant information while ignoring irrelevant information from the…

Computation and Language · Computer Science 2020-09-08 Zhijiang Guo , Yan Zhang , Wei Lu

Additive regression trees are flexible non-parametric models and popular off-the-shelf tools for real-world non-linear regression. In application domains, such as bioinformatics, where there is also demand for probabilistic predictions with…

Machine Learning · Statistics 2015-02-17 Balaji Lakshminarayanan , Daniel M. Roy , Yee Whye Teh

Bayesian networks can be used to extract explanations about the observed state of a subset of variables. In this paper, we explicate the desiderata of an explanation and confront them with the concept of explanation proposed by existing…

Artificial Intelligence · Computer Science 2012-06-18 Ulf Nielsen , Jean-Philippe Pellet , André Elisseeff

The reduced-rank vector autoregressive (VAR) model can be interpreted as a supervised factor model, where two factor modelings are simultaneously applied to response and predictor spaces. This article introduces a new model, called vector…

Methodology · Statistics 2023-06-16 Di Wang , Xiaoyu Zhang , Guodong Li , Ruey Tsay

To learn (statistical) dependencies among random variables requires exponentially large sample size in the number of observed random variables if any arbitrary joint probability distribution can occur. We consider the case that sparse data…

Machine Learning · Computer Science 2007-05-23 Dominik Janzing , Daniel Herrmann

We present Collaborative Trees, a novel tree model designed for regression prediction, along with its bagging version, which aims to analyze complex statistical associations between features and uncover potential patterns inherent in the…

Methodology · Statistics 2024-05-21 Chien-Ming Chi

We consider a graphical model where a multivariate normal vector is associated with each node of the underlying graph and estimate the graphical structure. We minimize a loss function obtained by regressing the vector at each node on those…

Machine Learning · Statistics 2017-09-19 Xingqi Du , Subhashis Ghosal

Reduced-rank regression recognises the possibility of a rank-deficient matrix of coefficients. We propose a novel Bayesian model for estimating the rank of the coefficient matrix, which obviates the need for post-processing steps and allows…

Methodology · Statistics 2024-02-14 Maria F. Pintado , Matteo Iacopini , Luca Rossini , Alexander Y. Shestopaloff

Change-plane regression identifies subpopulations through an interpretable linear threshold rule, but likelihood-based inference for the hard-threshold boundary is nonregular: objectives are non-smooth, the boundary is weakly identified…

Methodology · Statistics 2026-04-28 Yuki Ohnishi , Fan Li

Undirected graphical models encode in a graph $G$ the dependency structure of a random vector $Y$. In many applications, it is of interest to model $Y$ given another random vector $X$ as input. We refer to the problem of estimating the…

Machine Learning · Statistics 2010-06-22 Han Liu , Xi Chen , John Lafferty , Larry Wasserman

Battery performance datasets are typically non-normal and multicollinear. Extrapolating such datasets for model predictions needs attention to such characteristics. This study explores the impact of data normality in building machine…

Machine Learning · Computer Science 2021-11-05 Shovan Chowdhury , Yuxiao Lin , Boryann Liaw , Leslie Kerby

Graphical models describe associations between variables through the notion of conditional independence. Gaussian graphical models are a widely used class of such models where the relationships are formalized by non-null entries of the…

Methodology · Statistics 2023-08-08 Sagnik Bhadury , Riten Mitra , Jeremy T. Gaskins

We study the growth of a time-ordered rooted tree by probabilistic attachment of new vertices to leaves. We construct a likelihood function of the leaves based on the connectivity of the tree. We take such connectivity to be induced by the…

Data Structures and Algorithms · Computer Science 2020-11-03 Nomvelo Sibisi

Big Data often presents as massive non-probability samples. Not only is the selection mechanism often unknown, but larger data volume amplifies the relative contribution of selection bias to total error. Existing bias adjustment approaches…

Methodology · Statistics 2022-03-29 Ali Rafei , Carol A. C. Flannagan , Brady T. West , Michael R. Elliott

The hierarchical and recursive expressive capability of rooted trees is applicable to represent statistical models in various areas, such as data compression, image processing, and machine learning. On the other hand, such hierarchical…

Machine Learning · Computer Science 2022-01-25 Yuta Nakahara , Shota Saito , Akira Kamatsuka , Toshiyasu Matsushima

Many causal systems such as biological processes in cells can only be observed indirectly via measurements, such as gene expression. Causal representation learning -- the task of correctly mapping low-level observations to latent causal…

Machine Learning · Computer Science 2025-10-31 Elliot Layne , Jason Hartford , Sébastien Lachapelle , Mathieu Blanchette , Dhanya Sridhar

Decision trees are important both as interpretable models amenable to high-stakes decision-making, and as building blocks of ensemble methods such as random forests and gradient boosting. Their statistical properties, however, are not well…

Machine Learning · Statistics 2021-10-20 Yan Shuo Tan , Abhineet Agarwal , Bin Yu