English
Related papers

Related papers: Highly Efficient Structural Learning of Sparse Sta…

200 papers

We provide time- and sample-efficient algorithms for learning and testing latent-tree Ising models, i.e. Ising models that may only be observed at their leaf nodes. On the learning side, we obtain efficient algorithms for learning a…

Machine Learning · Computer Science 2023-07-11 Davin Choo , Yuval Dagan , Constantinos Daskalakis , Anthimos Vardis Kandiros

We develop sampling algorithms to fit Bayesian hierarchical models, the computational complexity of which scales linearly with the number of observations and the number of parameters in the model. We focus on crossed random effect and…

Computation · Statistics 2025-01-03 Omiros Papaspiliopoulos , Timothée Stumpf-Fétizon , Giacomo Zanella

This work considers the problem of learning the structure of multivariate linear tree models, which include a variety of directed tree graphical models with continuous, discrete, and mixed latent variables such as linear-Gaussian models,…

Machine Learning · Computer Science 2011-11-09 Animashree Anandkumar , Kamalika Chaudhuri , Daniel Hsu , Sham M. Kakade , Le Song , Tong Zhang

Bayesian networks are a widely-used class of probabilistic graphical models capable of representing symmetric conditional independence between variables of interest using the topology of the underlying graph. For categorical variables, they…

Machine Learning · Statistics 2022-10-07 Gherardo Varando , Federico Carli , Manuele Leonelli

Bayesian network structure learning algorithms with limited data are being used in domains such as systems biology and neuroscience to gain insight into the underlying processes that produce observed data. Learning reliable networks from…

Machine Learning · Statistics 2013-07-10 Diane Oyen , Terran Lane

This paper addresses the problem of learning a sparse structure Bayesian network from high-dimensional discrete data. Compared to continuous Bayesian networks, learning a discrete Bayesian network is a challenging problem due to the large…

Machine Learning · Computer Science 2022-09-27 Nazanin Shajoonnezhad , Amin Nikanjam

Learning a Bayesian network structure from data is an NP-hard problem and thus exact algorithms are feasible only for small data sets. Therefore, network structures for larger networks are usually learned with various heuristics. Another…

Machine Learning · Computer Science 2012-10-19 Teppo Niinimaki , Pekka Parviainen

Causal structure learning, also known as causal discovery, aims to estimate causal relationships between variables as a form of a causal directed acyclic graph (DAG) from observational data. One of the major frameworks is the order-based…

Machine Learning · Statistics 2026-02-18 Kentaro Kanamori , Hirofumi Suzuki , Takuya Takagi

We present an algorithm for learning decision trees using stochastic gradient information as the source of supervision. In contrast to previous approaches to gradient-based tree learning, our method operates in the incremental learning…

Machine Learning · Statistics 2019-09-25 Henry Gouk , Bernhard Pfahringer , Eibe Frank

Regression trees are one of the oldest forms of AI models, and their predictions can be made without a calculator, which makes them broadly useful, particularly for high-stakes applications. Within the large literature on regression trees,…

Machine Learning · Computer Science 2023-04-11 Rui Zhang , Rui Xin , Margo Seltzer , Cynthia Rudin

Dynamic regression trees are an attractive option for automatic regression and classification with complicated response surfaces in on-line application settings. We create a sequential tree model whose state changes in time with the…

Methodology · Statistics 2010-11-23 Matthew A. Taddy , Robert B. Gramacy , Nicholas G. Polson

Bayesian Decision Trees are known for their probabilistic interpretability. However, their construction can sometimes be costly. In this article we present a general Bayesian Decision Tree algorithm applicable to both regression and…

Machine Learning · Statistics 2020-09-23 Giuseppe Nuti , Lluís Antoni Jiménez Rugama , Andreea-Ingrid Cross

Data structures known as $k$-d trees have numerous applications in scientific computing, particularly in areas of modern statistics and data science such as range search in decision trees, clustering, nearest neighbors search, local…

Data Structures and Algorithms · Computer Science 2022-01-21 Aritra Chakravorty , William S. Cleveland , Patrick J. Wolfe

Decision trees and their ensembles are popular in machine learning as easy-to-understand models. Several techniques have been proposed in the literature for learning tree-based classifiers, with different techniques working well for data…

Machine Learning · Computer Science 2025-05-20 Maria-Florina Balcan , Dravyansh Sharma

In many modern applications, including analysis of gene expression and text documents, the data are noisy, high-dimensional, and unordered--with no particular meaning to the given order of the variables. Yet, successful learning is often…

Methodology · Statistics 2008-07-25 Ann B. Lee , Boaz Nadler , Larry Wasserman

Interpretability is crucial for doctors, hospitals, pharmaceutical companies and biotechnology corporations to analyze and make decisions for high stakes problems that involve human health. Tree-based methods have been widely adopted for…

Machine Learning · Computer Science 2024-05-24 Rui Zhang , Rui Xin , Margo Seltzer , Cynthia Rudin

In recent years, there is a growing interest in learning Bayesian networks with continuous variables. Learning the structure of such networks is a computationally expensive procedure, which limits most applications to parameter learning.…

Machine Learning · Computer Science 2012-07-19 Iftach Nachman , Gal Elidan , Nir Friedman

We investigate the problem of learning Bayesian networks in a robust model where an $\epsilon$-fraction of the samples are adversarially corrupted. In this work, we study the fully observable discrete case where the structure of the network…

Data Structures and Algorithms · Computer Science 2018-10-30 Yu Cheng , Ilias Diakonikolas , Daniel Kane , Alistair Stewart

Causal discovery algorithms aim at untangling complex causal relationships from data. Here, we study causal discovery and inference methods based on staged tree models, which can represent complex and asymmetric causal relationships between…

Methodology · Statistics 2023-03-02 Manuele Leonelli , Gherardo Varando

Based on decision trees, many fields have arguably made tremendous progress in recent years. In simple words, decision trees use the strategy of "divide-and-conquer" to divide the complex problem on the dependency between input features and…

Machine Learning · Computer Science 2021-01-22 Jinxiong Zhang