English
Related papers

Related papers: Chow-Liu++: Optimal Prediction-Centric Learning of…

200 papers

We show that $n$-variable tree-structured Ising models can be learned computationally-efficiently to within total variation distance $\epsilon$ from an optimal $O(n \ln n/\epsilon^2)$ samples, where $O(\cdot)$ hides an absolute constant…

Machine Learning · Computer Science 2020-12-01 Constantinos Daskalakis , Qinxuan Pan

We provide high probability finite sample complexity guarantees for hidden non-parametric structure learning of tree-shaped graphical models, whose hidden and observable nodes are discrete random variables with either finite or countable…

Machine Learning · Statistics 2021-04-01 Konstantinos E. Nikolakakis , Dionysios S. Kalogerias , Anand D. Sarwate

We provide finite sample guarantees for the classical Chow-Liu algorithm (IEEE Trans.~Inform.~Theory, 1968) to learn a tree-structured graphical model of a distribution. For a distribution $P$ on $\Sigma^n$ and a tree $T$ on $n$ nodes, we…

Data Structures and Algorithms · Computer Science 2021-07-23 Arnab Bhattacharyya , Sutanu Gayen , Eric Price , N. V. Vinodchandran

The problem of learning forest-structured discrete graphical models from i.i.d. samples is considered. An algorithm based on pruning of the Chow-Liu tree through adaptive thresholding is proposed. It is shown that this algorithm is both…

Information Theory · Computer Science 2011-02-15 Vincent Y. F. Tan , Animashree Anandkumar , Alan S. Willsky

We consider the problem of learning underlying tree structure from noisy, mixed data obtained from a linear model. To achieve this, we use the expectation maximization algorithm combined with Chow-Liu minimum spanning tree algorithm. This…

Information Theory · Computer Science 2017-10-06 Navid Tafaghodi Khajavi

We develop optimal algorithms for learning undirected Gaussian trees and directed Gaussian polytrees from data. We consider both problems of distribution learning (i.e. in KL distance) and structure learning (i.e. exact recovery). The first…

Machine Learning · Computer Science 2024-02-12 Yuhao Wang , Ming Gao , Wai Ming Tai , Bryon Aragam , Arnab Bhattacharyya

Consider the problem of learning undirected graphical models on trees from corrupted data. Recently Katiyar et al. showed that it is possible to recover trees from noisy binary data up to a small equivalence class of possible trees. Their…

Machine Learning · Statistics 2021-02-11 Marta Casanellas , Marina Garrote-López , Piotr Zwiernik

We consider the task of learning the maximum-likelihood polytree from data. Our first result is a performance guarantee establishing that the optimal branching (or Chow-Liu tree), which can be computed very easily, constitutes a good…

Artificial Intelligence · Computer Science 2013-01-30 Sanjoy Dasgupta

The Chow-Liu algorithm (IEEE Trans.~Inform.~Theory, 1968) has been a mainstay for the learning of tree-structured graphical models from i.i.d.\ sampled data vectors. Its theoretical properties have been well-studied and are well-understood.…

Machine Learning · Computer Science 2021-10-29 Fengzhuo Zhang , Anshoo Tandon , Vincent Y. F. Tan

This paper considers structure learning from data with $n$ samples of $p$ variables, assuming that the structure is a forest, using the Chow-Liu algorithm. Specifically, for incomplete data, we construct two model selection algorithms that…

Information Theory · Computer Science 2018-08-06 Joe Suzuki

We extend the Chow-Liu algorithm for general random variables while the previous versions only considered finite cases. In particular, this paper applies the generalization to Suzuki's learning algorithm that generates from data forests…

Information Theory · Computer Science 2010-02-12 Joe Suzuki

The seminal work of Chow and Liu (1968) shows that approximation of a finite probabilistic system by Markov trees can achieve the minimum information loss with the topology of a maximum spanning tree. Our current paper generalizes the…

Data Structures and Algorithms · Computer Science 2018-01-23 Liang Ding , Di Chang , Russell Malmberg , Aaron Martinez , David Robinson , Matthew Wicker , Hongfei Yan , Liming Cai

Accurate knowledge of power grid topology is a prerequisite for effective state estimation and grid stability. While data-driven methods for topology reconstruction exist, the minimum requirements for measurement quality, specifically…

Physics and Society · Physics 2026-05-13 Daniel T. Speckhard

We provide time- and sample-efficient algorithms for learning and testing latent-tree Ising models, i.e. Ising models that may only be observed at their leaf nodes. On the learning side, we obtain efficient algorithms for learning a…

Machine Learning · Computer Science 2023-07-11 Davin Choo , Yuval Dagan , Constantinos Daskalakis , Anthimos Vardis Kandiros

In the context of graphical causal discovery, we adapt the versatile framework of linear non-Gaussian acyclic models (LiNGAMs) to propose new algorithms to efficiently learn graphs that are polytrees. Our approach combines the Chow--Liu…

Machine Learning · Statistics 2022-08-16 Daniele Tramontano , Anthea Monod , Mathias Drton

We study the problem of learning a tree Ising model from samples such that subsequent predictions made using the model are accurate. The prediction task considered in this paper is that of predicting the values of a subset of variables…

Statistics Theory · Mathematics 2018-06-15 Guy Bresler , Mina Karzand

Chow and Liu (1968) studied the problem of learning a maximumlikelihood Markov tree. We generalize their work to more complexMarkov networks by considering the problem of learning a maximumlikelihood Markov network of bounded complexity. We…

Machine Learning · Computer Science 2013-01-14 Nathan Srebro

We consider the task of learning Ising models when the signs of different random variables are flipped independently with possibly unequal, unknown probabilities. In this paper, we focus on the problem of robust estimation of…

Machine Learning · Statistics 2020-06-11 Ashish Katiyar , Vatsal Shah , Constantine Caramanis

This paper studies the decentralized learning of tree-structured Gaussian graphical models (GGMs) from noisy data. In decentralized learning, data set is distributed across different machines (sensors), and GGMs are widely used to model…

Machine Learning · Computer Science 2021-09-23 Akram Hussain

We consider the problem of modeling discrete-valued vector time series data using extensions of Chow-Liu tree models to capture both dependencies across time and dependencies across variables. Conditional Chow-Liu tree models are…

Machine Learning · Computer Science 2012-07-19 Sergey Kirshner , Padhraic Smyth , Andrew Robertson
‹ Prev 1 2 3 10 Next ›