English
Related papers

Related papers: Sample-Optimal and Efficient Learning of Tree Isin…

200 papers

We consider learning the structures of Gaussian latent tree models with vector observations when a subset of them are arbitrarily corrupted. First, we present the sample complexities of Recursive Grouping (RG) and Chow-Liu Recursive…

Machine Learning · Statistics 2021-10-26 Fengzhuo Zhang , Vincent Y. F. Tan

We study the problem of learning a latent tree graphical model where samples are available only from a subset of variables. We propose two consistent and computationally efficient algorithms for learning minimal latent trees, that is, trees…

Machine Learning · Statistics 2010-09-15 Myung Jin Choi , Vincent Y. F. Tan , Animashree Anandkumar , Alan S. Willsky

We consider the problem of learning the structure of ferromagnetic Ising models Markov on sparse Erdos-Renyi random graph. We propose simple local algorithms and analyze their performance in the regime of correlation decay. We prove that an…

Statistics Theory · Mathematics 2015-03-17 Animashree Anandkumar , Vincent Tan , Alan Willsky

We establish optimal Statistical Query (SQ) lower bounds for robustly learning certain families of discrete high-dimensional distributions. In particular, we show that no efficient SQ algorithm with access to an $\epsilon$-corrupted binary…

Data Structures and Algorithms · Computer Science 2022-06-10 Ilias Diakonikolas , Daniel M. Kane , Yuxin Sun

We consider the problem of estimating Ising models over $n$ variables in Total Variation (TV) distance, given $l$ independent samples from the model. While the statistical complexity of the problem is well-understood [DMR20], identifying…

Machine Learning · Computer Science 2025-11-27 Constantinos Daskalakis , Vardis Kandiros , Rui Yao

Efficient sampling from constraint manifolds, and thereby generating a diverse set of solutions for feasibility problems, is a fundamental challenge. We consider the case where a problem is factored, that is, the underlying nonlinear…

Robotics · Computer Science 2021-03-30 Joaquim Ortiz-Haro , Valentin N. Hartmann , Ozgur S. Oguz , Marc Toussaint

Accurate knowledge of power grid topology is a prerequisite for effective state estimation and grid stability. While data-driven methods for topology reconstruction exist, the minimum requirements for measurement quality, specifically…

Physics and Society · Physics 2026-05-13 Daniel T. Speckhard

We extend the Chow-Liu algorithm for general random variables while the previous versions only considered finite cases. In particular, this paper applies the generalization to Suzuki's learning algorithm that generates from data forests…

Information Theory · Computer Science 2010-02-12 Joe Suzuki

The problem of maximum-likelihood (ML) estimation of discrete tree-structured distributions is considered. Chow and Liu established that ML-estimation reduces to the construction of a maximum-weight spanning tree using the empirical mutual…

Machine Learning · Statistics 2016-11-15 Vincent Y. F. Tan , Animashree Anandkumar , Lang Tong , Alan S. Willsky

Given side information that an Ising tree-structured graphical model is homogeneous and has no external field, we derive the exact asymptotics of learning its structure from independently drawn samples. Our results, which leverage the use…

Machine Learning · Statistics 2020-05-12 Anshoo Tandon , Vincent Y. F. Tan , Shiyao Zhu

Chow and Liu (1968) studied the problem of learning a maximumlikelihood Markov tree. We generalize their work to more complexMarkov networks by considering the problem of learning a maximumlikelihood Markov network of bounded complexity. We…

Machine Learning · Computer Science 2013-01-14 Nathan Srebro

In this paper we investigate the computational complexity of learning the graph structure underlying a discrete undirected graphical model from i.i.d. samples. We first observe that the notoriously difficult problem of learning parities…

Machine Learning · Statistics 2014-12-04 Guy Bresler , David Gamarnik , Devavrat Shah

The success of neural networks over the past decade has established them as effective models for many relevant data generating processes. Statistical theory on neural networks indicates graceful scaling of sample complexity. For example,…

Machine Learning · Computer Science 2023-03-28 Yifan Zhu , Hong Jun Jeon , Benjamin Van Roy

Motion planning under differential constraints is a classic problem in robotics. To date, the state of the art is represented by sampling-based techniques, with the Rapidly-exploring Random Tree algorithm as a leading example. Yet, the…

Robotics · Computer Science 2015-03-03 Edward Schmerling , Lucas Janson , Marco Pavone

We consider the following basic learning task: given independent draws from an unknown distribution over a discrete support, output an approximation of the distribution that is as accurate as possible in $\ell_1$ distance (i.e. total…

Machine Learning · Computer Science 2015-11-12 Gregory Valiant , Paul Valiant

The problem of learning tree-structured Gaussian graphical models from independent and identically distributed (i.i.d.) samples is considered. The influence of the tree structure and the parameters of the Gaussian distribution on the…

Machine Learning · Statistics 2010-05-06 Vincent Y. F. Tan , Animashree Anandkumar , Alan S. Willsky

We consider the problem of estimating the expected value of information (the knowledge gradient) for Bayesian learning problems where the belief model is nonlinear in the parameters. Our goal is to maximize some metric, while simultaneously…

Machine Learning · Statistics 2016-11-23 Xinyu He , Warren B. Powell

We consider the problem of estimating how well a model class is capable of fitting a distribution of labeled data. We show that it is often possible to accurately estimate this "learnability" even when given an amount of data that is too…

Machine Learning · Computer Science 2019-03-26 Weihao Kong , Gregory Valiant

In lifelong learning, tasks (or classes) to be learned arrive sequentially over time in arbitrary order. During training, knowledge from previous tasks can be captured and transferred to subsequent ones to improve sample efficiency. We…

Machine Learning · Computer Science 2022-03-02 Xinyuan Cao , Weiyang Liu , Santosh S. Vempala

We revisit the problem of efficiently learning the underlying parameters of Ising models from data. Current algorithmic approaches achieve essentially optimal sample complexity when given i.i.d. samples from the stationary measure and the…

Machine Learning · Computer Science 2023-11-16 Jason Gaitonde , Elchanan Mossel