English
Related papers

Related papers: Exact Asymptotics for Learning Tree-Structured Gra…

200 papers

We provide high-probability sample complexity guarantees for exact structure recovery and accurate predictive learning using noise-corrupted samples from an acyclic (tree-shaped) graphical model. The hidden variables follow a…

Machine Learning · Statistics 2021-02-18 Konstantinos E. Nikolakakis , Dionysios S. Kalogerias , Anand D. Sarwate

We show that $n$-variable tree-structured Ising models can be learned computationally-efficiently to within total variation distance $\epsilon$ from an optimal $O(n \ln n/\epsilon^2)$ samples, where $O(\cdot)$ hides an absolute constant…

Machine Learning · Computer Science 2020-12-01 Constantinos Daskalakis , Qinxuan Pan

The problem of learning tree-structured Gaussian graphical models from independent and identically distributed (i.i.d.) samples is considered. The influence of the tree structure and the parameters of the Gaussian distribution on the…

Machine Learning · Statistics 2010-05-06 Vincent Y. F. Tan , Animashree Anandkumar , Alan S. Willsky

Extremal graphical models are sparse statistical models for multivariate extreme events. The underlying graph encodes conditional independencies and enables a visual interpretation of the complex extremal dependence structure. For the…

Methodology · Statistics 2022-08-18 Sebastian Engelke , Stanislav Volgushev

We provide time- and sample-efficient algorithms for learning and testing latent-tree Ising models, i.e. Ising models that may only be observed at their leaf nodes. On the learning side, we obtain efficient algorithms for learning a…

Machine Learning · Computer Science 2023-07-11 Davin Choo , Yuval Dagan , Constantinos Daskalakis , Anthimos Vardis Kandiros

This paper considers learning of the graphical structure of a $p$-dimensional random vector $X \in R^p$ using both parametric and non-parametric methods. Unlike the previous works which observe $x$ directly, we consider the indirect…

Machine Learning · Statistics 2022-05-10 Hang Zhang , Afshin Abdi , Faramarz Fekri

In this paper we investigate the computational complexity of learning the graph structure underlying a discrete undirected graphical model from i.i.d. samples. We first observe that the notoriously difficult problem of learning parities…

Machine Learning · Statistics 2014-12-04 Guy Bresler , David Gamarnik , Devavrat Shah

We consider learning Ising tree models when the observations from the nodes are corrupted by independent but non-identically distributed noise with unknown statistics. Katiyar et al. (2020) showed that although the exact tree structure…

Machine Learning · Statistics 2021-01-25 Anshoo Tandon , Aldric H. J. Yuan , Vincent Y. F. Tan

We provide high probability finite sample complexity guarantees for hidden non-parametric structure learning of tree-shaped graphical models, whose hidden and observable nodes are discrete random variables with either finite or countable…

Machine Learning · Statistics 2021-04-01 Konstantinos E. Nikolakakis , Dionysios S. Kalogerias , Anand D. Sarwate

We consider the problem of learning the structure of ferromagnetic Ising models Markov on sparse Erdos-Renyi random graph. We propose simple local algorithms and analyze their performance in the regime of correlation decay. We prove that an…

Statistics Theory · Mathematics 2015-03-17 Animashree Anandkumar , Vincent Tan , Alan Willsky

For a large class of feature maps we provide a tight asymptotic characterisation of the test error associated with learning the readout layer, in the high-dimensional limit where the input dimension, hidden layer widths, and number of…

Machine Learning · Statistics 2024-06-11 Dominik Schröder , Daniil Dmitriev , Hugo Cui , Bruno Loureiro

We consider the task of learning Ising models when the signs of different random variables are flipped independently with possibly unequal, unknown probabilities. In this paper, we focus on the problem of robust estimation of…

Machine Learning · Statistics 2020-06-11 Ashish Katiyar , Vatsal Shah , Constantine Caramanis

In the study of Ising models on large locally tree-like graphs, in both rigorous and non-rigorous methods one is often led to understanding the so-called belief propagation distributional recursions and its fixed points. We prove that there…

Information Theory · Computer Science 2023-08-01 Qian Yu , Yury Polyanskiy

Ordinary Differential Equations (ODEs) have recently gained a lot of attention in machine learning. However, the theoretical aspects, e.g., identifiability and asymptotic properties of statistical estimation are still obscure. This paper…

Machine Learning · Statistics 2024-06-04 Yuanyuan Wang , Wei Huang , Mingming Gong , Xi Geng , Tongliang Liu , Kun Zhang , Dacheng Tao

We study the problem of learning directed acyclic graphs from continuous observational data, generated according to a linear Gaussian structural equation model. State-of-the-art structure learning methods for this setting have at least one…

Methodology · Statistics 2025-04-03 Tong Xu , Armeen Taeb , Simge Küçükyavuz , Ali Shojaie

We study non-Bayesian social learning on random directed graphs and show that under mild connectivity assumptions, all the agents almost surely learn the true state of the world asymptotically in time if the sequence of the associated…

Optimization and Control · Mathematics 2021-08-02 Rohit Parasnis , Massimo Franceschetti , Behrouz Touri

The problem of learning structural equation models (SEMs) from data is a fundamental problem in causal inference. We develop a new algorithm --- which is computationally and statistically efficient and works in the high-dimensional regime…

Machine Learning · Computer Science 2019-01-30 Asish Ghoshal , Jean Honorio

We study the problem of learning a tree Ising model from samples such that subsequent predictions made using the model are accurate. The prediction task considered in this paper is that of predicting the values of a subset of variables…

Statistics Theory · Mathematics 2018-06-15 Guy Bresler , Mina Karzand

We present novel information-theoretic limits on detecting sparse changes in Ising models, a problem that arises in many applications where network changes can occur due to some external stimuli. We show that the sample complexity for…

Information Theory · Computer Science 2020-11-10 Aditya Gangrade , Bobak Nazer , Venkatesh Saligrama

Learning high-dimensional distributions is a significant challenge in machine learning and statistics. Classical research has mostly concentrated on asymptotic analysis of such data under suitable assumptions. While existing works…

Machine Learning · Computer Science 2024-11-19 Sutanu Gayen , Sanket Kale , Sayantan Sen
‹ Prev 1 2 3 10 Next ›