English
Related papers

Related papers: Optimal Rates for Learning Hidden Tree Structures

200 papers

We consider the problem of modeling discrete-valued vector time series data using extensions of Chow-Liu tree models to capture both dependencies across time and dependencies across variables. Conditional Chow-Liu tree models are…

Machine Learning · Computer Science 2012-07-19 Sergey Kirshner , Padhraic Smyth , Andrew Robertson

We revisit the problem of learning from untrusted batches introduced by Qiao and Valiant [QV17]. Recently, Jain and Orlitsky [JO19] gave a simple semidefinite programming approach based on the cut-norm that achieves essentially…

Machine Learning · Computer Science 2020-06-09 Sitan Chen , Jerry Li , Ankur Moitra

The information reconstruction problem on an infinite tree, is to collect and analyze massive data samples at the $n$th level of the tree to identify whether there is non-vanishing information of the root, as $n$ goes to infinity. This…

Probability · Mathematics 2019-10-02 Wenjian Liu , Ning Ning

Bayesian structure learning is the NP-hard problem of discovering a Bayesian network that optimally represents a given set of training data. In this paper we study the computational worst-case complexity of exact Bayesian structure learning…

Machine Learning · Computer Science 2012-03-19 Sebastian Ordyniak , Stefan Szeider

This paper studies the problem of shuffled linear regression, where the correspondence between predictors and responses in a linear model is obfuscated by a latent permutation. Specifically, we consider the model $y = \Pi_* X \beta_* + w$,…

Statistics Theory · Mathematics 2024-02-16 Leon Lufkin , Yihong Wu , Jiaming Xu

A new synthesis scheme is proposed to effectively generate a random vector with prescribed joint density that induces a (latent) Gaussian tree structure. The quality of synthesis is measured by total variation distance between the…

Information Theory · Computer Science 2017-05-09 Ali Moharrer , Shuangqing Wei , George T. Amariucai , Jing Deng

In the noisy population recovery problem of Dvir et al., the goal is to learn an unknown distribution $f$ on binary strings of length $n$ from noisy samples. For some parameter $\mu \in [0,1]$, a noisy sample is generated by flipping each…

Computational Complexity · Computer Science 2016-02-25 Anindya De , Michael Saks , Sijian Tang

Despite the widespread application of latent factor analysis, existing methods suffer from the following weaknesses: requiring the number of factors to be known, lack of theoretical guarantees for learning the model structure, and…

Methodology · Statistics 2023-06-06 Dale S. Kim , Qing Zhou

The configuration model is a cornerstone of statistical assessment of network structure. While the Chung-Lu model is among the most widely used configuration models, it systematically oversamples edges between large-degree nodes, leading to…

Social and Information Networks · Computer Science 2025-10-23 Xuanchi Li , Xin Wang , Sadamori Kojaku

Causal discovery in the presence of missing data introduces a chicken-and-egg dilemma. While the goal is to recover the true causal structure, robust imputation requires considering the dependencies or, preferably, causal relations among…

Machine Learning · Computer Science 2024-06-04 Vy Vo , He Zhao , Trung Le , Edwin V. Bonilla , Dinh Phung

We study the task of agnostically learning halfspaces under the Gaussian distribution. Specifically, given labeled examples $(\mathbf{x},y)$ from an unknown distribution on $\mathbb{R}^n \times \{ \pm 1\}$, whose marginal distribution on…

Machine Learning · Computer Science 2023-02-14 Ilias Diakonikolas , Daniel M. Kane , Lisheng Ren

One fundamental goal of high-dimensional statistics is to detect or recover planted structure (such as a low-rank matrix) hidden in noisy data. A growing body of work studies low-degree polynomials as a restricted model of computation for…

Statistics Theory · Mathematics 2022-06-22 Tselil Schramm , Alexander S. Wein

In the standard Gaussian linear measurement model $Y=X\mu_0+\xi \in \mathbb{R}^m$ with a fixed noise level $\sigma>0$, we consider the problem of estimating the unknown signal $\mu_0$ under a convex constraint $\mu_0 \in K$, where $K$ is a…

Statistics Theory · Mathematics 2022-01-24 Qiyang Han

We consider the problem of learning the weighted edges of a graph by observing the noisy times of infection for multiple epidemic cascades on this graph. Past work has considered this problem when the cascade information, i.e., infection…

Social and Information Networks · Computer Science 2019-08-13 Jessica Hoffmann , Constantine Caramanis

Learning graphs from data automatically has shown encouraging performance on clustering and semisupervised learning tasks. However, real data are often corrupted, which may cause the learned graph to be inexact or unreliable. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Zhao Kang , Haiqi Pan , Steven C. H. Hoi , Zenglin Xu

Consider an information source generating a symbol at the root of a tree network whose links correspond to noisy communication channels, and broadcasting it through the network. We study the problem of reconstructing the transmitted symbol…

Statistical Mechanics · Physics 2009-11-11 Marc Mezard , Andrea Montanari

Graph learning on molecules makes use of information from both the molecular structure and the features attached to that structure. Much work has been conducted on biasing either towards structure or features, with the aim that bias…

Machine Learning · Computer Science 2025-02-03 Alex O. Davies , Nirav S. Ajmeri , Telmo de Menezes e Silva Filho

In this paper, learning of tree-structured Gaussian graphical models from distributed data is addressed. In our model, samples are stored in a set of distributed machines where each machine has access to only a subset of features. A central…

Machine Learning · Computer Science 2018-12-05 Mostafa Tavassolipour , Seyed Abolfazl Motahari , Mohammad-Taghi Manzuri Shalmani

The inclusion of a macroscopic adaptive threshold is studied for the retrieval dynamics of both layered feedforward and fully connected neural network models with synaptic noise. These two types of architectures require a different method…

Disordered Systems and Neural Networks · Physics 2007-08-03 D. Bolle , R. Heylen

We derive approximation bounds for learning single neuron models using thresholded gradient descent when both the labels and the covariates are possibly corrupted adversarially. We assume the data follows the model $y =…

Machine Learning · Statistics 2024-09-06 Arvind Rathnashyam , Alex Gittens