English
Related papers

Related papers: Information-Theoretic Thresholds for Bipartite Lat…

200 papers

Empirical networks are often globally sparse, with a small average number of connections per node, when compared to the total size of the network. However, this sparsity tends not to be homogeneous, and networks can also be locally dense,…

Physics and Society · Physics 2020-07-20 Tiago P. Peixoto

In this paper, we present several density-type theorems which show how to find a copy of a sparse bipartite graph in a graph of positive density. Our results imply several new bounds for classical problems in graph Ramsey theory and improve…

Combinatorics · Mathematics 2007-11-12 Jacob Fox , Benny Sudakov

We establish conditions under which latent causal graphs are nonparametrically identifiable and can be reconstructed from unknown interventions in the latent space. Our primary focus is the identification of the latent structure in…

Machine Learning · Statistics 2023-11-06 Yibo Jiang , Bryon Aragam

We give nearly optimal bounds on the sample complexity of $(\widetilde{\Omega}(\epsilon),\epsilon)$-tolerant testing the $\rho$-independent set property in the dense graph setting. In particular, we give an algorithm that inspects a random…

Data Structures and Algorithms · Computer Science 2025-03-28 Cameron Seth

We describe a general technique that yields the first {\em Statistical Query lower bounds} for a range of fundamental high-dimensional learning problems involving Gaussian distributions. Our main results are for the problems of (1) learning…

Machine Learning · Computer Science 2017-05-18 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

Spatiotemporal graph represents a crucial data structure where the nodes and edges are embedded in a geometric space and can evolve dynamically over time. Nowadays, spatiotemporal graph data is becoming increasingly popular and important,…

Machine Learning · Computer Science 2022-03-02 Yuanqi Du , Xiaojie Guo , Hengning Cao , Yanfang Ye , Liang Zhao

The rapid development of high-throughput technologies has enabled the generation of data from biological or disease processes that span multiple layers, like genomic, proteomic or metabolomic data, and further pertain to multiple sources,…

Machine Learning · Statistics 2022-01-25 Subhabrata Majumdar , George Michailidis

We develop a unified framework for distributed inference, semantic communication, and exploration in spatial networks by integrating stochastic geometry with information geometry - a direction that has not been explored in prior literature.…

Information Theory · Computer Science 2025-08-26 Gourab Ghatak

We investigate the in-distribution generalization of machine learning algorithms. We depart from traditional complexity-based approaches by analyzing information-theoretic bounds that quantify the dependence between a learning algorithm and…

Machine Learning · Statistics 2024-08-27 Borja Rodríguez-Gálvez , Ragnar Thobaben , Mikael Skoglund

What is the optimal number of independent observations from which a sparse Gaussian Graphical Model can be correctly recovered? Information-theoretic arguments provide a lower bound on the minimum number of samples necessary to perfectly…

Machine Learning · Computer Science 2018-11-20 Sidhant Misra , Marc Vuffray , Andrey Y. Lokhov

We study the problem of detecting the edge correlation between two random graphs with $n$ unlabeled nodes. This is formalized as a hypothesis testing problem, where under the null hypothesis, the two graphs are independently generated;…

Statistics Theory · Mathematics 2021-02-09 Yihong Wu , Jiaming Xu , Sophie H. Yu

Elastic similarity measures are fundamental to time series similarity search because of their ability to handle temporal misalignments. These measures are inherently computationally expensive, therefore necessitating the use of lower bounds…

Databases · Computer Science 2026-03-20 Zemin Chao , Boyu Xiao , Zitong Li , Zhixin Qi , Xianglong Liu , Hongzhi Wang

Denote by $A$ the adjacency matrix of an Erdos-Renyi graph with bounded average degree. We consider the problem of maximizing $\langle A-E\{A\},X\rangle$ over the set of positive semidefinite matrices $X$ with diagonal entries $X_{ii}=1$.…

Discrete Mathematics · Computer Science 2015-12-25 Andrea Montanari , Subhabrata Sen

In this paper, we study the task of detecting the edge dependency between two weighted random graphs. We formulate this task as a simple hypothesis testing problem, where under the null hypothesis, the two observed graphs are statistically…

Machine Learning · Computer Science 2024-09-25 Mor Oren , Vered Paslev , Wasim Huleihel

Multilayer (or deep) networks are powerful probabilistic models based on multiple stages of a linear transform followed by a non-linear (possibly random) function. In general, the linear transforms are defined by matrices and the non-linear…

Information Theory · Computer Science 2017-10-13 Galen Reeves

Finding hidden layers in complex networks is an important and a non-trivial problem in modern science. We explore the framework of quantum graphs to determine whether concealed parts of a multi-layer system exist and if so then what is…

Disordered Systems and Neural Networks · Physics 2021-10-04 Łukasz G. Gajewski , Julian Sienkiewicz , Janusz A. Hołyst

The paper proposes an identification procedure for autoregressive gaussian stationary stochastic processes wherein the manifest (or observed) variables are mostly related through a limited number of latent (or hidden) variables. The method…

Optimization and Control · Mathematics 2014-12-02 Mattia Zorzi , Rodolphe Sepulchre

Sparse inverse covariance estimation (i.e., edge de-tection) is an important research problem in recent years, wherethe goal is to discover the direct connections between a set ofnodes in a networked system based upon the observed…

Machine Learning · Computer Science 2021-01-15 Hang Yin , Xinyue Liu , Xiangnan Kong

To learn (statistical) dependencies among random variables requires exponentially large sample size in the number of observed random variables if any arbitrary joint probability distribution can occur. We consider the case that sparse data…

Machine Learning · Computer Science 2007-05-23 Dominik Janzing , Daniel Herrmann

Modern deep neural networks (DNNs) are typically trained with a global cross-entropy loss in a supervised end-to-end manner: neurons need to store their outgoing weights; training alternates between a forward pass (computation) and a…

Machine Learning · Computer Science 2025-11-03 Shuyan Lyu , Zhanzimo Wu , Junliang Du