English
Related papers

Related papers: Computational Lower Bounds for Graphon Estimation …

200 papers

We consider two problems of estimation in high-dimensional Gaussian models. The first problem is that of estimating a linear functional of the means of $n$ independent $p$-dimensional Gaussian vectors, under the assumption that most of…

Statistics Theory · Mathematics 2018-11-12 Olivier Collier , Arnak S. Dalalyan

We study robust community detection in the context of node-corrupted stochastic block model, where an adversary can arbitrarily modify all the edges incident to a fraction of the $n$ vertices. We present the first polynomial-time algorithm…

Machine Learning · Computer Science 2023-08-29 Jingqiu Ding , Tommaso d'Orsi , Yiding Hua , David Steurer

Community detection in hypergraphs is explored. Under a generative hypergraph model called "d-wise hypergraph stochastic block model" (d-hSBM) which naturally extends the Stochastic Block Model from graphs to d-uniform hypergraphs, the…

Information Theory · Computer Science 2018-02-06 I Chien , Chung-Yi Lin , I-Hsiang Wang

The interplay between computational efficiency and statistical accuracy in high-dimensional inference has drawn increasing attention in the literature. In this paper, we study computational and statistical boundaries for submatrix…

Statistics Theory · Mathematics 2020-07-27 T. Tony Cai , Tengyuan Liang , Alexander Rakhlin

Graph Neural Networks (GNNs) are a predominant method for graph representation learning. However, beyond subgraph frequency estimation, their application to network motif significance-profile (SP) prediction remains under-explored, with no…

Machine Learning · Computer Science 2025-07-11 Pedro C. Vieira , Miguel E. P. Silva , Pedro Manuel Pinto Ribeiro

In many high-dimensional problems,polynomial-time algorithms fall short of achieving the statistical limits attainable without computational constraints. A powerful approach to probe the limits of polynomial-time algorithms is to study the…

Statistics Theory · Mathematics 2025-07-11 Bertrand Even , Christophe Giraud , Nicolas Verzelen

We lower bound the complexity of finding $\epsilon$-stationary points (with gradient norm at most $\epsilon$) using stochastic first-order methods. In a well-studied model where algorithms access smooth, potentially non-convex functions…

Optimization and Control · Mathematics 2022-03-01 Yossi Arjevani , Yair Carmon , John C. Duchi , Dylan J. Foster , Nathan Srebro , Blake Woodworth

This paper introduces a new proximal stochastic gradient method with variance reduction and stabilization for minimizing the sum of a convex stochastic function and a group sparsity-inducing regularization function. Since the method may be…

Optimization and Control · Mathematics 2023-02-15 Yutong Dai , Guanyi Wang , Frank E. Curtis , Daniel P. Robinson

We develop the first pure node-differentially-private algorithms for learning stochastic block models and for graphon estimation with polynomial running time for any constant number of blocks. The statistical utility guarantees match those…

Data Structures and Algorithms · Computer Science 2024-04-19 Hongjie Chen , Jingqiu Ding , Tommaso d'Orsi , Yiding Hua , Chih-Hung Liu , David Steurer

Under a standard assumption in complexity theory (NP not in P/poly), we demonstrate a gap between the minimax prediction risk for sparse linear regression that can be achieved by polynomial-time algorithms, and that achieved by optimal…

Statistics Theory · Mathematics 2014-05-22 Yuchen Zhang , Martin J. Wainwright , Michael I. Jordan

We consider minimum variance estimation within the sparse linear Gaussian model (SLGM). A sparse vector is to be estimated from a linearly transformed version embedded in Gaussian noise. Our analysis is based on the theory of reproducing…

Information Theory · Computer Science 2013-04-16 Alexander Jung , Sebastian Schmutzhard , Franz Hlawatsch , Zvika Ben-Haim , Yonina C. Eldar

A popular approach to minimize a finite-sum of convex functions is stochastic gradient descent (SGD) and its variants. Fundamental research questions associated with SGD include: (i) To find a lower bound on the number of times that the…

Optimization and Control · Mathematics 2022-08-16 Nuozhou Wang , Shuzhong Zhang

We study graphons as a non-parametric generalization of stochastic block models, and show how to obtain compactly represented estimators for sparse networks in this framework. Our algorithms and analysis go beyond previous work in several…

Statistics Theory · Mathematics 2016-02-25 Christian Borgs , Jennifer T. Chayes , Henry Cohn , Shirshendu Ganguly

This paper investigates the computational and statistical limits in clustering matrix-valued observations. We propose a low-rank mixture model (LrMM), adapted from the classical Gaussian mixture model (GMM) to treat matrix-valued…

Statistics Theory · Mathematics 2023-06-08 Zhongyuan Lyu , Dong Xia

There is growing interest in improving our algorithmic understanding of fundamental statistical problems such as mean estimation, driven by the goal of understanding the limits of what we can extract from valuable data. The state of the art…

Statistics Theory · Mathematics 2023-11-22 Trung Dang , Jasper C. H. Lee , Maoyuan Song , Paul Valiant

We revisit the problem of computing submatrices of the Cram\'er-Rao bound (CRB), which lower bounds the variance of any unbiased estimator of a vector parameter $\vth$. We explore iterative methods that avoid direct inversion of the Fisher…

Information Theory · Computer Science 2015-06-04 Paul Tune

Low energy barrier magnet (LBM) technology has recently been proposed as a candidate for accelerating algorithms based on energy minimization and probabilistic graphs because their physical characteristics have a one-to-one mapping onto the…

Emerging Technologies · Computer Science 2025-03-03 Md Golam Morshed , Samiran Ganguly , Avik W. Ghosh

A central question in high-dimensional statistics is to understand statistical--computational gaps: regimes in which recovering a hidden signal is information-theoretically possible but conjectured to be computationally intractable. The…

Statistics Theory · Mathematics 2026-05-29 Daniel Fu , Youngtak Sohn

The stochastic block model is a canonical random graph model for clustering and community detection on network-structured data. Decades of extensive study on the problem have established many profound results, among which the phase…

Machine Learning · Statistics 2024-02-29 Junda Sheng , Thomas Strohmer

We consider the classical Minimum Crossing Number problem: given an $n$-vertex graph $G$, compute a drawing of $G$ in the plane, while minimizing the number of crossings between the images of its edges. This is a fundamental and extensively…

Data Structures and Algorithms · Computer Science 2022-02-15 Julia Chuzhoy , Zihan Tan