English
Related papers

Related papers: Robust recovery for stochastic block models

200 papers

We introduce a class of stochastic algorithms for minimizing weakly convex functions over proximally smooth sets. As their main building blocks, the algorithms use simplified models of the objective function and the constraint set, along…

Optimization and Control · Mathematics 2025-01-22 Damek Davis , Dmitriy Drusvyatskiy , Zhan Shi

Motivated by a neuroscience application we study the problem of statistical estimation of a high-dimensional covariance matrix with a block structure. The block model embeds a structural assumption: the population of items (neurons) can be…

Methodology · Statistics 2025-03-03 Yunran Chen , Surya T Tokdar , Jennifer M Groh

We explore the connection between outlier-robust high-dimensional statistics and non-convex optimization in the presence of sparsity constraints, with a focus on the fundamental tasks of robust sparse mean estimation and robust sparse PCA.…

Machine Learning · Computer Science 2022-11-15 Yu Cheng , Ilias Diakonikolas , Rong Ge , Shivam Gupta , Daniel M. Kane , Mahdi Soltanolkotabi

Robust Optimization has traditionally taken a pessimistic, or worst-case viewpoint of uncertainty which is motivated by a desire to find sets of optimal policies that maintain feasibility under a variety of operating conditions. In this…

Machine Learning · Statistics 2017-11-22 Matthew Norton , Akiko Takeda , Alexander Mafusalov

We consider the problem of estimation of a low-rank matrix from a limited number of noisy rank-one projections. In particular, we propose two fast, non-convex \emph{proper} algorithms for matrix recovery and support them with rigorous…

Machine Learning · Statistics 2017-05-23 Mohammadreza Soltani , Chinmay Hegde

Robust control seeks stabilizing policies that perform reliably under adversarial disturbances, with $\mathcal{H}_\infty$ control as a classical formulation. It is known that policy optimization of robust $\mathcal{H}_\infty$ control…

Optimization and Control · Mathematics 2025-10-01 Yuto Watanabe , Feng-Yi Liao , Yang Zheng

Large sectors of the recent optimization literature focused in the last decade on the development of optimal stochastic first order schemes for constrained convex models under progressively relaxed assumptions. Stochastic proximal point is…

Optimization and Control · Mathematics 2020-05-05 Andrei Patrascu

We investigate implications of the (extended) low-degree conjecture (recently formalized in [MW23]) in the context of the symmetric stochastic block model. Assuming the conjecture holds, we establish that no polynomial-time algorithm can…

Computational Complexity · Computer Science 2025-04-29 Jingqiu Ding , Yiding Hua , Lucas Slot , David Steurer

In the area of sparse recovery, numerous researches hint that non-convex penalties might induce better sparsity than convex ones, but up until now those corresponding non-convex algorithms lack convergence guarantees from the initial…

Information Theory · Computer Science 2014-04-29 Laming Chen , Yuantao Gu

This paper presents a novel algorithm integrating global and robust optimization methods to solve continuous non-convex quadratic problems under convex uncertainty sets. The proposed Robust spatial branch-and-bound (RsBB) algorithm combines…

Optimization and Control · Mathematics 2025-11-18 Asimina Marousi , Vassilis M. Charitopoulos

As machine learning models are increasingly being employed to make consequential decisions in real-world settings, it becomes critical to ensure that individuals who are adversely impacted (e.g., loan denied) by the predictions of these…

Machine Learning · Computer Science 2023-10-12 Martin Pawelczyk , Teresa Datta , Johannes van-den-Heuvel , Gjergji Kasneci , Himabindu Lakkaraju

We describe and analyze a simple algorithm for principal component analysis and singular value decomposition, VR-PCA, which uses computationally cheap stochastic iterations, yet converges exponentially fast to the optimal solution. In…

Machine Learning · Computer Science 2015-08-03 Ohad Shamir

The stochastic block model is one of the oldest and most ubiquitous models for studying clustering and community detection. In an exciting sequence of developments, motivated by deep but non-rigorous ideas from statistical physics, Decelle…

Data Structures and Algorithms · Computer Science 2016-03-23 Ankur Moitra , William Perry , Alexander S. Wein

We analyze convergence rates of stochastic optimization procedures for non-smooth convex optimization problems. By combining randomized smoothing techniques with accelerated gradient methods, we obtain convergence rates of stochastic…

Optimization and Control · Mathematics 2012-04-10 John C. Duchi , Peter L. Bartlett , Martin J. Wainwright

In this paper, we study the problem of matrix recovery, which aims to restore a target matrix of authentic samples from grossly corrupted observations. Most of the existing methods, such as the well-known Robust Principal Component Analysis…

Computer Vision and Pattern Recognition · Computer Science 2018-11-12 Xingyu Xie , Jianlong Wu , Guangcan Liu , Jun Wang

We consider a blind identification problem in which we aim to recover a statistical model of a network without knowledge of the network's edges, but based solely on nodal observations of a certain process. More concretely, we focus on…

Machine Learning · Computer Science 2020-05-08 Michael T. Schaub , Santiago Segarra , John N. Tsitsiklis

We study robust community detection in the context of node-corrupted stochastic block model, where an adversary can arbitrarily modify all the edges incident to a fraction of the $n$ vertices. We present the first polynomial-time algorithm…

Machine Learning · Computer Science 2023-08-29 Jingqiu Ding , Tommaso d'Orsi , Yiding Hua , David Steurer

We consider the community detection problem in sparse random hypergraphs under the non-uniform hypergraph stochastic block model (HSBM), a general model of random networks with community structure and higher-order interactions. When the…

Statistics Theory · Mathematics 2024-12-11 Ioana Dumitriu , Haixiao Wang , Yizhe Zhu

The task of recovering a low-rank matrix from its noisy linear measurements plays a central role in computational science. Smooth formulations of the problem often exhibit an undesirable phenomenon: the condition number, classically…

Optimization and Control · Mathematics 2019-04-24 Vasileios Charisopoulos , Yudong Chen , Damek Davis , Mateo Díaz , Lijun Ding , Dmitriy Drusvyatskiy

Robust optimization is a common framework in optimization under uncertainty when the problem parameters are not known, but it is rather known that the parameters belong to some given uncertainty set. In the robust optimization framework the…

Optimization and Control · Mathematics 2014-02-27 Aharon Ben-Tal , Elad Hazan , Tomer Koren , Shie Mannor