中文
相关论文

相关论文: Robust recovery for stochastic block models

200 篇论文

We introduce a class of stochastic algorithms for minimizing weakly convex functions over proximally smooth sets. As their main building blocks, the algorithms use simplified models of the objective function and the constraint set, along…

最优化与控制 · 数学 2025-01-22 Damek Davis , Dmitriy Drusvyatskiy , Zhan Shi

Motivated by a neuroscience application we study the problem of statistical estimation of a high-dimensional covariance matrix with a block structure. The block model embeds a structural assumption: the population of items (neurons) can be…

统计方法学 · 统计学 2025-03-03 Yunran Chen , Surya T Tokdar , Jennifer M Groh

We explore the connection between outlier-robust high-dimensional statistics and non-convex optimization in the presence of sparsity constraints, with a focus on the fundamental tasks of robust sparse mean estimation and robust sparse PCA.…

机器学习 · 计算机科学 2022-11-15 Yu Cheng , Ilias Diakonikolas , Rong Ge , Shivam Gupta , Daniel M. Kane , Mahdi Soltanolkotabi

Robust Optimization has traditionally taken a pessimistic, or worst-case viewpoint of uncertainty which is motivated by a desire to find sets of optimal policies that maintain feasibility under a variety of operating conditions. In this…

机器学习 · 统计学 2017-11-22 Matthew Norton , Akiko Takeda , Alexander Mafusalov

We consider the problem of estimation of a low-rank matrix from a limited number of noisy rank-one projections. In particular, we propose two fast, non-convex \emph{proper} algorithms for matrix recovery and support them with rigorous…

机器学习 · 统计学 2017-05-23 Mohammadreza Soltani , Chinmay Hegde

Robust control seeks stabilizing policies that perform reliably under adversarial disturbances, with $\mathcal{H}_\infty$ control as a classical formulation. It is known that policy optimization of robust $\mathcal{H}_\infty$ control…

最优化与控制 · 数学 2025-10-01 Yuto Watanabe , Feng-Yi Liao , Yang Zheng

Large sectors of the recent optimization literature focused in the last decade on the development of optimal stochastic first order schemes for constrained convex models under progressively relaxed assumptions. Stochastic proximal point is…

最优化与控制 · 数学 2020-05-05 Andrei Patrascu

We investigate implications of the (extended) low-degree conjecture (recently formalized in [MW23]) in the context of the symmetric stochastic block model. Assuming the conjecture holds, we establish that no polynomial-time algorithm can…

计算复杂性 · 计算机科学 2025-04-29 Jingqiu Ding , Yiding Hua , Lucas Slot , David Steurer

In the area of sparse recovery, numerous researches hint that non-convex penalties might induce better sparsity than convex ones, but up until now those corresponding non-convex algorithms lack convergence guarantees from the initial…

信息论 · 计算机科学 2014-04-29 Laming Chen , Yuantao Gu

This paper presents a novel algorithm integrating global and robust optimization methods to solve continuous non-convex quadratic problems under convex uncertainty sets. The proposed Robust spatial branch-and-bound (RsBB) algorithm combines…

最优化与控制 · 数学 2025-11-18 Asimina Marousi , Vassilis M. Charitopoulos

As machine learning models are increasingly being employed to make consequential decisions in real-world settings, it becomes critical to ensure that individuals who are adversely impacted (e.g., loan denied) by the predictions of these…

机器学习 · 计算机科学 2023-10-12 Martin Pawelczyk , Teresa Datta , Johannes van-den-Heuvel , Gjergji Kasneci , Himabindu Lakkaraju

We describe and analyze a simple algorithm for principal component analysis and singular value decomposition, VR-PCA, which uses computationally cheap stochastic iterations, yet converges exponentially fast to the optimal solution. In…

机器学习 · 计算机科学 2015-08-03 Ohad Shamir

The stochastic block model is one of the oldest and most ubiquitous models for studying clustering and community detection. In an exciting sequence of developments, motivated by deep but non-rigorous ideas from statistical physics, Decelle…

数据结构与算法 · 计算机科学 2016-03-23 Ankur Moitra , William Perry , Alexander S. Wein

We analyze convergence rates of stochastic optimization procedures for non-smooth convex optimization problems. By combining randomized smoothing techniques with accelerated gradient methods, we obtain convergence rates of stochastic…

最优化与控制 · 数学 2012-04-10 John C. Duchi , Peter L. Bartlett , Martin J. Wainwright

In this paper, we study the problem of matrix recovery, which aims to restore a target matrix of authentic samples from grossly corrupted observations. Most of the existing methods, such as the well-known Robust Principal Component Analysis…

计算机视觉与模式识别 · 计算机科学 2018-11-12 Xingyu Xie , Jianlong Wu , Guangcan Liu , Jun Wang

We consider a blind identification problem in which we aim to recover a statistical model of a network without knowledge of the network's edges, but based solely on nodal observations of a certain process. More concretely, we focus on…

机器学习 · 计算机科学 2020-05-08 Michael T. Schaub , Santiago Segarra , John N. Tsitsiklis

We study robust community detection in the context of node-corrupted stochastic block model, where an adversary can arbitrarily modify all the edges incident to a fraction of the $n$ vertices. We present the first polynomial-time algorithm…

机器学习 · 计算机科学 2023-08-29 Jingqiu Ding , Tommaso d'Orsi , Yiding Hua , David Steurer

We consider the community detection problem in sparse random hypergraphs under the non-uniform hypergraph stochastic block model (HSBM), a general model of random networks with community structure and higher-order interactions. When the…

统计理论 · 数学 2024-12-11 Ioana Dumitriu , Haixiao Wang , Yizhe Zhu

The task of recovering a low-rank matrix from its noisy linear measurements plays a central role in computational science. Smooth formulations of the problem often exhibit an undesirable phenomenon: the condition number, classically…

Robust optimization is a common framework in optimization under uncertainty when the problem parameters are not known, but it is rather known that the parameters belong to some given uncertainty set. In the robust optimization framework the…

最优化与控制 · 数学 2014-02-27 Aharon Ben-Tal , Elad Hazan , Tomer Koren , Shie Mannor