English
Related papers

Related papers: A theoretical guarantee for SyncRank

200 papers

This paper describes a fast algorithm for recovering low-rank matrices from their linear measurements contaminated with Poisson noise: the Poisson noise Maximum Likelihood Singular Value thresholding (PMLSV) algorithm. We propose a convex…

Machine Learning · Statistics 2014-12-22 Yang Cao , Yao Xie

We study the high-dimensional dynamics of online stochastic gradient descent (SGD) for the multi-spiked tensor model. This multi-index model arises from the tensor principal component analysis (PCA) problem with multiple spikes, where the…

Machine Learning · Statistics 2025-10-24 Gérard Ben Arous , Cédric Gerbelot , Vanessa Piccolo

Motivated by the philosophy and phenomenal success of compressed sensing, the problem of reconstructing a matrix from a sampling of its entries has attracted much attention recently. Such a problem can be viewed as an information-theoretic…

Information Theory · Computer Science 2009-05-15 Zhisu Zhu , Anthony Man-Cho So , Yinyu Ye

We consider estimation models of the form $Y=X^*+N$, where $X^*$ is some $m$-dimensional signal we wish to recover, and $N$ is symmetrically distributed noise that may be unbounded in all but a small $\alpha$ fraction of the entries. We…

Machine Learning · Computer Science 2022-11-15 Tommaso d'Orsi , Rajai Nasser , Gleb Novikov , David Steurer

Tensor completion is a fundamental tool for incomplete data analysis, where the goal is to predict missing entries from partial observations. However, existing methods often make the explicit or implicit assumption that the observed entries…

Machine Learning · Statistics 2022-03-18 Yuning Qiu , Guoxu Zhou , Qibin Zhao , Shengli Xie

We consider the phase retrieval problem of reconstructing a $n$-dimensional real or complex signal $\mathbf{X}^{\star}$ from $m$ (possibly noisy) observations $Y_\mu = | \sum_{i=1}^n \Phi_{\mu i} X^{\star}_i/\sqrt{n}|$, for a large class of…

Statistics Theory · Mathematics 2021-02-18 Antoine Maillard , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

We consider the problem of recovering the rank of a set of $n$ items based on noisy pairwise comparisons. We assume the SST class as the family of generative models. Our analysis gave sharp information theoretic upper and lower bound for…

Machine Learning · Statistics 2021-11-22 Yihan He

The angular synchronization problem of estimating a set of unknown angles from their known noisy pairwise differences arises in various applications. It can be reformulated as a optimization problem on graphs involving the graph Laplacian…

Optimization and Control · Mathematics 2022-09-12 Frank Filbir , Felix Krahmer , Oleh Melnyk

For the problems of low-rank matrix completion, the efficiency of the widely-used nuclear norm technique may be challenged under many circumstances, especially when certain basis coefficients are fixed, for example, the low-rank correlation…

Optimization and Control · Mathematics 2015-06-23 Weimin Miao , Shaohua Pan , Defeng Sun

We study the problem of recovering an incomplete $m\times n$ matrix of rank $r$ with columns arriving online over time. This is known as the problem of life-long matrix completion, and is widely applied to recommendation system, computer…

Machine Learning · Computer Science 2016-12-04 Maria-Florina Balcan , Hongyang Zhang

We study the algorithmic thresholds for principal component analysis of Gaussian $k$-tensors with a planted rank-one spike, via Langevin dynamics and gradient descent. In order to efficiently recover the spike from natural initializations,…

Probability · Mathematics 2023-06-23 Gerard Ben Arous , Reza Gheissari , Aukosh Jagannath

We propose a general framework for reconstructing and denoising single entries of incomplete and noisy entries. We describe: effective algorithms for deciding if and entry can be reconstructed and, if so, for reconstructing and denoising…

Machine Learning · Statistics 2013-04-02 Franz J. Király , Louis Theran

We describe a seriation algorithm for ranking a set of items given pairwise comparisons between these items. Intuitively, the algorithm assigns similar rankings to items that compare similarly with all others. It does so by constructing a…

Machine Learning · Computer Science 2016-03-11 Fajwel Fogel , Alexandre d'Aspremont , Milan Vojnovic

Identifying the most influential nodes in a network, typically using centrality measures, is a central task in applied network analysis. However, real-world networks are often constructed from noisy or incomplete data, which can distort…

Statistics Theory · Mathematics 2026-05-26 Hui Shen , Eric D. Kolaczyk

In this paper, we study the problem of recovering a low-rank matrix (the principal components) from a high-dimensional data matrix despite both small entry-wise noise and gross sparse errors. Recently, it has been shown that a convex…

Information Theory · Computer Science 2010-01-15 Zihan Zhou , Xiaodong Li , John Wright , Emmanuel Candes , Yi Ma

We consider the problem of estimation of a low-rank matrix from a limited number of noisy rank-one projections. In particular, we propose two fast, non-convex \emph{proper} algorithms for matrix recovery and support them with rigorous…

Machine Learning · Statistics 2017-05-23 Mohammadreza Soltani , Chinmay Hegde

This paper studies the problem of deterministic rank-one matrix completion. It is known that the simplest semidefinite programming relaxation, involving minimization of the nuclear norm, does not in general return the solution for this…

Numerical Analysis · Mathematics 2018-01-03 Augustin Cosse , Laurent Demanet

We derive an a priori parameter range for overrelaxation of the Sinkhorn algorithm, which guarantees global convergence and a strictly faster asymptotic local convergence. Guided by the spectral analysis of the linearized problem we pursue…

Optimization and Control · Mathematics 2021-12-07 Tobias Lehmann , Max-K. von Renesse , Alexander Sambale , André Uschmajew

This paper addresses the challenges of aligning large language models (LLMs) with human values via preference learning (PL), focusing on incomplete and corrupted data in preference datasets. We propose a novel method for robustly and…

Artificial Intelligence · Computer Science 2025-10-30 Son The Nguyen , Niranjan Uma Naresh , Theja Tulabandhula

We propose a new framework -- Square Root Principal Component Pursuit -- for low-rank matrix recovery from observations corrupted with noise and outliers. Inspired by the square root Lasso, this new formulation does not require prior…

Machine Learning · Computer Science 2021-11-01 Junhui Zhang , Jingkai Yan , John Wright