English
Related papers

Related papers: A Convergence Analysis on URV Refinement

200 papers

In this paper we analyse convergence of projected fixed-point iteration on a Riemannian manifold of matrices with fixed rank. As a retraction method we use `projector splitting scheme'. We prove that the projector splitting scheme converges…

Numerical Analysis · Mathematics 2016-04-08 Denis Kolesnikov , Ivan Oseledets

In this paper, we develop an approach to recursively estimate the quadratic risk for matrix recovery problems regularized with spectral functions. Toward this end, in the spirit of the SURE theory, a key step is to compute the (weak)…

Optimization and Control · Mathematics 2012-11-07 Charles-Alban Deledalle , Samuel Vaiter , Gabriel Peyré , Jalal Fadili , Charles Dossal

This paper revisits and extends the convergence and robustness properties of value and policy iteration algorithms for discrete-time linear quadratic regulator problems. In the model-based case, we extend current results concerning the…

Systems and Control · Electrical Eng. & Systems 2025-04-11 Bowen Song , Chenxuan Wu , Andrea Iannelli

We prove an estimate on the smallest singular value of a multiplicatively and additively deformed random rectangular matrix. Suppose $n\le N \le M \le \Lambda N$ for some constant $\Lambda \ge 1$. Let $X$ be an $M\times n$ random matrix…

Probability · Mathematics 2018-10-17 Fan Yang

The reduced-rank regression model is a popular model to deal with multivariate response and multiple predictors, and is widely used in biology, chemometrics, econometrics, engineering, and other fields. In the reduced-rank regression…

Methodology · Statistics 2022-07-05 Canhong Wen , Qin Wang , Yuan Jiang

Matrix completion is a widely used technique for image inpainting and personalized recommender system, etc. In this work, we focus on accelerating the matrix completion using faster randomized singular value decomposition (rSVD). Firstly,…

Machine Learning · Computer Science 2018-10-17 Xu Feng , Wenjian Yu , Yaohang Li

Robust principal component analysis (RPCA) is a widely used tool for dimension reduction. In this work, we propose a novel non-convex algorithm, coined Iterated Robust CUR (IRCUR), for solving RPCA problems, which dramatically improves the…

Machine Learning · Statistics 2021-02-09 HanQin Cai , Keaton Hamm , Longxiu Huang , Jiaqi Li , Tao Wang

The matrix completion problem consists of finding or approximating a low-rank matrix based on a few samples of this matrix. We propose a new algorithm for matrix completion that minimizes the least-square distance on the sampling set over…

Optimization and Control · Mathematics 2012-09-19 Bart Vandereycken

In this paper, we propose an efficient and scalable low rank matrix completion algorithm. The key idea is to extend orthogonal matching pursuit method from the vector case to the matrix case. We further propose an economic version of our…

Machine Learning · Computer Science 2014-04-17 Zheng Wang , Ming-Jun Lai , Zhaosong Lu , Wei Fan , Hasan Davulcu , Jieping Ye

This paper considers the problem of updating the rank-k truncated Singular Value Decomposition (SVD) of matrices subject to the addition of new rows and/or columns over time. Such matrix problems represent an important computational kernel…

A problem of paramount importance in both pure (Restricted Invertibility problem) and applied mathematics (Feature extraction) is the one of selecting a submatrix of a given matrix, such that this submatrix has its smallest singular value…

Machine Learning · Computer Science 2018-04-05 Stephane Chretien , Zhen-Wai Olivier Ho

Matrix completion algorithms recover a low rank matrix from a small fraction of the entries, each entry contaminated with additive errors. In practice, the singular vectors and singular values of the low rank matrix play a pivotal role for…

Methodology · Statistics 2016-05-03 Juhee Cho , Donggyu Kim , Karl Rohe

This paper develops a novel framework for phase retrieval, a problem which arises in X-ray crystallography, diffraction imaging, astronomical imaging and many other applications. Our approach combines multiple structured illuminations…

Information Theory · Computer Science 2011-09-21 Emmanuel J. Candes , Yonina Eldar , Thomas Strohmer , Vlad Voroninski

Relying on recent advances in statistical estimation of covariance distances based on random matrix theory, this article proposes an improved covariance and precision matrix estimation for a wide family of metrics. The method is shown to…

Machine Learning · Statistics 2021-02-03 Malik Tiomoko , Florent Bouchard , Guillaume Ginholac , Romain Couillet

Parameter-efficient fine-tuning for pre-trained Vision Transformers aims to adeptly tailor a model to downstream tasks by learning a minimal set of new adaptation parameters while preserving the frozen majority of pre-trained parameters.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Wei Dong , Xing Zhang , Bihui Chen , Dawei Yan , Zhijun Lin , Qingsen Yan , Peng Wang , Yang Yang

In space-time adaptive processing (STAP) of the airborne radar system, it is very important to realize sparse restoration of the clutter covariance matrix with a small number of samples. In this paper, a clutter suppression method for…

Signal Processing · Electrical Eng. & Systems 2023-01-30 Tao Zhang , Haifang Zheng , Qijun Luo

We revisit the use of Stochastic Gradient Descent (SGD) for solving convex optimization problems that serve as highly popular convex relaxations for many important low-rank matrix recovery problems such as \textit{matrix completion},…

Machine Learning · Computer Science 2020-06-16 Dan Garber

We analyze a distributed algorithm to compute a low-rank matrix factorization on $N$ clients, each holding a local dataset $\mathbf{S}^i \in \mathbb{R}^{n_i \times d}$, mathematically, we seek to solve $min_{\mathbf{U}^i \in…

Machine Learning · Computer Science 2025-07-22 Constantin Philippenko , Kevin Scaman , Laurent Massoulié

We study extensions of compressive sensing and low rank matrix recovery (matrix completion) to the recovery of low rank tensors of higher order from a small number of linear measurements. While the theoretical understanding of low rank…

Information Theory · Computer Science 2016-02-18 Holger Rauhut , Reinhold Schneider , Zeljka Stojanac

The advent of advanced crystallographic techniques has shifted structural biology from static, single-conformer models toward probing protein dynamics. Extracting cooperative motions from temporally and spatially averaged electron density…

Quantitative Methods · Quantitative Biology 2025-09-08 Avinash Mandaiya , Veit Elser