English
Related papers

Related papers: Alternating Least-Squares for Low-Rank Matrix Reco…

200 papers

This article focuses on the problem of reconstructing low-rank matrices from underdetermined measurements using alternating optimization strategies. We endeavour to combine an alternating least-squares based estimation strategy with ideas…

Statistics Theory · Mathematics 2014-07-15 Kezhi Li , Martin Sundin , Cristian R. Rojas , Saikat Chatterjee , Magnus Jansson

We propose a new Iteratively Reweighted Least Squares (IRLS) algorithm for the problem of completing or denoising low-rank matrices that are structured, e.g., that possess a Hankel, Toeplitz or block-Hankel/Toeplitz structure. The algorithm…

Optimization and Control · Mathematics 2018-12-06 Christian Kümmerle , Claudio Mayrink Verdun

We consider the problem of reconstructing rank-one matrices from random linear measurements, a task that appears in a variety of problems in signal processing, statistics, and machine learning. In this paper, we focus on the Alternating…

Machine Learning · Computer Science 2022-04-26 Kiryung Lee , Dominik Stöger

In this paper, we propose a novel element-wise subset selection method for the alternating least squares (ALS) algorithm, focusing on low-rank matrix factorization involving matrices with missing values, as commonly encountered in…

Methodology · Statistics 2025-11-12 Dunyao Xue , Mengyu Li , Cheng Meng , Jingyi Zhang

We propose Matrix ALPS for recovering a sparse plus low-rank decomposition of a matrix given its corrupted and incomplete linear measurements. Our approach is a first-order projected gradient method over non-convex sets, and it exploits a…

Information Theory · Computer Science 2012-06-22 Anastasios Kyrillidis , Volkan Cevher

Tensor ring (TR) decomposition has been widely applied as an effective approach in a variety of applications to discover the hidden low-rank patterns in multidimensional data. A well-known method for TR decomposition is the alternating…

Numerical Analysis · Mathematics 2022-10-21 Yajie Yu , Hanyu Li

The low multilinear rank approximation, also known as the truncated Tucker decomposition, has been extensively utilized in many applications that involve higher-order tensors. Popular methods for low multilinear rank approximation usually…

Numerical Analysis · Mathematics 2021-04-05 Chuanfu Xiao , Chao Yang , Min Li

We consider the problem of reconstructing a low rank matrix from a subset of its entries and analyze two variants of the so-called Alternating Minimization algorithm, which has been proposed in the past. We establish that when the…

Machine Learning · Statistics 2016-09-21 David Gamarnik , Sidhant Misra

We propose a new iteratively reweighted least squares (IRLS) algorithm for the recovery of a matrix $X \in \mathbb{C}^{d_1\times d_2}$ of rank $r \ll\min(d_1,d_2)$ from incomplete linear observations, solving a sequence of low complexity…

Numerical Analysis · Mathematics 2018-02-28 Christian Kümmerle , Juliane Sigl

Matrix factorization is an important representation learning algorithm, e.g., recommender systems, where a large matrix can be factorized into the product of two low dimensional matrices termed as latent representations. This paper…

Information Theory · Computer Science 2021-05-11 Siyuan Wang , Qifa Yan , Jingjing Zhang , Jianping Wang , Linqi Song

We present and analyze an efficient implementation of an iteratively reweighted least squares algorithm for recovering a matrix from a small number of linear measurements. The algorithm is designed for the simultaneous promotion of both a…

Numerical Analysis · Mathematics 2011-07-19 Massimo Fornasier , Holger Rauhut , Rachel Ward

Matrix factorization learned by implicit alternating least squares (iALS) is a popular baseline in recommender system research publications. iALS is known to be one of the most computationally efficient and scalable collaborative filtering…

Information Retrieval · Computer Science 2021-10-28 Steffen Rendle , Walid Krichene , Li Zhang , Yehuda Koren

Alternating Minimization is a widely used and empirically successful heuristic for matrix completion and related low-rank optimization problems. Theoretical guarantees for Alternating Minimization have been hard to come by and are still…

Machine Learning · Computer Science 2014-05-15 Moritz Hardt

This paper presents a novel adaptive reduced-rank {multi-input multi-output} (MIMO) equalization scheme and algorithms based on alternating optimization design techniques for MIMO spatial multiplexing systems. The proposed reduced-rank…

Information Theory · Computer Science 2013-01-15 Rodrigo C. de Lamare , Raimundo Sampaio-Neto

The approximation of tensors has important applications in various disciplines, but it remains an extremely challenging task. It is well known that tensors of higher order can fail to have best low-rank approximations, but with an important…

Numerical Analysis · Mathematics 2015-03-19 Mike Espig , Aram Khachatryan

In this work, we propose an alternating low-rank decomposition (ALRD) approach and novel subspace algorithms for direction-of-arrival (DOA) estimation. In the ALRD scheme, the decomposition matrix for rank reduction is composed of a set of…

Information Theory · Computer Science 2016-04-18 Yunlong Cai , Linzheng Qiu , Rodrigo C. de Lamare , Minjian Zhao

This paper introduces a randomized variation of the alternating least squares (ALS) algorithm for rank reduction of canonical tensor formats. The aim is to address the potential numerical ill-conditioning of least squares matrices at each…

Numerical Analysis · Mathematics 2015-10-07 Matthew Reynolds , Alireza Doostan , Gregory Beylkin

We introduce a novel optimization algorithm for image recovery under learned sparse and low-rank constraints, which we parameterize as weighted extensions of the $\ell_p^p$-vector and $\mathcal S_p^p$ Schatten-matrix quasi-norms for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Stamatios Lefkimmiatis , Iaroslav Koshelev

We propose an iterative algorithm for low-rank matrix completion that can be interpreted as an iteratively reweighted least squares (IRLS) algorithm, a saddle-escaping smoothing Newton method or a variable metric proximal gradient method…

Optimization and Control · Mathematics 2021-06-07 Christian Kümmerle , Claudio Mayrink Verdun

We propose a new algorithm for the problem of recovering data that adheres to multiple, heterogeneous low-dimensional structures from linear observations. Focusing on data matrices that are simultaneously row-sparse and low-rank, we propose…

Machine Learning · Computer Science 2024-01-19 Christian Kümmerle , Johannes Maly
‹ Prev 1 2 3 10 Next ›