English
Related papers

Related papers: Finding a low-rank basis in a matrix subspace

200 papers

In this paper, we suggest a new method for a given tensor to find CP decompositions using a less number of rank $1$ tensors. The main ingredient is the Least Absolute Shrinkage and Selection Operator (LASSO) by considering the decomposition…

Commutative Algebra · Mathematics 2023-05-24 Taehyeong Kim , Jeong-Hoon Ju , Yeongrak Kim

Many problems can be formulated as recovering a low-rank tensor. Although an increasingly common task, tensor recovery remains a challenging problem because of the delicacy associated with the decomposition of higher order tensors. To…

Machine Learning · Statistics 2014-05-09 Ming Yuan , Cun-Hui Zhang

Low-rank tensor approximation techniques attempt to mitigate the overwhelming complexity of linear algebra tasks arising from high-dimensional applications. In this work, we study the low-rank approximability of solutions to linear systems…

Numerical Analysis · Mathematics 2016-01-08 Daniel Kressner , André Uschmajew

In low-rank tensor completion tasks, due to the underlying multiple large-scale singular value decomposition (SVD) operations and rank selection problem of the traditional methods, they suffer from high computational cost and high…

Numerical Analysis · Computer Science 2018-05-23 Longhao Yuan , Chao Li , Danilo Mandic , Jianting Cao , Qibin Zhao

In this paper, we study the problem of matrix recovery, which aims to restore a target matrix of authentic samples from grossly corrupted observations. Most of the existing methods, such as the well-known Robust Principal Component Analysis…

Computer Vision and Pattern Recognition · Computer Science 2018-11-12 Xingyu Xie , Jianlong Wu , Guangcan Liu , Jun Wang

Structured Low-Rank Approximation is a problem arising in a wide range of applications in Numerical Analysis and Engineering Sciences. Given an input matrix $M$, the goal is to compute a matrix $M'$ of given rank $r$ in a linear or affine…

Numerical Analysis · Computer Science 2014-10-28 Éric Schost , Pierre-Jean Spaenlehauer

Low-rank matrix recovery problems involving high-dimensional and heterogeneous data appear in applications throughout statistics and machine learning. The contribution of this paper is to establish the fundamental limits of recovery for a…

Machine Learning · Statistics 2022-03-22 Joshua K. Behne , Galen Reeves

We analyze a distributed algorithm to compute a low-rank matrix factorization on $N$ clients, each holding a local dataset $\mathbf{S}^i \in \mathbb{R}^{n_i \times d}$, mathematically, we seek to solve $min_{\mathbf{U}^i \in…

Machine Learning · Computer Science 2025-07-22 Constantin Philippenko , Kevin Scaman , Laurent Massoulié

PhaseLift, proposed by E.J. Cand\`{e}s et al., is one convex relaxation approach for phase retrieval. The relaxation enlarges the solution set from rank one matrices to positive semidefinite matrices. In this paper, a relaxation is employed…

Optimization and Control · Mathematics 2014-05-08 Pengwen Chen , Hung Hung

We study the role of the constraint set in determining the solution to low-rank, positive semidefinite (PSD) matrix sensing problems. The setting we consider involves rank-one sensing matrices: In particular, given a set of rank-one…

Machine Learning · Statistics 2021-04-07 T. Mitchell Roddenberry , Santiago Segarra , Anastasios Kyrillidis

We propose a computational framework for computing low-rank approximations to the ensemble of solutions of a parametrized system of the form $A(\xi)x(\xi)+g(x(\xi))=b(\xi)$ for multiple parameter values. The central idea is to reinterpret…

Numerical Analysis · Mathematics 2026-04-09 Marco Sutti , Tommaso Vanzan

Sparse matrix reordering can significantly reduce the fill-in during matrix factorization, thereby decreasing the computational and storage requirements in sparse matrix computations. Finding a minimal fill-in ordering is known to be an…

Machine Learning · Computer Science 2026-05-19 Ziwei Li , Tao Yuan , Shuzi Niu , Huiyuan Li

The CP tensor decomposition is used in applications such as machine learning and signal processing to discover latent low-rank structure in multidimensional data. Computing a CP decomposition via an alternating least squares (ALS) method…

Numerical Analysis · Mathematics 2021-12-22 Rachel Minster , Irina Viviano , Xiaotian Liu , Grey Ballard

Numerical computing of the rank of a matrix is a fundamental problem in scientific computation. The datasets generated by the internet often correspond to the analysis of high-dimensional sparse matrices. Notwithstanding recent advances in…

Numerical Analysis · Mathematics 2023-04-13 Chen Zhao , Yuqing Liu , Li Hu , Zhengzhong Yuan

The problem of low-rank approximation with convex constraints, which appears in data analysis, system identification, model order reduction, low-order controller design and low-complexity modelling is considered. Given a matrix, the…

Optimization and Control · Mathematics 2018-11-12 Christian Grussler , Anders Rantzer , Pontus Giselsson

Integer data sets frequently appear in many applications in sciences and technology. To analyze these, integer low rank approximation has received much attention due to its capacity of representing the results in integers preserving the…

Numerical Analysis · Mathematics 2015-10-20 Bo Dong , Matthew M. Lin , Haesun Park

In this paper, we propose three approaches for the estimation of the Tucker decomposition of multi-way arrays (tensors) from partial observations. All approaches are formulated as convex minimization problems. Therefore, the minimum is…

Machine Learning · Statistics 2015-03-17 Ryota Tomioka , Kohei Hayashi , Hisashi Kashima

Let $A$ be a square matrix with a given structure (e.g. real matrix, sparsity pattern, Toeplitz structure, etc.) and assume that it is unstable, i.e. at least one of its eigenvalues lies in the complex right half-plane. The problem of…

Numerical Analysis · Mathematics 2024-02-23 Nicola Guglielmi , Stefano Sicilia

Robust low-rank matrix completion (RMC), or robust principal component analysis with partially observed data, has been studied extensively for computer vision, signal processing and machine learning applications. This problem aims to…

Machine Learning · Computer Science 2021-06-09 Minhui Huang , Shiqian Ma , Lifeng Lai

We study the problem of estimating low-rank matrices from linear measurements (a.k.a., matrix sensing) through nonconvex optimization. We propose an efficient stochastic variance reduced gradient descent algorithm to solve a nonconvex…

Machine Learning · Statistics 2017-01-17 Xiao Zhang , Lingxiao Wang , Quanquan Gu
‹ Prev 1 8 9 10 Next ›