English
Related papers

Related papers: Factorization approach to structured low-rank appr…

200 papers

This paper, broadly speaking, covers the use of randomness in two main areas: low-rank approximation and kernel methods. Low-rank approximation is very important in numerical linear algebra. Many applications depend on matrix decomposition…

Numerical Analysis · Mathematics 2020-08-12 Rishi Advani , Madison Crim , Sean O'Hagan

In this paper, we consider low-rank approximations for the solutions to the stochastic Helmholtz equation with random coefficients. A Stochastic Galerkin finite element method is used for the discretization of the Helmholtz problem.…

Numerical Analysis · Mathematics 2023-02-17 Adem Kaya , Melina A. Freitag

We study the problem of finding structured low-rank matrices using nuclear norm regularization where the structure is encoded by a linear map. In contrast to most known approaches for linearly structured rank minimization, we do not (a) use…

Systems and Control · Computer Science 2015-09-09 Adams Wei Yu , Wanli Ma , Yaoliang Yu , Jaime G. Carbonell , Suvrit Sra

This work studies low-rank approximation of a positive semidefinite matrix from partial entries via nonconvex optimization. We characterized how well local-minimum based low-rank factorization approximates a fixed positive semidefinite…

Optimization and Control · Mathematics 2019-04-08 Ji Chen , Xiaodong Li

This letter proposes to estimate low-rank matrices by formulating a convex optimization problem with non-convex regularization. We employ parameterized non-convex penalty functions to estimate the non-zero singular values more accurately…

Computer Vision and Pattern Recognition · Computer Science 2016-04-14 Ankit Parekh , Ivan W. Selesnick

Low-rank approximation of a matrix by means of random sampling has been consistently efficient in its empirical studies by many scientists who applied it with various sparse and structured multipliers, but adequate formal support for this…

Numerical Analysis · Mathematics 2016-06-07 Victor Y. Pan , Liang Zhao

Integral equations are commonly encountered when solving complex physical problems. Their discretization leads to a dense kernel matrix that is block or hierarchically low-rank. This paper proposes a new way to build a low-rank…

Numerical Analysis · Mathematics 2020-01-28 Léopold Cambier , Eric Darve

Many matrices appearing in numerical methods for partial differential equations and integral equations are rank-structured, i.e., they contain submatrices that can be approximated by matrices of low rank. A relatively general class of…

Numerical Analysis · Mathematics 2015-03-10 Steffen Börm , Knut Reimer

We study a family of (potentially non-convex) constrained optimization problems with convex composite structure. Through a novel analysis of non-smooth geometry, we show that proximal-type algorithms applied to exact penalty formulations of…

Optimization and Control · Mathematics 2019-03-04 Yu Bai , John Duchi , Song Mei

Affine rank minimization algorithms typically rely on calculating the gradient of a data error followed by a singular value decomposition at every iteration. Because these two steps are expensive, heuristic approximations are often used to…

Optimization and Control · Mathematics 2013-06-04 Stephen Becker , Volkan Cevher , Anastasios Kyrillidis

The problem of low-rank approximation with convex constraints, which appears in data analysis, system identification, model order reduction, low-order controller design and low-complexity modelling is considered. Given a matrix, the…

Optimization and Control · Mathematics 2018-11-12 Christian Grussler , Anders Rantzer , Pontus Giselsson

The goal of this paper is to find a low-rank approximation for a given tensor. Specifically, we give a computable strategy on calculating the rank of a given tensor, based on approximating the solution to an NP-hard problem. In this paper,…

Numerical Analysis · Mathematics 2016-10-20 Xiaofei Wang , Carmeliza Navasca

We consider the problem of learning low-rank tensors from partial observations with structural constraints, and propose a novel factorization of such tensors, which leads to a simpler optimization problem. The resulting problem is an…

Machine Learning · Computer Science 2023-05-16 Jayadev Naram , Tanmay Kumar Sinha , Pawan Kumar

In this paper we consider the low-rank matrix completion problem with specific application to forecasting in time series analysis. Briefly, the low-rank matrix completion problem is the problem of imputing missing values of a matrix under a…

Methodology · Statistics 2018-02-23 Jonathan Gillard , Konstantin Usevich

Tensor methods are among the most prominent tools for the numerical solution of high-dimensional problems where functions of multiple variables have to be approximated. These methods exploit the tensor structure of function spaces and apply…

Numerical Analysis · Mathematics 2021-02-01 Anthony Nouy

In this paper, we consider the problem of minimizing a smooth objective over multiple rank constraints on Hankel-structured matrices. This kind of problems arises in system identification, system theory and signal processing, where the rank…

Optimization and Control · Mathematics 2019-06-26 Tianxiang Liu , Ivan Markovsky , Ting Kei Pong , Akiko Takeda

The low-rank approximation is a complexity reduction technique to approximate a tensor or a matrix with a reduced rank, which has been applied to the simulation of high dimensional problems to reduce the memory required and computational…

Computational Physics · Physics 2020-08-26 Zhuogang Peng , Ryan McClarren , Martin Frank

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani

Low-rank tensor approximation techniques attempt to mitigate the overwhelming complexity of linear algebra tasks arising from high-dimensional applications. In this work, we study the low-rank approximability of solutions to linear systems…

Numerical Analysis · Mathematics 2016-01-08 Daniel Kressner , André Uschmajew

We present a fast randomized algorithm that computes a low rank LU decomposition. Our algorithm uses random projections type techniques to efficiently compute a low rank approximation of large matrices. The randomized LU algorithm can be…

Numerical Analysis · Mathematics 2016-02-02 Gil Shabat , Yaniv Shmueli , Yariv Aizenbud , Amir Averbuch