English
Related papers

Related papers: Exact Solutions in Structured Low-Rank Approximati…

200 papers

We consider robust low rank matrix estimation as a trace regression when outputs are contaminated by adversaries. The adversaries are allowed to add arbitrary values to arbitrary outputs. Such values can depend on any samples. We deal with…

Machine Learning · Statistics 2024-05-27 Takeyuki Sasai , Hironori Fujisawa

Low-rank approximation of kernels is a fundamental mathematical problem with widespread algorithmic applications. Often the kernel is restricted to an algebraic variety, e.g., in problems involving sparse or low-rank data. We show that…

Machine Learning · Computer Science 2023-10-02 Jason M. Altschuler , Pablo A. Parrilo

The numerical integration of stiff equations is a challenging problem that needs to be approached by specialized numerical methods. Exponential integrators form a popular class of such methods since they are provably robust to stiffness and…

Numerical Analysis · Mathematics 2024-05-15 Benjamin Carrel , Bart Vandereycken

Low-rank learning has attracted much attention recently due to its efficacy in a rich variety of real-world tasks, e.g., subspace segmentation and image categorization. Most low-rank methods are incapable of capturing low-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2016-11-16 Ping Li , Jun Yu , Meng Wang , Luming Zhang , Deng Cai , Xuelong Li

Recently there is a line of research work proposing to employ Spectral Clustering (SC) to segment (group){Throughout the paper, we use segmentation, clustering, and grouping, and their verb forms, interchangeably.} high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2010-10-11 Yuzhao Ni , Ju Sun , Xiaotong Yuan , Shuicheng Yan , Loong-Fah Cheong

Given a pair of matrices X and B and an appropriate class of structured matrices S, we provide a complete solution of the structured inverse least-squares problem $min_{A\in_S} \|AX-B\|_F$. Indeed, we determine all solutions of the…

Numerical Analysis · Mathematics 2016-10-31 Bibhas Adhikari , Rafikul Alam

In this paper, we tackle two important problems in low-rank learning, which are partial singular value decomposition and numerical rank estimation of huge matrices. By using the concepts of Krylov subspaces such as Golub-Kahan…

Machine Learning · Statistics 2021-09-07 Reza Godaz , Reza Monsefi , Faezeh Toutounian , Reshad Hosseini

We propose a novel low-rank initialization framework for training low-rank deep neural networks -- networks where the weight parameters are re-parameterized by products of two low-rank matrices. The most successful prior existing approach,…

Machine Learning · Computer Science 2022-05-23 Kiran Vodrahalli , Rakesh Shivanna , Maheswaran Sathiamoorthy , Sagar Jain , Ed H. Chi

Weighted low rank approximation (WLRA) is an important yet computationally challenging primitive with applications ranging from statistical analysis, model compression, and signal processing. To cope with the NP-hardness of this problem,…

Data Structures and Algorithms · Computer Science 2024-06-05 David P. Woodruff , Taisuke Yasuda

Recent developments in engineering techniques for spatial data collection such as geographic information systems have resulted in an increasing need for methods to analyze large spatial data sets. These sorts of data sets can be found in…

Methodology · Statistics 2020-08-14 Toshihiro Hirano

The task of reconstructing a matrix given a sample of observedentries is known as the matrix completion problem. It arises ina wide range of problems, including recommender systems, collaborativefiltering, dimensionality reduction, image…

Statistics Theory · Mathematics 2014-12-20 Jean Lafond , Olga Klopp , Eric Moulines , Jospeh Salmon

Rank-constrained matrix problems appear frequently across science and engineering. The convergence analysis of iterative algorithms developed for these problems often hinges on local error bounds, which correlate the distance to the…

Optimization and Control · Mathematics 2025-10-03 Ruoning Chen , Defeng Sun , Liping Zhang

During the last years, low-rank tensor approximation has been established as a new tool in scientific computing to address large-scale linear and multilinear algebra problems, which would be intractable by classical techniques. This survey…

Numerical Analysis · Mathematics 2013-03-01 Lars Grasedyck , Daniel Kressner , Christine Tobler

In this survey, we provide a detailed review of recent advances in the recovery of continuous domain multidimensional signals from their few non-uniform (multichannel) measurements using structured low-rank matrix completion formulation.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Mathews Jacob , Merry P. Mani , Jong Chul Ye

This contribution revisits the classical approximate realization problem, which involves determining matrices of a state-space model based on estimates of a truncated series of Markov parameters. A Hankel matrix built up by these Markov…

Systems and Control · Electrical Eng. & Systems 2025-05-27 Jiabao He , Yueyue Xu , Yue Ju , Cristian R. Rojas , Håkan Hjalmarsson

We provide new approximation guarantees for greedy low rank matrix estimation under standard assumptions of restricted strong convexity and smoothness. Our novel analysis also uncovers previously unknown connections between the low rank…

Machine Learning · Statistics 2017-03-09 Rajiv Khanna , Ethan Elenberg , Alexandros G. Dimakis , Sahand Negahban

Integer data sets frequently appear in many applications in sciences and technology. To analyze these, integer low rank approximation has received much attention due to its capacity of representing the results in integers preserving the…

Numerical Analysis · Mathematics 2015-10-20 Bo Dong , Matthew M. Lin , Haesun Park

This work proposes an adaptive structure-preserving model order reduction method for finite-dimensional parametrized Hamiltonian systems modeling non-dissipative phenomena. To overcome the slowly decaying Kolmogorov width typical of…

Numerical Analysis · Mathematics 2022-02-02 Jan S. Hesthaven , Cecilia Pagliantini , Nicolò Ripamonti

In this paper, we propose and solve a low phase-rank approximation problem, which serves as a counterpart to the well-known low-rank approximation problem and the Schmidt-Mirsky theorem. More specifically, a nonzero complex number can be…

Rings and Algebras · Mathematics 2020-12-01 Di Zhao , Axel Ringh , Li Qiu , Sei Zhen Khong

We introduce and study the problem of consistent low-rank approximation, in which rows of an input matrix $\mathbf{A}\in\mathbb{R}^{n\times d}$ arrive sequentially and the goal is to provide a sequence of subspaces that well-approximate the…

Data Structures and Algorithms · Computer Science 2026-03-03 David P. Woodruff , Samson Zhou