English
Related papers

Related papers: Matrix Recipes for Hard Thresholding Methods

200 papers

The dynamic matrix inverse problem is to maintain the inverse of a matrix undergoing element and column updates. It is the main subroutine behind the best algorithms for many dynamic problems whose complexity is not yet well-understood,…

Data Structures and Algorithms · Computer Science 2019-05-14 Jan van den Brand , Danupon Nanongkai , Thatchaphol Saranurak

Recovery of low-rank matrices from a small number of linear measurements is now well-known to be possible under various model assumptions on the measurements. Such results demonstrate robustness and are backed with provable theoretical…

Numerical Analysis · Mathematics 2019-08-23 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

Recovering low-rank and sparse matrices from incomplete or corrupted observations is an important problem in machine learning, statistics, bioinformatics, computer vision, as well as signal and image processing. In theory, this problem can…

Machine Learning · Computer Science 2014-09-04 Fanhua Shang , Yuanyuan Liu , Hanghang Tong , James Cheng , Hong Cheng

We study minimax rates for denoising simultaneously sparse and low rank matrices in high dimensions. We show that an iterative thresholding algorithm achieves (near) optimal rates adaptively under mild conditions for a large class of loss…

Statistics Theory · Mathematics 2014-05-05 Dan Yang , Zongming Ma , Andreas Buja

Triangular factorizations are an important tool for solving integral equations and partial differential equations with hierarchical matrices ($\mathcal{H}$-matrices). Experiments show that using an $\mathcal{H}$-matrix LR factorization to…

Numerical Analysis · Mathematics 2019-05-28 Steffen Börm

Recent work in the matrix completion literature has shown that prior knowledge of a matrix's row and column spaces can be successfully incorporated into reconstruction programs to substantially benefit matrix recovery. This paper proposes a…

Information Theory · Computer Science 2025-09-10 Oscar López

As a paradigm to recover unknown entries of a matrix from partial observations, low-rank matrix completion (LRMC) has generated a great deal of interest. Over the years, there have been lots of works on this topic but it might not be easy…

Data Structures and Algorithms · Computer Science 2019-07-30 Luong Trung Nguyen , Junhan Kim , Byonghyo Shim

In this paper, we propose a method for the approximation of the solution of high-dimensional weakly coercive problems formulated in tensor spaces using low-rank approximation formats. The method can be seen as a perturbation of a minimal…

Numerical Analysis · Mathematics 2015-02-13 Marie Billaud-Friess , Anthony Nouy , Olivier Zahm

Matrix multiplication is a fundamental building block for large scale computations arising in various applications, including machine learning. There has been significant recent interest in using coding to speed up distributed matrix…

Information Theory · Computer Science 2019-05-17 Wei-Ting Chang , Ravi Tandon

This paper studies the matrix completion problem under arbitrary sampling schemes. We propose a new estimator incorporating both max-norm and nuclear-norm regularization, based on which we can conduct efficient low-rank matrix recovery…

Machine Learning · Statistics 2016-09-27 Ethan X. Fang , Han Liu , Kim-Chuan Toh , Wen-Xin Zhou

Low-rank modeling has a lot of important applications in machine learning, computer vision and social network analysis. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has…

Numerical Analysis · Computer Science 2016-05-02 Quanming Yao , James T. Kwok , Wenliang Zhong

In this paper, the problem of matrix rank minimization under affine constraints is addressed. The state-of-the-art algorithms can recover matrices with a rank much less than what is sufficient for the uniqueness of the solution of this…

Information Theory · Computer Science 2016-11-15 Mohammadreza Malek-Mohammadi , Massoud Babaie-Zadeh , Arash Amini , Christian Jutten

In this overview article we will consider the deliberate restarting of algorithms, a meta technique, in order to improve the algorithm's performance, e.g., convergence rates or approximation guarantees. One of the major advantages is that…

Optimization and Control · Mathematics 2020-06-29 Sebastian Pokutta

Recent theory of mapping an image into a structured low-rank Toeplitz or Hankel matrix has become an effective method to restore images. In this paper, we introduce a generalized structured low-rank algorithm to recover images from their…

Image and Video Processing · Electrical Eng. & Systems 2018-11-28 Yue Hu , Xiaohan Liu , Mathews Jacob

This paper concerns with a noisy structured low-rank matrix recovery problem which can be modeled as a structured rank minimization problem. We reformulate this problem as a mathematical program with a generalized complementarity constraint…

Optimization and Control · Mathematics 2017-03-14 Shujun Bi , Shaohua Pan , Defeng Sun

Matrix recovery is the problem of recovering a low-rank matrix from a few linear measurements. Recently, this problem has gained a lot of attention as it is employed in many applications such as Netflix prize problem, seismic data…

Information Theory · Computer Science 2019-07-30 Hamideh. S Fazael Ardakani , Sajad Daei , Farzan Haddadi

We study the problem of learning mixtures of low-rank models, i.e. reconstructing multiple low-rank matrices from unlabelled linear measurements of each. This problem enriches two widely studied settings -- low-rank matrix sensing and mixed…

Machine Learning · Statistics 2021-03-10 Yanxi Chen , Cong Ma , H. Vincent Poor , Yuxin Chen

We consider the problem of learning a low-rank matrix, constrained to lie in a linear subspace, and introduce a novel factorization for modeling such matrices. A salient feature of the proposed factorization scheme is it decouples the…

Machine Learning · Statistics 2018-06-18 Pratik Jawanpuria , Bamdev Mishra

In this paper, we consider optimal low-rank regularized inverse matrix approximations and their applications to inverse problems. We give an explicit solution to a generalized rank-constrained regularized inverse approximation problem,…

Numerical Analysis · Mathematics 2016-03-21 Julianne Chung , Matthias Chung

We investigate the methods that simultaneously enforce sparsity and low-rank structure in a matrix as often employed for sparse phase retrieval problems or phase calibration problems in compressive sensing. We propose a new approach for…

Numerical Analysis · Computer Science 2014-03-20 Cagdas Bilen , Gilles Puy , Rémi Gribonval , Laurent Daudet