English
Related papers

Related papers: denoiseR: A Package for Low Rank Matrix Estimation

200 papers

Low-rank matrix regression is a fundamental problem in data science with various applications in systems and control. Nuclear norm regularization has been widely applied to solve this problem due to its convexity. However, it suffers from…

Systems and Control · Electrical Eng. & Systems 2025-06-04 Mingzhou Yin , Matthias A. Müller

Traditional applications of latent class models (LCMs) often focus on scenarios where a set of unobserved classes are well-defined and easily distinguishable. However, in numerous real-world applications, these classes are weakly separated…

Computation · Statistics 2023-09-21 Mengbing Li , Bolin Wu , Briana Stephenson , Zhenke Wu

Low rank approximation is a commonly occurring problem in many computer vision and machine learning applications. There are two common ways of optimizing the resulting models. Either the set of matrices with a given rank can be explicitly…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Marcus Valtonen Örnhag , Carl Olsson , Anders Heyden

In high-dimensional multivariate regression problems, enforcing low rank in the coefficient matrix offers effective dimension reduction, which greatly facilitates parameter estimation and model interpretation. However, commonly-used…

Statistics Theory · Mathematics 2017-07-18 Yiyuan She , Kun Chen

Low rank matrix recovery is the focus of many applications, but it is a NP-hard problem. A popular way to deal with this problem is to solve its convex relaxation, the nuclear norm regularized minimization problem (NRM), which includes…

Optimization and Control · Mathematics 2019-09-17 Pan Shang , Lingchen Kong

We consider the problem of estimating a low-rank matrix from a noisy observed matrix. Previous work has shown that the optimal method depends crucially on the choice of loss function. In this paper, we use a family of weighted loss…

Statistics Theory · Mathematics 2021-04-08 William Leeb

We study minimax rates for denoising simultaneously sparse and low rank matrices in high dimensions. We show that an iterative thresholding algorithm achieves (near) optimal rates adaptively under mild conditions for a large class of loss…

Statistics Theory · Mathematics 2014-05-05 Dan Yang , Zongming Ma , Andreas Buja

Matrices with low-rank structure are ubiquitous in scientific computing. Choosing an appropriate rank is a key step in many computational algorithms that exploit low-rank structure. However, estimating the rank has been done largely in an…

Numerical Analysis · Mathematics 2024-01-08 Maike Meier , Yuji Nakatsukasa

Recently, low-rank matrix recovery theory has been emerging as a significant progress for various image processing problems. Meanwhile, the group sparse coding (GSC) theory has led to great successes in image restoration (IR) problem with…

Image and Video Processing · Electrical Eng. & Systems 2020-05-26 Yunyi Li , Guan Gui , Xiefeng Cheng

The advancement of imaging devices and countless images generated everyday pose an increasingly high demand on image denoising, which still remains a challenging task in terms of both effectiveness and efficiency. To improve denoising…

Image and Video Processing · Electrical Eng. & Systems 2023-05-10 Zhaoming Kong , Fangxi Deng , Haomin Zhuang , Jun Yu , Lifang He , Xiaowei Yang

We study algorithms for estimating the statistical leverage scores of rectangular dense or sparse matrices of arbitrary rank. Our approach is based on combining rank revealing methods with compositions of dense and sparse randomized…

Data Structures and Algorithms · Computer Science 2022-03-08 Aleksandros Sobczyk , Efstratios Gallopoulos

Modern technologies are producing a wealth of data with complex structures. For instance, in two-dimensional digital imaging, flow cytometry, and electroencephalography, matrix type covariates frequently arise when measurements are obtained…

Methodology · Statistics 2013-10-22 Hua Zhou , Lexin Li

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

Machine Learning · Computer Science 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

Modern decision-making scenarios often involve data that is both high-dimensional and rich in higher-order contextual information, where existing bandits algorithms fail to generate effective policies. In response, we propose in this paper…

Machine Learning · Computer Science 2025-01-24 Jiannan Li , Yiyang Yang , Yao Wang , Shaojie Tang

A common problem in many disciplines is the need to assign a set of items into categories or classes with known labels. This is often done by one or more expert raters, or sometimes by an automated process. If these assignments or `ratings'…

Methodology · Statistics 2024-01-11 Jeffrey M. Pullin , Lyle C. Gurrin , Damjan Vukcevic

This paper considers the problem of estimating a low-rank matrix from the observation of all or a subset of its entries in the presence of Poisson noise. When we observe all entries, this is a problem of matrix denoising; when we observe…

Machine Learning · Statistics 2024-04-22 Andrew D. McRae , Mark A. Davenport

While matrix variate regression models have been studied in many existing works, classical statistical and computational methods for the analysis of the regression coefficient estimation are highly affected by high dimensional and noisy…

Machine Learning · Statistics 2022-05-17 Hsin-Hsiung Huang , Feng Yu , Xing Fan , Teng Zhang

This paper proposes a new method for solving the well-known rank aggregation problem from pairwise comparisons using the method of low-rank matrix completion. The partial and noisy data of pairwise comparisons is transformed into a matrix…

Machine Learning · Statistics 2018-06-15 Tal Levy , Alireza Vahid , Raja Giryes

For a given matrix subspace, how can we find a basis that consists of low-rank matrices? This is a generalization of the sparse vector problem. It turns out that when the subspace is spanned by rank-1 matrices, the matrices can be obtained…

Numerical Analysis · Computer Science 2016-06-29 Yuji Nakatsukasa , Tasuku Soma , André Uschmajew

Low-rank regularization (LRR) has been widely applied in various machine learning tasks, but the associated optimization is challenging. Directly optimizing the rank function under constraints is NP-hard in general. To overcome this…

Machine Learning · Computer Science 2025-05-22 Naiqi Li , Yuqiu Xie , Peiyuan Liu , Tao Dai , Yong Jiang , Shu-Tao Xia