English
Related papers

Related papers: Regularization parameter selection for low rank ma…

200 papers

We develop two iterative algorithms for solving the low rank phase retrieval (LRPR) problem. LRPR refers to recovering a low-rank matrix $\X$ from magnitude-only (phaseless) measurements of random linear projections of its columns. Both…

Information Theory · Computer Science 2017-08-02 Namrata Vaswani , Seyedehsara Nayer , Yonina C. Eldar

This paper considers a large class of problems where we seek to recover a low rank matrix and/or sparse vector from some set of measurements. While methods based on convex relaxations suffer from a (possibly large) estimator bias, and other…

Machine Learning · Statistics 2021-09-28 April Sagan , John E. Mitchell

We propose a new algorithm for estimating NARMAX models with $L_1$ regularization for models represented as a linear combination of basis functions. Due to the $L_1$-norm penalty the Lasso estimation tends to produce some coefficients that…

Systems and Control · Computer Science 2018-02-27 Antônio H. Ribeiro , Luis A. Aguirre

A Low-rank Spectral Optimization Problem (LSOP) minimizes a linear objective subject to multiple two-sided linear matrix inequalities intersected with a low-rank and spectral constrained domain set. Although solving LSOP is, in general,…

Optimization and Control · Mathematics 2023-06-22 Yongchun Li , Weijun Xie

In this paper, nonconvex and nonsmooth models for compressed sensing (CS) and low rank matrix completion (MC) is studied. The problem is formulated as a nonconvex regularized leat square optimization problems, in which the l0-norm and the…

Optimization and Control · Mathematics 2016-05-03 Zhuo-Xu Cui , Qibin Fan

In this paper, we propose a novel approach to the rank minimization problem, termed rank residual constraint (RRC) model. Different from existing low-rank based approaches, such as the well-known nuclear norm minimization (NNM) and the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Zhiyuan Zha , Xin Yuan , Bihan Wen , Jiantao Zhou , Jiachao Zhang , Ce Zhu

The affine matrix rank minimization (AMRM) problem is to find a matrix of minimum rank that satisfies a given linear system constraint. It has many applications in some important areas such as control, recommender systems, matrix completion…

Optimization and Control · Mathematics 2018-11-26 Angang Cui , Jigen Peng , Haiyang Li , Junxiong Jia , Meng Wen

Rank minimization (RM) is a wildly investigated task of finding solutions by exploiting low-rank structure of parameter matrices. Recently, solving RM problem by leveraging non-convex relaxations has received significant attention. It has…

Machine Learning · Computer Science 2018-09-17 Zaiyi Chen

Quadratic regression (QR) models naturally extend linear models by considering interaction effects between the covariates. To conduct model selection in QR, it is important to maintain the hierarchical model structure between main effects…

Methodology · Statistics 2016-07-15 Ning Hao , Yang Feng , Hao Helen Zhang

In high-dimensional and/or non-parametric regression problems, regularization (or penalization) is used to control model complexity and induce desired structure. Each penalty has a weight parameter that indicates how strongly the structure…

Machine Learning · Statistics 2017-03-30 Jean Feng , Noah Simon

We tackle the problem of penalty selection of regularization on the basis of the minimum description length (MDL) principle. In particular, we consider that the design space of the penalty function is high-dimensional. In this situation,…

Machine Learning · Statistics 2018-04-27 Kohei Miyaguchi , Kenji Yamanishi

The Least Absolute Shrinkage and Selection Operator (LASSO) has gained attention in a wide class of continuous parametric estimation problems with promising results. It has been a subject of research for more than a decade. Due to the…

Computation · Statistics 2015-04-13 Ashkan Panahi , Mats Viberg

An approach to parameter optimization for the low-rank matrix recovery method in hyperspectral imaging is discussed. We formulate an optimization problem with respect to the initial parameters of the low-rank matrix recovery method. The…

Optimization and Control · Mathematics 2023-08-10 Monika Wolfmayr

The topic of recovery of a structured model given a small number of linear observations has been well-studied in recent years. Examples include recovering sparse or group-sparse vectors, low-rank matrices, and the sum of sparse and low-rank…

Information Theory · Computer Science 2014-07-28 Samet Oymak , Amin Jalali , Maryam Fazel , Yonina C. Eldar , Babak Hassibi

Modern technologies are producing a wealth of data with complex structures. For instance, in two-dimensional digital imaging, flow cytometry, and electroencephalography, matrix type covariates frequently arise when measurements are obtained…

Methodology · Statistics 2013-10-22 Hua Zhou , Lexin Li

We propose a new framework for deriving screening rules for convex optimization problems. Our approach covers a large class of constrained and penalized optimization formulations, and works in two steps. First, given any approximate point,…

Optimization and Control · Mathematics 2016-09-26 Anant Raj , Jakob Olbrich , Bernd Gärtner , Bernhard Schölkopf , Martin Jaggi

Lasso and other regularization procedures are attractive methods for variable selection, subject to a proper choice of shrinkage parameter. Given a set of potential subsets produced by a regularization algorithm, a consistent model…

Methodology · Statistics 2014-02-26 Minh-Ngoc Tran

Low-rank representation~(LRR) has been a significant method for segmenting data that are generated from a union of subspaces. It is, however, known that solving the LRR program is challenging in terms of time complexity and memory…

Machine Learning · Statistics 2017-10-24 Jie Shen , Ping Li , Huan Xu

This work investigates the geometry of a nonconvex reformulation of minimizing a general convex loss function $f(X)$ regularized by the matrix nuclear norm $\|X\|_*$. Nuclear-norm regularized matrix inverse problems are at the heart of many…

Numerical Analysis · Computer Science 2017-04-07 Qiuwei Li , Zhihui Zhu , Gongguo Tang

In this work, we propose a method to efficiently find the regularization parameter for low-rank MMSE filters based on a Kronecker-product representation. We show that the regularization parameter is surprisingly linked to the problem of…

Machine Learning · Computer Science 2025-12-18 Daniel Gomes de Pinho Zanco , Leszek Szczecinski , Jacob Benesty , Eduardo Vinicius Kuhn