English
Related papers

Related papers: Robust Subspace System Identification via Weighted…

200 papers

Dimension reduction is often an important step in the analysis of high-dimensional data. PCA is a popular technique to find the best low-dimensional approximation of high-dimensional data. However, classical PCA is very sensitive to…

Computation · Statistics 2019-01-14 Holger Cevallos-Valdiviezo , Stefan Van Aelst

This paper considers the problem of recovering either a low rank matrix or a sparse vector from observations of linear combinations of the vector or matrix elements. Recent methods replace the non-convex regularization with $\ell_1$ or…

Optimization and Control · Mathematics 2017-03-22 Carl Olsson , Marcus Carlsson , Fredrik Andersson , Viktor Larsson

Understanding the fundamental mechanism behind the success of deep neural networks is one of the key challenges in the modern machine learning literature. Despite numerous attempts, a solid theoretical analysis is yet to be developed. In…

Machine Learning · Computer Science 2022-01-14 Tolga Ergen , Mert Pilanci

This paper studies the parameter tuning problem of positive linear systems for optimizing their stability properties. We specifically show that, under certain regularity assumptions on the parametrization, the problem of finding the…

Optimization and Control · Mathematics 2019-11-26 Masaki Ogura , Masako Kishida , James Lam

Low rank recovery problems have been a subject of intense study in recent years. While the rank function is useful for regularization it is difficult to optimize due to its non-convexity and discontinuity. The standard remedy for this is to…

Optimization and Control · Mathematics 2021-08-17 Marcus Carlsson , Daniele Gerosa , Carl Olsson

Robust PCA has drawn significant attention in the last decade due to its success in numerous application domains, ranging from bio-informatics, statistics, and machine learning to image and video processing in computer vision. Robust PCA…

Optimization and Control · Mathematics 2018-06-12 Shiqian Ma , Necdet Serhat Aybat

The subspace method is one of the mainstream system identification method of linear systems, and its basic idea is to estimate the system parameter matrices by projecting them into a subspace related to input and output. However, most of…

Systems and Control · Electrical Eng. & Systems 2022-02-03 Xiangyu Mao , Jianping He , Chengcheng Zhao

In recent work, robust Principal Components Analysis (PCA) has been posed as a problem of recovering a low-rank matrix $\mathbf{L}$ and a sparse matrix $\mathbf{S}$ from their sum, $\mathbf{M}:= \mathbf{L} + \mathbf{S}$ and a provably exact…

Information Theory · Computer Science 2023-07-19 Jinchun Zhan , Namrata Vaswani

Low-rank matrix approximation, which aims to construct a low-rank matrix from an observation, has received much attention recently. An efficient method to solve this problem is to convert the problem of rank minimization into a nuclear norm…

Information Theory · Computer Science 2016-09-21 Seyedroohollah Hosseini

We propose a convex optimization procedure for black-box identification of nonlinear state-space models for systems that exhibit stable limit cycles (unforced periodic solutions). It extends the "robust identification error" framework in…

Optimization and Control · Mathematics 2013-03-21 Ian R. Manchester , Mark M. Tobenkin , Jennifer Wang

In this work, we propose an optimization framework for estimating a sparse robust one-dimensional subspace. Our objective is to minimize both the representation error and the penalty, in terms of the l1-norm criterion. Given that the…

Machine Learning · Statistics 2024-03-07 Xiao Ling , Paul Brooks

Robust PCA is a widely used statistical procedure to recover a underlying low-rank matrix with grossly corrupted observations. This work considers the problem of robust PCA as a nonconvex optimization problem on the manifold of low-rank…

Machine Learning · Statistics 2017-09-04 Teng Zhang , Yi Yang

Over the past years Robust PCA has been established as a standard tool for reliable low-rank approximation of matrices in the presence of outliers. Recently, the Robust PCA approach via nuclear norm minimization has been extended to…

Machine Learning · Statistics 2015-06-15 Clemens Hage , Martin Kleinsteuber

The problem of estimating ARMA models is computationally interesting due to the nonconcavity of the log-likelihood function. Recent results were based on the convex minimization. Joint model selection using penalization by a convex norm,…

Statistics Theory · Mathematics 2015-08-10 Stéphane Chrétien , Tianwen Wei , Basad Ali Hussain Al-sarray

In this work, we consider the matrix completion problem, where the objective is to reconstruct a low-rank matrix from a few observed entries. A commonly employed approach involves nuclear norm minimization. For this method to succeed, the…

Signal Processing · Electrical Eng. & Systems 2024-06-25 Hamideh. Sadat Fazael Ardakani , Sajad Daei , Arash Amini , Mikael Skoglund , Gabor Fodor

Matrix form data sets arise in many areas, so there are lots of works about the matrix regression models. One special model of these models is the adaptive nuclear norm regularized trace regression, which has been proven have good…

Methodology · Statistics 2024-04-16 Pan Shang , Lingchen Kong

Sparsity and rank functions are important ways of regularizing under-determined linear systems. Optimization of the resulting formulations is made difficult since both these penalties are non-convex and discontinuous. The most common remedy…

Optimization and Control · Mathematics 2019-01-01 Carl Olsson , Marcus Carlsson , Daniele Gerosa

Low-rank learning has attracted much attention recently due to its efficacy in a rich variety of real-world tasks, e.g., subspace segmentation and image categorization. Most low-rank methods are incapable of capturing low-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2016-11-16 Ping Li , Jun Yu , Meng Wang , Luming Zhang , Deng Cai , Xuelong Li

Robust PCA, the problem of PCA in the presence of outliers has been extensively investigated in the last few years. Here we focus on Robust PCA in the outlier model where each column of the data matrix is either an inlier or an outlier.…

Machine Learning · Statistics 2019-05-01 Vishnu Menon , Sheetal Kalyani

In recent years, the nuclear norm minimization (NNM) problem has been attracting much attention in computer vision and machine learning. The NNM problem is capitalized on its convexity and it can be solved efficiently. The standard nuclear…

Computer Vision and Pattern Recognition · Computer Science 2014-05-26 Qi Xie , Deyu Meng , Shuhang Gu , Lei Zhang , Wangmeng Zuo , Xiangchu Feng , Zongben Xu