English
Related papers

Related papers: Informed Non-convex Robust Principal Component Ana…

200 papers

This paper extends robust principal component analysis (RPCA) to nonlinear manifolds. Suppose that the observed data matrix is the sum of a sparse component and a component drawn from some low dimensional manifold. Is it possible to…

Machine Learning · Computer Science 2019-11-12 He Lyu , Ningyu Sha , Shuyang Qin , Ming Yan , Yuying Xie , Rongrong Wang

In this paper, we focus on the decentralized composite optimization for convex functions. Because of advantages such as robust to the network and no communication bottle-neck in the central server, the decentralized optimization has…

Optimization and Control · Mathematics 2024-07-16 Haishan Ye , Xiangyu Chang

We propose an extended primal-dual algorithm framework for solving a general nonconvex optimization model. This work is motivated by image reconstruction problems in a class of nonlinear imaging, where the forward operator can be formulated…

Optimization and Control · Mathematics 2024-08-28 Yu Gao , Xiaochuan Pan , Chong Chen

Sparse principal component analysis (PCA) is an important technique for dimensionality reduction of high-dimensional data. However, most existing sparse PCA algorithms are based on non-convex optimization, which provide little guarantee on…

Methodology · Statistics 2019-11-20 Yixuan Qiu , Jing Lei , Kathryn Roeder

Non-convex optimization plays a key role in a growing number of machine learning applications. This motivates the identification of specialized structure that enables sharper theoretical analysis. One such identified structure is…

Optimization and Control · Mathematics 2023-06-06 Qiang Fu , Dongchu Xu , Ashia Wilson

This paper introduces an abstract framework for randomized subspace correction methods for convex optimization, which unifies and generalizes a broad class of existing algorithms, including domain decomposition, multigrid, and block…

Optimization and Control · Mathematics 2026-04-28 Boou Jiang , Jongho Park , Jinchao Xu

We study the problem of estimating low-rank matrices from linear measurements (a.k.a., matrix sensing) through nonconvex optimization. We propose an efficient stochastic variance reduced gradient descent algorithm to solve a nonconvex…

Machine Learning · Statistics 2017-01-17 Xiao Zhang , Lingxiao Wang , Quanquan Gu

We consider the problem of recovering a target matrix that is a superposition of low-rank and sparse components, from a small set of linear measurements. This problem arises in compressed sensing of structured high-dimensional signals such…

Information Theory · Computer Science 2012-02-22 John Wright , Arvind Ganesh , Kerui Min , Yi Ma

In this paper, we propose a non-convex formulation to recover the authentic structure from the corrupted real data. Typically, the specific structure is assumed to be low rank, which holds for a wide range of data, such as images and…

Computer Vision and Pattern Recognition · Computer Science 2016-08-23 Jing Wang , Meng Wang , Xuegang Hu , Shuicheng Yan

It is well known that Principal Component Analysis (PCA) is strongly affected by outliers and a lot of effort has been put into robustification of PCA. In this paper we present a new algorithm for robust PCA minimizing the trimmed…

Machine Learning · Statistics 2015-06-02 Anastasia Podosinnikova , Simon Setzer , Matthias Hein

The proposed article aims at offering a comprehensive tutorial for the computational aspects of structured matrix and tensor factorization. Unlike existing tutorials that mainly focus on {\it algorithmic procedures} for a small set of…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Xiao Fu , Nico Vervliet , Lieven De Lathauwer , Kejun Huang , Nicolas Gillis

The joint problem of reconstruction / feature extraction is a challenging task in image processing. It consists in performing, in a joint manner, the restoration of an image and the extraction of its features. In this work, we firstly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Emilie Chouzenoux , Marie-Caroline Corbineau , Jean-Christophe Pesquet , Gabriele Scrivanti

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

Optimization and Control · Mathematics 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

Robust principal component analysis (RPCA) has been widely used for recovering low-rank matrices in many data mining and machine learning problems. It separates a data matrix into a low-rank part and a sparse part. The convex approach has…

Computer Vision and Pattern Recognition · Computer Science 2016-09-29 Chong Peng , Zhao Kang , Qiang Chen

Sparse feature selection has been demonstrated to be effective in handling high-dimensional data. While promising, most of the existing works use convex methods, which may be suboptimal in terms of the accuracy of feature selection and…

Machine Learning · Computer Science 2013-01-22 Shuo Xiang , Xiaotong Shen , Jieping Ye

Dictionary learning and component analysis models are fundamental for learning compact representations that are relevant to a given task (feature extraction, dimensionality reduction, denoising, etc.). The model complexity is encoded by…

Machine Learning · Statistics 2018-11-13 Mehdi Bahri , Yannis Panagakis , Stefanos Zafeiriou

Robust model fitting is a core algorithm in a large number of computer vision applications. Solving this problem efficiently for datasets highly contaminated with outliers is, however, still challenging due to the underlying computational…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Giang Truong , Huu Le , David Suter , Erchuan Zhang , Syed Zulqarnain Gilani

This paper presents a family of algorithms for decentralized convex composite problems. We consider the setting of a network of agents that cooperatively minimize a global objective function composed of a sum of local functions plus a…

Optimization and Control · Mathematics 2023-02-14 Yichuan Li , Petros G. Voulgaris , Dusan M. Stipanovic , Nikolaos M. Freris

Robust matrix completion (RMC) is a widely used machine learning tool that simultaneously tackles two critical issues in low-rank data analysis: missing data entries and extreme outliers. This paper proposes a novel scalable and learnable…

Machine Learning · Computer Science 2026-05-22 HanQin Cai , Chandra Kundu , Jialin Liu , Wotao Yin

Numerous applications in data mining and machine learning require recovering a matrix of minimal rank. Robust principal component analysis (RPCA) is a general framework for handling this kind of problems. Nuclear norm based convex surrogate…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Zhao Kang , Chong Peng , Qiang Cheng
‹ Prev 1 3 4 5 6 7 10 Next ›