English
Related papers

Related papers: A variational approach to stable principal compone…

200 papers

Principal components analysis (PCA) is a classical method for the reduction of dimensionality of data in the form of n observations (or cases) of a vector with p variables. For a simple model of factor analysis type, it is proved that…

Statistics Theory · Mathematics 2009-01-29 Iain M Johnstone , Arthur Yu Lu

When synthesizing multi-source high-dimensional data, a key objective is to extract low-dimensional representations that effectively approximate the original features across different sources. Such representations facilitate the discovery…

Machine Learning · Computer Science 2026-03-10 Zhenyu Wang , Molei Liu , Jing Lei , Francis Bach , Zijian Guo

In tracking of time-varying low-rank models of time-varying matrices, we present a method robust to both uniformly-distributed measurement noise and arbitrarily-distributed ``sparse'' noise. In theory, we bound the tracking error. In…

Optimization and Control · Mathematics 2020-02-05 Albert Akhriev , Jakub Marecek , Andrea Simonetto

Convolutional sparse coding (CSC) can learn representative shift-invariant patterns from multiple kinds of data. However, existing CSC methods can only model noises from Gaussian distribution, which is restrictive and unrealistic. In this…

Machine Learning · Computer Science 2020-04-22 Yaqing Wang , James T. Kwok , Lionel M. Ni

Sparse principal component analysis (PCA) involves nonconvex optimization for which the global solution is hard to obtain. To address this issue, one popular approach is convex relaxation. However, such an approach may produce suboptimal…

Machine Learning · Statistics 2014-08-25 Zhaoran Wang , Huanran Lu , Han Liu

Principal Component Analysis is a novel way of of dimensionality reduction. This problem essentially boils down to finding the top k eigen vectors of the data covariance matrix. A considerable amount of literature is found on algorithms…

Machine Learning · Computer Science 2019-01-08 Jian Vora

This paper presents a sequential convex programming (SCP) framework for ensuring the continuous-time satisfaction of compound state-triggered constraints, a subset of logical specifications, in the powered descent guidance (PDG) problem.…

Systems and Control · Electrical Eng. & Systems 2025-10-14 Samet Uzun , Behcet Acikmese , John M. Carson

Principal component pursuit (PCP) is a state-of-the-art approach for background estimation problems. Due to their higher computational cost, PCP algorithms, such as robust principal component analysis (RPCA) and its variants, are not…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Aritra Dutta , Xin Li , Peter Richtárik

We extend the theoretical analysis of a recently proposed single subspace learning algorithm, called Dual Principal Component Pursuit (DPCP), to the case where the data are drawn from of a union of hyperplanes. To gain insight into the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Manolis C. Tsakiris , Rene Vidal

This paper considers the problem of detecting the support (sparsity pattern) of a sparse vector from random noisy measurements. Conditional power of a component of the sparse vector is defined as the energy conditioned on the component…

Information Theory · Computer Science 2015-03-24 Alyson K. Fletcher , Sundeep Rangan , Vivek K Goyal

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

In this paper, we consider the problem of minimum-time optimal control for a dynamical system with initial state uncertainties and propose a sequential convex programming (SCP) solution framework. We seek to minimize the expected terminal…

Optimization and Control · Mathematics 2024-09-17 Kazuya Echigo , Abhishek Cauligi , Behçet Açıkmeşe

The sparse generalized eigenvalue problem arises in a number of standard and modern statistical learning models, including sparse principal component analysis, sparse Fisher discriminant analysis, and sparse canonical correlation analysis.…

Numerical Analysis · Computer Science 2019-03-05 Ganzhao Yuan , Li Shen , Wei-Shi Zheng

We introduce a new approach for designing numerical schemes for stochastic differential equations (SDEs). The approach, which we have called direction and norm decomposition method, proposes to approximate the required solution $X_t$ by…

Numerical Analysis · Mathematics 2017-02-21 C. M. Mora , H. A. Mardones , J. C. Jimenez , M. Selva , R. Biscay

We consider the problem of learning a linear subspace from data corrupted by outliers. Classical approaches are typically designed for the case in which the subspace dimension is small relative to the ambient dimension. Our approach works…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Manolis C. Tsakiris , Rene Vidal

We consider a class of iterative numerical methods and introduce the notion of semiglobally, practically, strictly pseudogradient (SPSP) search directions. We demonstrate the relevance of the SPSP property in modelling a variety of…

Optimization and Control · Mathematics 2017-03-14 Karla Kvaternik

This article introduces a numerical algorithm that serves as a preliminary step toward solving continuous-time model predictive control (MPC) problems directly without explicit time-discretization. The chief ingredients of the underlying…

Optimization and Control · Mathematics 2024-01-24 Souvik Das , Siddhartha Ganguly , Muthyala Anjali , Debasish Chatterjee

The celebrated sparse representation model has led to remarkable results in various signal processing tasks in the last decade. However, despite its initial purpose of serving as a global prior for entire signals, it has been commonly used…

Information Theory · Computer Science 2017-02-23 Vardan Papyan , Jeremias Sulam , Michael Elad

This paper introduces a novel framework called Mode-wise Principal Subspace Pursuit (MOP-UP) to extract hidden variations in both the row and column dimensions for matrix data. To enhance the understanding of the framework, we introduce a…

Methodology · Statistics 2024-08-06 Runshi Tang , Ming Yuan , Anru R. Zhang

Sparse Principal Component Analysis (sPCA) is a popular matrix factorization approach based on Principal Component Analysis (PCA) that combines variance maximization and sparsity with the ultimate goal of improving data interpretation. When…

Machine Learning · Statistics 2020-11-19 J. Camacho , A. K. Smilde , E. Saccenti , J. A. Westerhuis