中文
相关论文

相关论文: Optimal Solutions for Sparse Principal Component A…

200 篇论文

Sparse Principal Component Analysis (PCA) is a dimensionality reduction technique wherein one seeks a low-rank representation of a data matrix with additional sparsity constraints on the obtained representation. We consider two…

信息论 · 计算机科学 2014-05-06 Yash Deshpande , Andrea Montanari

Principal component analysis (PCA) is one of the most commonly used statistical procedures with a wide range of applications. This paper considers both minimax and adaptive estimation of the principal subspace in the high dimensional…

统计理论 · 数学 2014-01-08 T. Tony Cai , Zongming Ma , Yihong Wu

We study sparse approximate solutions to convex optimization problems. It is known that in many engineering applications researchers are interested in an approximate solution of an optimization problem as a linear combination of elements…

机器学习 · 统计学 2012-06-05 V. N. Temlyakov

Regularized variants of Principal Components Analysis, especially Sparse PCA and Functional PCA, are among the most useful tools for the analysis of complex high-dimensional data. Many examples of massive data, have both sparse and…

机器学习 · 统计学 2019-08-21 Genevera I. Allen , Michael Weylandt

This paper studies the sparse identification problem of unknown sparse parameter vectors in stochastic dynamic systems. Firstly, a novel sparse identification algorithm is proposed, which can generate sparse estimates based on least squares…

最优化与控制 · 数学 2024-04-02 Ziming Wang , Xinghua Zhu

We consider the problem of sparse coding, where each sample consists of a sparse linear combination of a set of dictionary atoms, and the task is to learn both the dictionary elements and the mixing coefficients. Alternating minimization is…

机器学习 · 计算机科学 2014-07-30 Alekh Agarwal , Animashree Anandkumar , Prateek Jain , Praneeth Netrapalli

Regularized regression problems are ubiquitous in statistical modeling, signal processing, and machine learning. Sparse regression in particular has been instrumental in scientific model discovery, including compressed sensing applications,…

机器学习 · 统计学 2018-11-09 Peng Zheng , Travis Askham , Steven L. Brunton , J. Nathan Kutz , Aleksandr Y. Aravkin

Principal component analysis (PCA) is a widely used technique for data analysis and dimension reduction with numerous applications in science and engineering. However, the standard PCA suffers from the fact that the principal components…

最优化与控制 · 数学 2009-07-14 Zhaosong Lu , Yong Zhang

Sparse Principal Component Analysis (Sparse PCA) is a pivotal tool in data analysis and dimensionality reduction. However, Sparse PCA is a challenging problem in both theory and practice: it is known to be NP-hard and current exact methods…

机器学习 · 计算机科学 2025-03-06 Alberto Del Pia , Dekun Zhou , Yinglun Zhu

In exact sparse optimization problems on Rd (also known as sparsity constrained problems), one looks for solution that have few nonzero components. In this paper, we consider problems where sparsity is exactly measured either by the…

最优化与控制 · 数学 2019-02-14 Jean-Philippe Chancelier , Michel De Lara , Ponts Paristech

This paper presents how the most recent improvements made on covariance matrix estimation and model order selection can be applied to the portfolio optimisation problem. The particular case of the Maximum Variety Portfolio is treated but…

应用统计 · 统计学 2018-04-03 Emmanuelle Jay , Eugénie Terreaux , Jean-Philippe Ovarlez , Frédéric Pascal

This paper establishes a statistical versus computational trade-off for solving a basic high-dimensional machine learning problem via a basic convex relaxation method. Specifically, we consider the {\em Sparse Principal Component Analysis}…

机器学习 · 计算机科学 2015-10-20 Tengyu Ma , Avi Wigderson

We address combinatorial problems that can be formulated as minimization of a partially separable function of discrete variables (energy minimization in graphical models, weighted constraint satisfaction, pseudo-Boolean optimization, 0-1…

计算机视觉与模式识别 · 计算机科学 2015-05-05 Alexander Shekhovtsov

We study sparse principal component analysis for high dimensional vector autoregressive time series under a doubly asymptotic framework, which allows the dimension $d$ to scale with the series length $T$. We treat the transition matrix of…

机器学习 · 统计学 2013-07-02 Zhaoran Wang , Fang Han , Han Liu

In this paper, we consider the optimization problem of minimizing a continuously differentiable function subject to both convex constraints and sparsity constraints. By exploiting a mixed-integer reformulation from the literature, we define…

最优化与控制 · 数学 2021-04-28 M. Lapucci , T. Levato , F. Rinaldi , M. Sciandrone

We address the non-convex optimisation problem of finding a sparse matrix on the Stiefel manifold (matrices with mutually orthogonal columns of unit length) that maximises (or minimises) a quadratic objective function. Optimisation problems…

最优化与控制 · 数学 2021-10-04 Florian Bernard , Daniel Cremers , Johan Thunberg

Gaussian graphical models are of great interest in statistical learning. Because the conditional independencies between different nodes correspond to zero entries in the inverse covariance matrix of the Gaussian distribution, one can learn…

机器学习 · 计算机科学 2010-11-02 Katya Scheinberg , Shiqian Ma , Donald Goldfarb

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

机器学习 · 统计学 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

This paper studies an optimization problem on the sum of traces of matrix quadratic forms in $m$ semi-orthogonal matrices, which can be considered as a generalization of the synchronization of rotations. While the problem is nonconvex, the…

最优化与控制 · 数学 2021-10-13 Joong-Ho Won , Teng Zhang , Hua Zhou

Sparse PCA provides a linear combination of small number of features that maximizes variance across data. Although Sparse PCA has apparent advantages compared to PCA, such as better interpretability, it is generally thought to be…

机器学习 · 统计学 2012-10-29 Youwei Zhang , Laurent El Ghaoui