中文
相关论文

相关论文: Rank/Norm Regularization with Closed-Form Solution…

200 篇论文

In this paper, we propose a regularized mixture probabilistic model to cluster matrix data and apply it to brain signals. The approach is able to capture the sparsity (low rank, small/zero values) of the original signals by introducing…

统计方法学 · 统计学 2018-08-07 Xu Gao , Weining Shen , Hernando Ombao

Principal component analysis (PCA) is one of the most commonly used statistical procedures with a wide range of applications. This paper considers both minimax and adaptive estimation of the principal subspace in the high dimensional…

统计理论 · 数学 2014-01-08 T. Tony Cai , Zongming Ma , Yihong Wu

Probabilistic principal component analysis (PPCA) is currently one of the most used statistical tools to reduce the ambient dimension of the data. From multidimensional scaling to the imputation of missing data, PPCA has a broad spectrum of…

机器学习 · 统计学 2023-11-15 Arghya Datta , Sayak Chakrabarty

Multi-task learning has been observed by many researchers, which supposes that different tasks can share a low-rank common yet latent subspace. It means learning multiple tasks jointly is better than learning them independently. In this…

机器学习 · 计算机科学 2021-12-10 Wei Chang , Feiping Nie , Rong Wang , Xuelong Li

Dynamic inner principal component analysis (DiPCA) is a powerful method for the analysis of time-dependent multivariate data. DiPCA extracts dynamic latent variables that capture the most dominant temporal trends by solving a large-scale,…

系统与控制 · 电气工程与系统科学 2020-03-16 Sungho Shin , Alex D. Smith , S. Joe Qin , Victor M. Zavala

Principal component analysis (PCA) is arguably the most widely used approach for large-dimensional factor analysis. While it is effective when the factors are sufficiently strong, it can be inconsistent when the factors are weak and/or the…

统计方法学 · 统计学 2025-08-22 Zhongyuan Lyu , Ming Yuan

Subspace identification is a classical and very well studied problem in system identification. The problem was recently posed as a convex optimization problem via the nuclear norm relaxation. Inspired by robust PCA, we extend this framework…

系统与控制 · 计算机科学 2013-12-10 Dorsa Sadigh , Henrik Ohlsson , S. Shankar Sastry , Sanjit A. Seshia

Principal component analysis (PCA) is a simple and popular tool for processing high-dimensional data. We investigate its effectiveness for matrix denoising. We consider the clean data are generated from a low-dimensional subspace, but…

统计理论 · 数学 2024-08-29 Xin T. Tong , Wanjie Wang , Yuguan Wang

In this paper we develop a new approach to sparse principal component analysis (sparse PCA). We propose two single-unit and two block optimization formulations of the sparse PCA problem, aimed at extracting a single sparse dominant…

最优化与控制 · 数学 2008-12-01 Michel Journée , Yurii Nesterov , Peter Richtárik , Rodolphe Sepulchre

Robust principal component analysis seeks to recover a low-rank matrix from fully observed data with sparse corruptions. A scalable approach fits a low-rank factorization by minimizing the sum of entrywise absolute residuals, leading to a…

最优化与控制 · 数学 2026-01-30 Pinxi Gong , Lexiao Lai , Jianhao Ma

In this paper, Kernel PCA is reinterpreted as the solution to a convex optimization problem. Actually, there is a constrained convex problem for each principal component, so that the constraints guarantee that the principal component is…

机器学习 · 计算机科学 2017-10-25 Carlos M. Alaíz , Michaël Fanuel , Johan A. K. Suykens

Distributed algorithms and theories are called for in this era of big data. Under weaker local signal-to-noise ratios, we improve upon the celebrated one-round distributed principal component analysis (PCA) algorithm designed in the spirit…

统计方法学 · 统计学 2025-07-01 ZeYu Li , Xinsheng Zhang , Wang Zhou

We study the problem of clustering ranking vectors, where each vector represents preferences as an ordered list of distinct integers. Specifically, we focus on the k-centroids ranking vectors clustering problem (KRC), which aims to…

机器学习 · 计算机科学 2025-07-18 Ali Fattahi , Ali Eshragh , Babak Aslani , Meysam Rabiee

Consider an ill-posed inverse problem of estimating causal factors from observations, one of which is known to lie near some (un- known) low-dimensional, non-linear manifold expressed by a predefined Mercer-kernel. Solving this problem…

计算机视觉与模式识别 · 计算机科学 2016-03-17 Ravi Garg , Anders Eriksson , Ian Reid

In this paper, we introduce and formalize a rank-one partitioning learning paradigm that unifies partitioning methods that proceed by summarizing a data set using a single vector that is further used to derive the final clustering…

机器学习 · 计算机科学 2020-09-02 Charlotte Laclau , Franck Iutzeler , Ievgen Redko

Interior-point methods for linear programming problems require the repeated solution of a linear system of equations. Solving these linear systems is non-trivial due to the severe ill-conditioning of the matrices towards convergence. This…

最优化与控制 · 数学 2021-05-05 Jeffrey Cornelis , Wim Vanroose

We study a regularizer which is defined as a parameterized infimum of quadratics, and which we call the box-norm. We show that the k-support norm, a regularizer proposed by [Argyriou et al, 2012] for sparse vector prediction problems,…

机器学习 · 计算机科学 2016-01-12 Andrew M. McDonald , Massimiliano Pontil , Dimitris Stamos

Principal component analysis (PCA) is a widely used method for data processing, such as for dimension reduction and visualization. Standard PCA is known to be sensitive to outliers, and thus, various robust PCA methods have been proposed.…

机器学习 · 统计学 2020-08-11 Keishi Sando , Hideitsu Hino

Principal Component Analysis (PCA) and K-means constitute fundamental techniques in multivariate analysis. Although they are frequently applied independently or sequentially to cluster observations, the relationship between them, especially…

机器学习 · 统计学 2025-12-02 Victor Saquicela , Kenneth Palacio-Baus , Mario Chifla

Nonconvex regularization has been popularly used in low-rank matrix learning. However, extending it for low-rank tensor learning is still computationally expensive. To address this problem, we develop an efficient solver for use with a…

机器学习 · 计算机科学 2022-05-09 Quanming Yao , Yaqing Wang , Bo Han , James Kwok