中文
相关论文

相关论文: Polynomial Time and Sample Complexity for Non-Gaus…

200 篇论文

Robust principal component analysis (RPCA) is a well-studied problem with the goal of decomposing a matrix into the sum of low-rank and sparse components. In this paper, we propose a nonconvex feasibility reformulation of RPCA problem and…

最优化与控制 · 数学 2020-01-27 Aritra Dutta , Filip Hanzely , Peter Richtárik

Principal component analysis (PCA) is largely adopted for chemical process monitoring and numerous PCA-based systems have been developed to solve various fault detection and diagnosis problems. Since PCA-based methods assume that the…

机器学习 · 计算机科学 2017-12-13 Haitao Zhao

Robust Principal Component Analysis (RPCA) is a fundamental technique for decomposing data into low-rank and sparse components, which plays a critical role for applications such as image processing and anomaly detection. Traditional RPCA…

机器学习 · 计算机科学 2024-12-20 Kexin Li , You-wei Wen , Xu Xiao , Mingchao Zhao

Principal Component Analysis (PCA) finds the best linear representation of data, and is an indispensable tool in many learning and inference tasks. Classically, principal components of a dataset are interpreted as the directions that…

最优化与控制 · 数学 2019-12-24 Raphael A. Hauser , Armin Eftekhari

We study the problem of overcoming exponential sample complexity in differential entropy estimation under Gaussian convolutions. Specifically, we consider the estimation of the differential entropy $h(X+Z)$ via $n$ independently and…

信息论 · 计算机科学 2023-05-12 Kristjan Greenewald , Brian Kingsbury , Yuancheng Yu

Signal processing in non-Gaussian noise environment is addressed in this paper. For many real-life situations, the additive noise process present in the system is found to be dominantly non-Gaussian. The problem of detection and estimation…

统计理论 · 数学 2014-01-23 Jugalkishore K. Banoth , Pradip Sircar

This work is concerned with the non-negative rank-1 robust principal component analysis (RPCA), where the goal is to recover the dominant non-negative principal components of a data matrix precisely, where a number of measurements could be…

机器学习 · 计算机科学 2019-09-05 Salar Fattahi , Somayeh Sojoudi

Principal Component Analysis (PCA) is one of the most used tools for extracting low-dimensional representations of data, in particular for time series. Performances are known to strongly depend on the quality (amount of noise) and the…

应用统计 · 统计学 2024-12-16 Mariia Legenkaia , Laurent Bourdieu , Rémi Monasson

We consider the problem of maximizing the variance explained from a data matrix using orthogonal sparse principal components that have a support of fixed cardinality. While most existing methods focus on building principal components (PCs)…

最优化与控制 · 数学 2022-10-14 Dimitris Bertsimas , Driss Lahlou Kitane

Even in low dimensions, sampling from multi-modal distributions is challenging. We provide the first sampling algorithm for a broad class of distributions -- including all Gaussian mixtures -- with a query complexity that is polynomial in…

统计计算 · 统计学 2025-10-24 Adrien Vacher , Omar Chehab , Anna Korba

Principal component analysis (PCA) defines a reduced space described by PC axes for a given multidimensional-data sequence to capture the variations of the data. In practice, we need multiple data sequences that accurately obey individual…

统计方法学 · 统计学 2021-04-19 Ikuo Fukuda , Kei Moritsugu

This paper aims to address the phase retrieval problem from subgaussian measurements with arbitrary noise, with a focus on devising robust and efficient algorithms for solving non-convex problems. To ensure uniqueness of solutions in the…

最优化与控制 · 数学 2024-12-11 Haiyang Peng , Deren Han , Linbin Li , Meng Huang

Distributed computing is a standard way to scale up machine learning and data science algorithms to process large amounts of data. In such settings, avoiding communication amongst machines is paramount for achieving high performance. Rather…

机器学习 · 统计学 2021-05-04 Vasileios Charisopoulos , Austin R. Benson , Anil Damle

We present a method for performing Principal Component Analysis (PCA) on noisy datasets with missing values. Estimates of the measurement error are used to weight the input data such that compared to classic PCA, the resulting eigenvectors…

天体物理仪器与方法 · 物理学 2015-06-11 Stephen Bailey

We give an efficient algorithm for finding sparse approximate solutions to linear systems of equations with nonnegative coefficients. Unlike most known results for sparse recovery, we do not require {\em any} assumption on the matrix other…

数据结构与算法 · 计算机科学 2015-01-09 Aditya Bhaskara , Ananda Theertha Suresh , Morteza Zadimoghaddam

We consider the following multi-component sparse PCA problem: given a set of data points, we seek to extract a small number of sparse components with disjoint supports that jointly capture the maximum possible variance. These components can…

It is well known that Sparse PCA (Sparse Principal Component Analysis) is NP-hard to solve exactly on worst-case instances. What is the complexity of solving Sparse PCA approximately? Our contributions include: 1) a simple and efficient…

机器学习 · 统计学 2015-07-22 Siu On Chan , Dimitris Papailiopoulos , Aviad Rubinstein

We consider the problem of clustering data points in high dimensions, i.e. when the number of data points may be much smaller than the number of dimensions. Specifically, we consider a Gaussian mixture model (GMM) with non-spherical…

统计理论 · 数学 2014-06-10 Martin Azizyan , Aarti Singh , Larry Wasserman

Principal component analysis (PCA) aims at estimating the direction of maximal variability of a high-dimensional dataset. A natural question is: does this task become easier, and estimation more accurate, when we exploit additional…

信息论 · 计算机科学 2014-06-19 Andrea Montanari , Emile Richard

Identifying low-dimensional latent structures within high-dimensional data has long been a central topic in the machine learning community, driven by the need for data compression, storage, transmission, and deeper data understanding.…

机器学习 · 统计学 2025-03-28 Ye Tian , Sanyou Wu , Long Feng