中文
相关论文

相关论文: An Acceleration Scheme for Memory Limited, Streami…

200 篇论文

Motivated by applications such as sparse PCA, in this paper we present provably-accurate one-pass algorithms for the sparse approximation of the top eigenvectors of extremely massive matrices based on a single compact linear sketch. The…

信息论 · 计算机科学 2026-05-06 Edem Boahen , Simone Brugiapaglia , Hung-Hsu Chou , Mark Iwen , Felix Krahmer

Principal component analysis (PCA) has been widely used in analyzing high-dimensional data. It converts a set of observed data points of possibly correlated variables into a set of linearly uncorrelated variables via an orthogonal…

最优化与控制 · 数学 2024-03-06 Xin Liang , Zhen-Chen Guo , Li Wang , Ren-Cang Li , Wen-Wei Lin

Oja's algorithm for Streaming Principal Component Analysis (PCA) for $n$ data-points in a $d$ dimensional space achieves the same sin-squared error $O(r_{\mathsf{eff}}/n)$ as the offline algorithm in $O(d)$ space and $O(nd)$ time and a…

统计理论 · 数学 2025-03-12 Syamantak Kumar , Purnamrita Sarkar

Sparse PCA is one of the most well-studied problems in high-dimensional statistics. In this problem, we are given samples from a distribution with covariance $\Sigma$, whose top eigenvector $v \in R^d$ is $s$-sparse. Existing sparse PCA…

机器学习 · 统计学 2026-03-04 Syamantak Kumar , Purnamrita Sarkar , Kevin Tian , Peiyuan Zhang

We study principal component analysis (PCA), where given a dataset in $\mathbb{R}^d$ from a distribution, the task is to find a unit vector $v$ that approximately maximizes the variance of the distribution after being projected along $v$.…

机器学习 · 计算机科学 2023-05-05 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia , Thanasis Pittas

We present an acceleration method for sequences of large-scale linear systems, such as the ones arising from the numerical solution of time-dependent partial differential equations coupled with algebraic constraints. We discuss different…

数值分析 · 数学 2024-03-29 Margherita Guido , Daniel Kressner , Paolo Ricci

Principal component analysis (PCA) is a fundamental dimension reduction tool in statistics and machine learning. For large and high-dimensional data, computing the PCA (i.e., the singular vectors corresponding to a number of dominant…

数据结构与算法 · 计算机科学 2017-04-26 Wenjian Yu , Yu Gu , Jian Li , Shenghua Liu , Yaohang Li

Constrained $k$-submodular maximization is a general framework that captures many discrete optimization problems such as ad allocation, influence maximization, personalized recommendation, and many others. In many of these applications,…

数据结构与算法 · 计算机科学 2023-05-26 Fabian Spaeh , Alina Ene , Huy L. Nguyen

Artificial neural networks that learn to perform Principal Component Analysis (PCA) and related tasks using strictly local learning rules have been previously derived based on the principle of similarity matching: similar pairs of inputs…

统计计算 · 统计学 2018-11-06 Victor Minden , Cengiz Pehlevan , Dmitri B. Chklovskii

We analyze a compression scheme for large data sets that randomly keeps a small percentage of the components of each data sample. The benefit is that the output is a sparse matrix and therefore subsequent processing, such as PCA or K-means,…

机器学习 · 统计学 2017-02-24 Farhad Pourkamali-Anaraki , Stephen Becker

In the current context of data explosion, online techniques that do not require storing all data in memory are indispensable to routinely perform tasks like principal component analysis (PCA). Recursive algorithms that update the PCA with…

机器学习 · 统计学 2015-11-13 Hervé Cardot , David Degras

Recent hardware acceleration advances have enabled powerful specialized accelerators for finite element computations, spiking neural network inference, and sparse tensor operations. However, existing approaches face fundamental limitations:…

硬件体系结构 · 计算机科学 2026-01-09 Chuanzhen Wang , Leo Zhang , Eric Liu

Given a multivariate data set, sparse principal component analysis (SPCA) aims to extract several linear combinations of the variables that together explain the variance in the data as much as possible, while controlling the number of…

机器学习 · 统计学 2020-05-08 Peter Richtárik , Majid Jahani , Selin Damla Ahipaşaoğlu , Martin Takáč

Reducing the computation time of model predictive control (MPC) is important, especially for systems constrained by many state constraints. In this paper, we propose a new online constraint removal framework for linear systems, for which we…

最优化与控制 · 数学 2023-08-29 S. A. N. Nouwens , M. M. Paulides , W. P. M. H. Heemels

The Particle-In-Cell (PIC) method is a computational technique widely used in plasma physics to model plasmas at the kinetic level. In this work, we present our effort to prepare the semi-implicit energy-conserving PIC code ECsim for…

Sparse principal component analysis (PCA) is a popular dimensionality reduction technique for obtaining principal components which are linear combinations of a small subset of the original features. Existing approaches cannot supply…

最优化与控制 · 数学 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

This paper proposes a fast system technology co-optimization (STCO) framework that optimizes power, performance, and area (PPA) for next-generation IC design, addressing the challenges and opportunities presented by novel materials and…

新兴技术 · 计算机科学 2024-10-31 Tianliang Ma , Guangxi Fan , Xuguang Sun , Zhihui Deng , Kainlu Low , Leilai Shao

Principal Component Analysis (PCA) is a well known procedure to reduce intrinsic complexity of a dataset, essentially through simplifying the covariance structure or the correlation structure. We introduce a novel algebraic, model-based…

统计方法学 · 统计学 2021-12-09 Martin Schlather , Felix Reinbott

When confronted with massive data streams, summarizing data with dimension reduction methods such as PCA raises theoretical and algorithmic pitfalls. Principal curves act as a nonlinear generalization of PCA and the present paper proposes a…

机器学习 · 统计学 2021-12-16 Benjamin Guedj , Le Li

This paper considers online optimization for a system that performs a sequence of back-to-back tasks. Each task can be processed in one of multiple processing modes that affect the duration of the task, the reward earned, and an additional…

最优化与控制 · 数学 2024-01-17 Michael J. Neely