中文
相关论文

相关论文: Adaptive PCA for Time-Varying Data

200 篇论文

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

最优化与控制 · 数学 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

The growing size of modern data sets brings many challenges to the existing statistical estimation approaches, which calls for new distributed methodologies. This paper studies distributed estimation for a fundamental statistical machine…

分布式、并行与集群计算 · 计算机科学 2021-02-04 Xi Chen , Jason D. Lee , He Li , Yun Yang

High dimensional data has introduced challenges that are difficult to address when attempting to implement classical approaches of statistical process control. This has made it a topic of interest for research due in recent years. However,…

应用统计 · 统计学 2019-04-23 Mohammad Nabhan , Yajun Mei , Jianjun Shi

We propose a new, computationally efficient, sparsity adaptive changepoint estimator for detecting changes in unknown subsets of a high-dimensional data sequence. Assuming the data sequence is Gaussian, we prove that the new method…

统计方法学 · 统计学 2023-11-27 Per August Jarval Moen , Ingrid Kristine Glad , Martin Tveten

We propose and analyze random subspace variants of the second-order Adaptive Regularization using Cubics (ARC) algorithm. These methods iteratively restrict the search space to some random subspace of the parameters, constructing and…

最优化与控制 · 数学 2025-01-17 Coralia Cartis , Zhen Shao , Edward Tansley

This work studies the robust subspace tracking (ST) problem. Robust ST can be simply understood as a (slow) time-varying subspace extension of robust PCA. It assumes that the true data lies in a low-dimensional subspace that is either fixed…

机器学习 · 计算机科学 2022-09-01 Praneeth Narayanamurthy , Namrata Vaswani

A large number of algorithms in machine learning, from principal component analysis (PCA), and its non-linear (kernel) extensions, to more recent spectral embedding and support estimation methods, rely on estimating a linear subspace from…

机器学习 · 统计学 2014-08-22 Alessandro Rudi , Guille D. Canas , Lorenzo Rosasco

With the development of high-throughput technologies, principal component analysis (PCA) in the high-dimensional regime is of great interest. Most of the existing theoretical and methodological results for high-dimensional PCA are based on…

统计理论 · 数学 2019-03-11 Rounak Dey , Seunggeun Lee

Robotic systems operating at the edge require efficient online learning algorithms that can continuously adapt to changing environments while processing streaming sensory data. Traditional backpropagation, while effective, conflicts with…

机器学习 · 计算机科学 2025-10-31 Darius Masoum Zadeh-Jousdani , Elvin Hajizada , Eyke Hüllermeier

Optimal designs minimize the number of experimental runs (samples) needed to accurately estimate model parameters, resulting in algorithms that, for instance, efficiently minimize parameter estimate variance. Governed by knowledge of past…

统计方法学 · 统计学 2023-02-03 Nicholas W. Barendregt , Emily G. Webb , Zachary P. Kilpatrick

Distributed Principal Component Analysis (PCA) has been studied to deal with the case when data are stored across multiple machines and communication cost or privacy concerns prohibit the computation of PCA in a central location. However,…

统计计算 · 统计学 2022-05-02 Yong He , Zichen Liu , Yalin Wang

This paper presents a hierarchical low-rank decomposition algorithm assuming any matrix element can be computed in $O(1)$ time. The proposed algorithm computes rank-revealing decompositions of sub-matrices with a blocked adaptive cross…

Autoregressive models capture stochastic processes in which past realizations determine the generative distribution of new data; they arise naturally in a variety of industrial, biomedical, and financial settings. A key challenge when…

统计理论 · 数学 2020-07-30 Daren Wang , Yi Yu , Alessandro Rinaldo , Rebecca Willett

We introduce a variant of (sparse) PCA in which the set of feasible support sets is determined by a graph. In particular, we consider the following setting: given a directed acyclic graph $G$ on $p$ vertices corresponding to variables, the…

Discovering dominant patterns and exploring dynamic behaviors especially critical state transitions and tipping points in high-dimensional time-series data are challenging tasks in study of real-world complex systems, which demand…

机器学习 · 统计学 2025-01-23 Pei Chen , Yaofang Suo , Rui Liu , Luonan Chen

Accurate predictions of pollutant concentrations at new locations are often of interest in air pollution studies on fine particulate matters (PM$_{2.5}$), in which data is usually not measured at all study locations. PM$_{2.5}$ is also a…

应用统计 · 统计学 2020-05-19 Phuong T. Vu , Timothy V. Larson , Adam A. Szpiro

In this paper, we propose a class of monitoring statistics for a mean shift in a sequence of high-dimensional observations. Inspired by the recent U-statistic based retrospective tests developed by Wang et al.(2019) and Zhang et al.(2020),…

统计方法学 · 统计学 2021-01-19 Teng Wu , Runmin Wang , Hao Yan , Xiaofeng Shao

There is an emerging need for efficient solutions to stochastic AC Optimal Power Flow ({AC-}OPF) to ensure optimal and reliable grid operations in the presence of increasing demand and generation uncertainty. This paper presents a highly…

系统与控制 · 电气工程与系统科学 2020-06-11 Ilyes Mezghani , Sidhant Misra , Deepjyoti Deka

We propose a novel Decentralized Differentially Private Power Method (D-DP-PM) for performing Principal Component Analysis (PCA) in networked multi-agent settings. Unlike conventional decentralized PCA approaches where each agent accesses…

机器学习 · 计算机科学 2025-07-31 Andrew Campbell , Anna Scaglione , Sean Peisert

The concept of parameter setting is a crucial and significant process in metaheuristics since it can majorly impact their performance. It is a highly complex and challenging procedure since it requires a deep understanding of the…

最优化与控制 · 数学 2025-04-08 Vasileios A. Tatsis , Dimos Ioannidis