English
Related papers

Related papers: Nonlinear Principal Component Analysis with Random…

200 papers

We propose a robust data-driven output feedback control algorithm that explicitly incorporates inherent finite-sample model estimate uncertainties into the control design. The algorithm has three components: (1) a subspace identification…

Systems and Control · Electrical Eng. & Systems 2022-05-12 Benjamin Gravell , Iman Shames , Tyler Summers

High performance computing (HPC) facilities consist of a large number of interconnected computing units (or nodes) that execute highly complex scientific simulations to support scientific research. Monitoring such facilities, in real-time,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-28 Niyazi Sorkunlu , Duc Thanh Anh Luong , Varun Chandola

We show that bootstrap methods based on the positivity of probability measures provide a systematic framework for studying both synchronous and asynchronous nonequilibrium stochastic processes on infinite lattices. First, we formulate…

Statistical Mechanics · Physics 2025-11-12 Minjae Cho

A novel method for estimating Bayesian network (BN) parameters from data is presented which provides improved performance on test data. Previous research has shown the value of representing conditional probability distributions (CPDs) via…

Machine Learning · Computer Science 2013-01-14 Geoff A. Jarrad

We prove concentration inequalities for several models of non-linear random matrices. As corollaries we obtain estimates for linear spectral statistics of the conjugate kernel of neural networks and non-commutative polynomials in (possibly…

Probability · Mathematics 2025-07-15 Radosław Adamczak

The product moment covariance is a cornerstone of multivariate data analysis, from which one can derive correlations, principal components, Mahalanobis distances and many other results. Unfortunately the product moment covariance and the…

Methodology · Statistics 2021-05-21 Jakob Raymaekers , Peter J. Rousseeuw

We propose a novel stochastic algorithm that randomly samples entire rows and columns of the matrix as a way to approximate an arbitrary matrix function using the power series expansion. This contrasts with existing Monte Carlo methods,…

Data Structures and Algorithms · Computer Science 2024-09-23 Nicolas L. Guidotti , Juan A. Acebrón , José Monteiro

Kernel-based subspace clustering, which addresses the nonlinear structures in data, is an evolving area of research. Despite noteworthy progressions, prevailing methodologies predominantly grapple with limitations relating to (i) the…

Machine Learning · Computer Science 2025-01-22 Kunpeng Xu , Lifei Chen , Shengrui Wang

Kernel methods, particularly kernel ridge regression (KRR), are time-proven, powerful nonparametric regression techniques known for their rich capacity, analytical simplicity, and computational tractability. The analysis of their predictive…

Statistics Theory · Mathematics 2025-09-23 Xin Bing , Xin He , Chao Wang

To accelerate kernel methods, we propose a near input sparsity time algorithm for sampling the high-dimensional feature space implicitly defined by a kernel transformation. Our main contribution is an importance sampling method for…

Data Structures and Algorithms · Computer Science 2020-07-15 David P. Woodruff , Amir Zandieh

Estimating the unknown causal dependencies among graph-connected time series plays an important role in many applications, such as sensor network analysis, signal processing over cyber-physical systems, and finance engineering. Inference of…

Signal Processing · Electrical Eng. & Systems 2021-04-02 Rohan Money , Joshin Krishnan , Baltasar Beferull-Lozano

Modern neural network architectures typically have many millions of parameters and can be pruned significantly without substantial loss in effectiveness which demonstrates they are over-parameterized. The contribution of this work is…

Machine Learning · Statistics 2021-03-09 Yaniv Shulman

The recurrent neural network and its variants have shown great success in processing sequences in recent years. However, this deep neural network has not aroused much attention in anomaly detection through predictively process monitoring.…

Machine Learning · Computer Science 2023-09-06 Jiaqi Qiu , Yu Lin , Inez Zwetsloot

We introduce a new method for sparse principal component analysis, based on the aggregation of eigenvector information from carefully-selected axis-aligned random projections of the sample covariance matrix. Unlike most alternative…

Methodology · Statistics 2019-05-07 Milana Gataric , Tengyao Wang , Richard J. Samworth

Recently, deep learning-based denoising approaches have led to dramatic improvements in low sample-count Monte Carlo rendering. These approaches are aimed at path tracing, which is not ideal for simulating challenging light transport…

Graphics · Computer Science 2020-04-28 Shilin Zhu , Zexiang Xu , Henrik Wann Jensen , Hao Su , Ravi Ramamoorthi

In the realm of big data, discerning patterns in nonlinear systems affected by external control inputs is increasingly challenging. Our approach blends the coarse-graining strengths of centroid-based unsupervised clustering with the clarity…

Fluid Dynamics · Physics 2023-12-25 Nitish Arya , Aditya G. Nair

The paper is concerned with asymptotic properties of the principal components analysis of functional data. The currently available results assume the existence of the fourth moment. We develop analogous results in a setting which does not…

Statistics Theory · Mathematics 2018-12-10 Piotr Kokoszka , Stilian Stoev , Qian Xiong

Principal Component Analysis (PCA) is the most widely used tool for linear dimensionality reduction and clustering. Still it is highly sensitive to outliers and does not scale well with respect to the number of data samples. Robust PCA…

Computer Vision and Pattern Recognition · Computer Science 2015-04-24 Nauman Shahid , Vassilis Kalofolias , Xavier Bresson , Michael Bronstein , Pierre Vandergheynst

The research paper addresses linear decomposition of time series of non-additive metrics that allows for the identification and interpretation of contributing factors (input features) of variance. Non-additive metrics, such as ratios, are…

Machine Learning · Computer Science 2022-04-15 Alex Glushkovsky

Deep neural networks have achieved impressive performance on a variety of tasks, but their brittleness to distributional shifts remains a significant barrier to real-world deployment. In this paper, we propose a framework to analyse and…

Machine Learning · Computer Science 2026-05-21 Divij Khaitan , Subhashis Banerjee