English
Related papers

Related papers: Implicitly Normalized Online PCA: A Regularized Al…

200 papers

Neural Cellular Automata (NCA) are a powerful combination of machine learning and mechanistic modelling. We train NCA to learn complex dynamics from time series of images and PDE trajectories. Our method is designed to identify underlying…

Pattern Formation and Solitons · Physics 2024-04-23 Alex D. Richardson , Tibor Antal , Richard A. Blythe , Linus J. Schumacher

In this paper, we propose a novel robust Principal Component Analysis (PCA) for high-dimensional data in the presence of various heterogeneities, especially the heavy-tailedness and outliers. A transformation motivated by the characteristic…

Methodology · Statistics 2022-04-05 Lingyu He , Yanrong Yang , Bo Zhang

The rapid expansion in the size of new datasets has created a need for fast and efficient parameter-learning techniques. Compressive learning is a framework that enables efficient processing by using random, non-linear features to project…

Machine Learning · Computer Science 2025-08-18 Daniel Mas Montserrat , David Bonet , Maria Perera , Xavier Giró-i-Nieto , Alexander G. Ioannidis

The growing adoption of IoT systems in industries like transportation, banking, healthcare, and smart energy has increased reliance on sensor networks. However, anomalies in sensor readings can undermine system reliability, making real-time…

Signal Processing · Electrical Eng. & Systems 2025-06-02 Tanish Baranwal , Arnab Das , Srihari Varada , Santanu Das , Mohammad R. Haider

Devising dynamic pricing policy with always valid online statistical learning procedure is an important and as yet unresolved problem. Most existing dynamic pricing policy, which focus on the faithfulness of adopted customer choice models,…

Machine Learning · Statistics 2023-11-22 Chi-Hua Wang , Zhanyu Wang , Will Wei Sun , Guang Cheng

Principal components analysis (PCA) is a fundamental algorithm in data analysis. Its memory-restricted online versions are useful in many modern applications, where the data are too large to fit in memory, or when data arrive as a stream of…

Machine Learning · Computer Science 2023-06-08 Roy Mitz , Yoel Shkolnisky

Cellular Automata are discrete dynamical systems that evolve following simple and local rules. Despite of its local simplicity, knowledge discovery in CA is a NP problem. This is the main motivation for using data mining techniques for CA…

Discrete Mathematics · Computer Science 2007-05-23 Gilson A. Giraldi , Antonio A. F. Oliveira , Leonardo Carvalho

Dynamic inner principal component analysis (DiPCA) is a powerful method for the analysis of time-dependent multivariate data. DiPCA extracts dynamic latent variables that capture the most dominant temporal trends by solving a large-scale,…

Systems and Control · Electrical Eng. & Systems 2020-03-16 Sungho Shin , Alex D. Smith , S. Joe Qin , Victor M. Zavala

Sparse principal component analysis (PCA) is an important technique for dimensionality reduction of high-dimensional data. However, most existing sparse PCA algorithms are based on non-convex optimization, which provide little guarantee on…

Methodology · Statistics 2019-11-20 Yixuan Qiu , Jing Lei , Kathryn Roeder

We deal with a general distributed constrained online learning problem with privacy over time-varying networks, where a class of nondecomposable objectives are considered. Under this setting, each node only controls a part of the global…

Optimization and Control · Mathematics 2024-05-28 Huqiang Cheng , Xiaofeng Liao , Huaqing Li

This text presents an introduction to an emerging paradigm in control of dynamical systems and differentiable reinforcement learning called online nonstochastic control. The new approach applies techniques from online convex optimization…

Machine Learning · Computer Science 2026-04-28 Elad Hazan , Karan Singh

In this paper, we present an online adaptive PCA algorithm that is able to compute the full dimensional eigenspace per new time-step of sequential data. The algorithm is based on a one-step update rule that considers all second order…

Machine Learning · Statistics 2017-09-13 Salaheddin Alakkari , John Dingliana

We propose algorithms for online principal component analysis (PCA) and variance minimization for adaptive settings. Previous literature has focused on upper bounding the static adversarial regret, whose comparator is the optimal fixed…

Machine Learning · Computer Science 2019-05-14 Jianjun Yuan , Andrew Lamperski

Predictive coding networks are neuroscience-inspired models with roots in both Bayesian statistics and neuroscience. Training such models, however, is quite inefficient and unstable. In this work, we show how by simply changing the temporal…

Neural and Evolutionary Computing · Computer Science 2024-02-08 Tommaso Salvatori , Yuhang Song , Yordan Yordanov , Beren Millidge , Zhenghua Xu , Lei Sha , Cornelius Emde , Rafal Bogacz , Thomas Lukasiewicz

We introduce the use of two machine learning algorithms to create an empirical model of an experimental apparatus, which is able to reduce the number of measurements necessary for generic optimisation tasks exponentially as compared to…

Quantum Physics · Physics 2020-05-20 Pascal Kobel , Martin Link , Michael Köhl

We propose Characteristic-Neural Ordinary Differential Equations (C-NODEs), a framework for extending Neural Ordinary Differential Equations (NODEs) beyond ODEs. While NODEs model the evolution of a latent variables as the solution to an…

Machine Learning · Computer Science 2022-11-10 Xingzi Xu , Ali Hasan , Khalil Elkhalil , Jie Ding , Vahid Tarokh

Achieving both optimality and safety under unknown system dynamics is a central challenge in real-world deployment of agents. To address this, we introduce a notion of maximum safe dynamics learning, where sufficient exploration is…

Systems and Control · Electrical Eng. & Systems 2026-02-24 Manish Prajapat , Johannes Köhler , Melanie N. Zeilinger , Andreas Krause

Studies of the degrees of freedom or "synergies" in musculoskeletal systems rely critically on algorithms to estimate the "dimension" of kinematic or neural data. Linear algorithms such as principal component analysis (PCA) are used almost…

Quantitative Methods · Quantitative Biology 2007-05-23 Robert H. Clewley , John M. Guckenheimer , Francisco J. Valero-Cuevas

Conventional optimization methods in machine learning and controls rely heavily on first-order update rules. Selecting the right method and hyperparameters for a particular task often involves trial-and-error or practitioner intuition,…

Machine Learning · Computer Science 2023-03-31 Tanmay Gautam , Samuel Pfrommer , Somayeh Sojoudi

We study principal component analysis (PCA), where given a dataset in $\mathbb{R}^d$ from a distribution, the task is to find a unit vector $v$ that approximately maximizes the variance of the distribution after being projected along $v$.…

Machine Learning · Computer Science 2023-05-05 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia , Thanasis Pittas
‹ Prev 1 4 5 6 7 8 10 Next ›