English
Related papers

Related papers: Large-Scale System Identification Using a Randomiz…

200 papers

Recursive adaptive filtering methods are often used for solving the problem of simultaneous state and parameters estimation arising in many areas of research. The gradient-based schemes for adaptive Kalman filtering (KF) require the…

Systems and Control · Computer Science 2017-09-12 Julia V. Tsyganova , Maria V. Kulikova

Classical data analysis requires computational efforts that become intractable in the age of Big Data. An essential task in time series analysis is the extraction of physically meaningful information from a noisy time series. One algorithm…

Modeling complex dynamical systems under varying conditions is computationally intensive, often rendering high-fidelity simulations intractable. Although reduced-order models (ROMs) offer a promising solution, current methods often struggle…

Machine Learning · Computer Science 2026-01-16 Andrew F. Ilersich , Kevin Course , Prasanth B. Nair

This paper is devoted to proposing a general weighted low-rank recovery model and designing a fast SVD-free computational scheme to solve it. First, our generic weighted low-rank recovery model unifies several existing approaches in the…

Optimization and Control · Mathematics 2022-08-02 Aritra Dutta , Jingwei Liang , Xin Li

Low-rank matrix approximation is extremely useful in the analysis of data that arises in scientific computing, engineering applications, and data science. However, as data sizes grow, traditional low-rank matrix approximation methods, such…

Numerical Analysis · Mathematics 2020-02-26 Bolong Zhang , Michael Mascagni

High-dimensional image data often require dimensionality reduction before further analysis. This paper provides a purely analytical comparison of two linear techniques-Principal Component Analysis (PCA) and Singular Value Decomposition…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Michael Gyimadu , Gregory Bell , Ph. D

We describe a method for the identification of models for dynamical systems from observational data. The method is based on the concept of symbolic regression and uses genetic programming to evolve a system of ordinary differential…

Machine Learning · Computer Science 2021-07-14 Gabriel Kronberger , Lukas Kammerer , Michael Kommenda

Linear transformation techniques such as singular value decomposition (SVD) have been used widely to gain insight into the qualitative dynamics of data generated by dynamical systems. There have been several reports in the past that had…

Chaotic Dynamics · Physics 2007-05-23 Radhakrishnan Nagarajan

We present a novel approach to system identification (SI) using deep learning techniques. Focusing on parametric system identification (PSI), we use a supervised learning approach for estimating the parameters of discrete and…

Systems and Control · Electrical Eng. & Systems 2023-06-21 Connor James Stephens , Emmanuel Blazquez

This paper surveys randomized algorithms in numerical linear algebra for low-rank decompositions of matrices and tensors. The survey begins with a review of classical matrix algorithms that can be accelerated by randomized dimensionality…

Numerical Analysis · Mathematics 2026-01-01 Katherine J. Pearce , Per-Gunnar Martinsson

The Hadamard decomposition is a powerful technique for data analysis and matrix compression, which decomposes a given matrix into the element-wise product of two or more low-rank matrices. In this paper, we develop an efficient algorithm to…

Machine Learning · Computer Science 2025-04-23 Samuel Wertz , Arnaud Vandaele , Nicolas Gillis

Leveraging recent work on data-driven methods for constructing a finite state space Markov process from dynamical systems, we address two problems for obtaining further reduced statistical representations. The first problem is to extract…

Chaotic Dynamics · Physics 2024-05-14 Ludovico Theo Giorgini , Andre N. Souza , Peter J. Schmid

We derive a finite-sample probabilistic bound on the parameter estimation error of a system identification algorithm for Linear Switched Systems. The algorithm estimates Markov parameters from a single trajectory and applies a variant of…

Machine Learning · Computer Science 2025-05-19 Daniel Racz , Mihaly Petreczky , Balint Daroczy

Singular Value Decomposition (SVD) is a technique based on linear projection theory, which has been frequently used for data analysis. It constitutes an optimal (in the sense of least squares) decomposition of a matrix in the most relevant…

Data Analysis, Statistics and Probability · Physics 2015-03-17 Pau Erola , Javier Borge-Holthoefer , Sergio Gomez , Alex Arenas

Sparse matrix factorization is a popular tool to obtain interpretable data decompositions, which are also effective to perform data completion or denoising. Its applicability to large datasets has been addressed with online and randomized…

Machine Learning · Statistics 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gaël Varoquaux

We present a matrix-factorization algorithm that scales to input matrices with both huge number of rows and columns. Learned factors may be sparse or dense and/or non-negative, which makes our algorithm suitable for dictionary learning,…

Machine Learning · Statistics 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gael Varoquaux

This manuscript describes the randomized algorithm randUTV for computing a so called UTV factorization efficiently. Given a matrix $A$, the algorithm computes a factorization $A = UTV^{*}$, where $U$ and $V$ have orthonormal columns, and…

Numerical Analysis · Mathematics 2017-03-06 Per-Gunnar Martinsson , Gregorio Quintana-Orti , Nathan Heavner

Parametric system identification methods estimate the parameters of explicitly defined physical systems from data. Yet, they remain constrained by the need to provide an explicit function space, typically through a predefined library of…

Machine Learning · Computer Science 2026-03-17 Markus W. Baumgartner , Anson Lei , Joe Watson , Ingmar Posner

Automated per-instance algorithm selection and configuration have shown promising performances for a number of classic optimization problems, including satisfiability, AI planning, and TSP. The techniques often rely on a set of features…

Neural and Evolutionary Computing · Computer Science 2020-10-01 Tome Eftimov , Gorjan Popovski , Quentin Renau , Peter Korosec , Carola Doerr

Large scale dynamical systems (e.g. many nonlinear coupled differential equations) can often be summarized in terms of only a few state variables (a few equations), a trait that reduces complexity and facilitates exploration of behavioral…