English
Related papers

Related papers: Regression techniques for subspace-based black-box…

200 papers

This paper addresses the problem of basis correction in the context of LSS identification from input-output data. It is often the case that identification algorithms for the LSSs from input-output data operate locally. The individually…

Systems and Control · Electrical Eng. & Systems 2024-07-30 Fethi Bencherki , Semiha Türkay , Hüseyin Akçay

Data attacks on state estimation modify part of system measurements such that the tempered measurements cause incorrect system state estimates. Attack techniques proposed in the literature often require detailed knowledge of system…

Cryptography and Security · Computer Science 2015-06-19 Jinsub Kim , Lang Tong , Robert J. Thomas

We consider a variant of regression problem, where the correspondence between input and output data is not available. Such shuffled data is commonly observed in many real world problems. Taking flow cytometry as an example, the measuring…

Machine Learning · Computer Science 2021-02-12 Yujia Xie , Yixiu Mao , Simiao Zuo , Hongteng Xu , Xiaojing Ye , Tuo Zhao , Hongyuan Zha

We present an acceleration method for sequences of large-scale linear systems, such as the ones arising from the numerical solution of time-dependent partial differential equations coupled with algebraic constraints. We discuss different…

Numerical Analysis · Mathematics 2024-03-29 Margherita Guido , Daniel Kressner , Paolo Ricci

We study a version of the randomized Kaczmarz algorithm for solving systems of linear equations where the iterates are confined to the solution space of a selected subsystem. We show that the subspace constraint leads to an accelerated…

Numerical Analysis · Mathematics 2024-06-11 Jackie Lok , Elizaveta Rebrova

We show in detail how to determine the time-reversed representation of a stationary hidden stochastic process from linear combinations of its forward-time $\epsilon$-machine causal states. This also gives a check for the $k$-cryptic…

Statistical Mechanics · Physics 2009-06-30 John R. Mahoney , Christopher J. Ellison , James P. Crutchfield

In this study, we employ the recently developed recurrence microstate probabilities as features to improve accuracy of several well-established machine learning (ML) algorithms. These algorithms are applied to classify discrete and…

Chaotic Dynamics · Physics 2025-12-15 J. V. M. Silveira , H. C. Costa , G. S. Spezzatto , T. L. Prado , S. R. Lopes

Spatio-temporal forecasting has numerous applications in analyzing wireless, traffic, and financial networks. Many classical statistical models often fall short in handling the complexity and high non-linearity present in time-series data.…

Machine Learning · Statistics 2021-06-14 Soumyasundar Pal , Liheng Ma , Yingxue Zhang , Mark Coates

State estimation is key to both analyzing physical mechanisms and enabling real-time control of fluid flows. A common estimation approach is to relate sensor measurements to a reduced state governed by a reduced-order model (ROM). (When…

Fluid Dynamics · Physics 2020-06-10 Nirmal J. Nair , Andres Goza

In the present paper, a flexible and parsimonious model of the vibrations of nonlinear mechanical systems is introduced in the form of state-space equations. It is shown that the nonlinear model terms can be formed using a limited number of…

Systems and Control · Computer Science 2016-10-31 Jean-Philippe Noël , Johan Schoukens , Gaetan Kerschen

Off-line robot dynamic identification methods are mostly based on the use of the inverse dynamic model, which is linear with respect to the dynamic parameters. This model is sampled while the robot is tracking reference trajectories that…

Robotics · Computer Science 2010-09-24 Maxime Gautier , Alexandre Janot , Pierre-Olivier Vandanjon

Tasks such as social network analysis, human behavior recognition, or modeling biochemical reactions, can be solved elegantly by using the probabilistic inference framework. However, standard probabilistic inference algorithms work at a…

Artificial Intelligence · Computer Science 2018-12-11 Stefan Lüdtke , Max Schröder , Frank Krüger , Sebastian Bader , Thomas Kirste

Deep state-space models (Deep SSMs) are becoming popular as effective approaches to model sequence data. They have also been shown to be capable of in-context learning, much like transformers. However, a complete picture of how SSMs might…

Machine Learning · Computer Science 2025-02-19 Neeraj Mohan Sushma , Yudou Tian , Harshvardhan Mestha , Nicolo Colombo , David Kappel , Anand Subramoney

Given an overcomplete dictionary $A$ and a signal $b$ that is a linear combination of a few linearly independent columns of $A$, classical sparse recovery theory deals with the problem of recovering the unique sparse representation $x$ such…

Machine Learning · Statistics 2015-07-07 C. You , R. Vidal

We develop an approach to subspace system identification using multiple data records and present a simple rank-based test for the adequacy of these data for fitting the unique linear, noise-free, dynamic model of prescribed state-vector,…

Systems and Control · Computer Science 2017-04-11 Chad M. Holcomb , Robert R. Bitmead

A new statistical model designed for regression analysis with a sparse design matrix is proposed. This new model utilizes the positions of the limited non-zero elements in the design matrix to decompose the regression model into…

Applications · Statistics 2022-01-17 Hsien-Wei Chen

Recently there has been substantial interest in spectral methods for learning dynamical systems. These methods are popular since they often offer a good tradeoff between computational and statistical efficiency. Unfortunately, they can be…

Machine Learning · Statistics 2015-11-05 Ahmed Hefny , Carlton Downey , Geoffrey Gordon

We present a gradient-based meta-learning framework for rapid adaptation of neural state-space models (NSSMs) for black-box system identification. When applicable, we also incorporate domain-specific physical constraints to improve the…

The state space dynamics representation is the most general approach for nonlinear systems and often chosen for system identification. During training, the state trajectory can deform significantly leading to poor data coverage of the state…

Machine Learning · Computer Science 2025-07-11 Hermann Klein , Max Heinz Herkersdorf , Oliver Nelles

Subspace clustering is an important unsupervised clustering approach. It is based on the assumption that the high-dimensional data points are approximately distributed around several low-dimensional linear subspaces. The majority of the…

Machine Learning · Computer Science 2021-12-20 Maryam Abdolali , Nicolas Gillis