English
Related papers

Related papers: Time-Varying Deep State Space Models for Sequences…

200 papers

Distribution shift poses a significant challenge in machine learning, particularly in biomedical applications using data collected across different subjects, institutions, and recording devices, such as sleep data. While existing…

Machine Learning · Computer Science 2026-02-02 Théo Gnassounou , Antoine Collas , Rémi Flamary , Alexandre Gramfort

State-space models (SSMs) face a fundamental trade-off between efficiency and expressivity that is mainly dictated by the structure of the model's transition matrix. Unstructured transition matrices enable maximal expressivity, as measured…

This paper investigates the problem of data-driven stabilization for linear discrete-time switched systems with unknown switching dynamics. In the absence of noise, a data-based state feedback stabilizing controller can be obtained by…

Systems and Control · Electrical Eng. & Systems 2023-11-21 Wenjie Liu , Yifei Li , Jian Sun , Gang Wang , Jie Chen

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

The evolution of sequence modeling architectures, from recurrent neural networks and convolutional models to Transformers and structured state-space models, reflects ongoing efforts to address the diverse temporal dependencies inherent in…

Machine Learning · Computer Science 2025-06-10 Haotian Jiang , Zeyu Bao , Shida Wang , Qianxiao Li

Latent space models (LSMs) are often used to analyze dynamic (time-varying) networks that evolve in continuous time. Existing approaches to Bayesian inference for these models rely on Markov chain Monte Carlo algorithms, which cannot handle…

Methodology · Statistics 2024-01-19 Joshua Daniel Loyal

Graph models provide efficient tools to capture the underlying structure of data defined over networks. Many real-world network topologies are subject to change over time. Learning to model the dynamic interactions between entities in such…

Machine Learning · Computer Science 2025-01-03 Amirhossein Javaheri , Jiaxi Ying , Daniel P. Palomar , Farokh Marvasti

We investigate the expressive power of state space models (SSM), which have recently emerged as a potential alternative to transformer architectures in large language models. Building on recent work, we analyse SSM expressiveness through…

Logic in Computer Science · Computer Science 2026-01-28 Eric Alsmann , Lowejatan Noori , Martin Lange

Dynamical systems with long delay feedback can exhibit complicated temporal phenomena, which once re-organized in a two-dimensional space are reminiscent of spatio-temporal behavior. In this framework, normal forms description have been…

Pattern Formation and Solitons · Physics 2020-12-30 Francesco Marino , Giovanni Giacomelli

Latent state space systems are ubiquitous in statistical modelling, arising naturally when a time series is observed through a noisy measurement function, however training deep state space models (DSSM) at scale remains difficult. Two…

Machine Learning · Computer Science 2026-05-21 John-Joseph Brady , Nikolas Nusken , Yunpeng Li

We investigate stability analysis and controller design of unknown continuous-time systems under state-feedback with aperiodic sampling, using only noisy data but no model knowledge. We first derive a novel data-dependent parametrization of…

Optimization and Control · Mathematics 2022-08-26 Julian Berberich , Stefan Wildhagen , Michael Hertneck , Frank Allgöwer

Dynamical systems are used to model a variety of phenomena in which the bifurcation structure is a fundamental characteristic. Here we propose a statistical machine-learning approach to derive lowdimensional models that automatically…

Quantitative Methods · Quantitative Biology 2015-06-11 Yohei Kondo , Kunihiko Kaneko , Shuji Ishihara

Data-driven, model-free analytics are natural choices for discovery and forecasting of complex, nonlinear systems. Methods that operate in the system state-space require either an explicit multidimensional state-space, or, one approximated…

Machine Learning · Statistics 2021-03-15 Joseph Park , Gerald M Pao , Erik Stabenau , George Sugihara , Thomas Lorimer

Locally adapted parameterizations of a model (such as locally weighted regression) are expressive but often suffer from high variance. We describe an approach for reducing the variance, based on the idea of estimating simultaneously a…

Machine Learning · Computer Science 2012-07-03 Doina Precup , Philip Bachman

To fully understand, analyze, and determine the behavior of dynamical systems, it is crucial to identify their intrinsic modal coordinates. In nonlinear dynamical systems, this task is challenging as the modal transformation based on the…

Machine Learning · Computer Science 2025-03-13 Abdolvahhab Rostamijavanani , Shanwu Li , Yongchao Yang

Audio processors whose parameters are modified periodically over time are often referred as time-varying or modulation based audio effects. Most existing methods for modeling these type of effect units are often optimized to a very specific…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-24 Marco A. Martínez Ramírez , Emmanouil Benetos , Joshua D. Reiss

We develop an approach for Bayesian learning of spatiotemporal dynamical mechanistic models. Such learning consists of statistical emulation of the mechanistic system that can efficiently interpolate the output of the system from arbitrary…

Methodology · Statistics 2025-07-11 Sudipto Banerjee , Xiang Chen , Ian Frankenburg , Daniel Zhou

Learning interpretable representations of neural dynamics at a population level is a crucial first step to understanding how observed neural activity relates to perception and behavior. Models of neural dynamics often focus on either…

Machine Learning · Statistics 2025-01-13 Noga Mudrik , Yenho Chen , Eva Yezerets , Christopher J. Rozell , Adam S. Charles

Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing visual Mamba methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Leiye Liu , Miao Zhang , Jihao Yin , Tingwei Liu , Wei Ji , Yongri Piao , Huchuan Lu

Modeling the dynamics of non-stationary stochastic systems requires balancing the representational power of deep learning with the mathematical transparency of classical models. While classical Markov transition operators provide explicit,…

Machine Learning · Computer Science 2026-05-07 Jan Rovirosa , Jesse Schmolze