English
Related papers

Related papers: Markov-Switching State-Space Models with Applicati…

200 papers

Deep state space models (SSMs) are an actively researched model class for temporal models developed in the deep learning community which have a close connection to classic SSMs. The use of deep SSMs as a black-box identification model can…

Systems and Control · Electrical Eng. & Systems 2021-06-21 Daniel Gedon , Niklas Wahlström , Thomas B. Schön , Lennart Ljung

Markov State Models (MSM) are widely used to elucidate dynamic properties of molecular systems from unbiased Molecular Dynamics (MD). However, the implementation of reweighting schemes for MSMs to analyze biased simulations, for example…

Chemical Physics · Physics 2020-11-26 Stefanie Kieninger , Luca Donati , Bettina G. Keller

This paper introduces a probabilistic approach for tracking the dynamics of unweighted and directed graphs using state-space models (SSMs). Unlike conventional topology inference methods that assume static graphs and generate point-wise…

Signal Processing · Electrical Eng. & Systems 2024-09-13 Victor M. Tenorio , Elvin Isufi , Geert Leus , Antonio G. Marques

State-space models are widely employed across various research disciplines to study unobserved dynamics. Conventional estimation techniques, such as Kalman filtering and expectation maximisation, offer valuable insights but incur high…

Computation · Statistics 2023-11-28 Jose M. Sanchez-Bornot , Roberto C. Sotero , Scott Kelso , Damien Coyle

Multi-state models are commonly used for intermittent observations of a state over time, but these are generally based on the Markov assumption, that transition rates are independent of the time spent in current and previous states. In a…

Methodology · Statistics 2026-05-07 Christopher Jackson

Markov state models (MSMs) are a powerful tool to analyze and coarse-grain complex dynamical data into interpretable kinetic processes. This capability is particularly important in heterogeneous catalysis, where a medley of reactants and…

Statistical Mechanics · Physics 2026-05-11 Caitlin A. McCandler , Chatipat Lorpaiboon , Timothy C. Berkelbach , Jutta Rogal

Markov switching models are a popular family of models that introduces time-variation in the parameters in the form of their state- or regime-specific values. Importantly, this time-variation is governed by a discrete-valued latent…

Econometrics · Economics 2023-11-13 Yong Song , Tomasz Woźniak

Over the past few years, research on deep graph learning has shifted from static graphs to temporal graphs in response to real-world complex systems that exhibit dynamic behaviors. In practice, temporal graphs are formalized as an ordered…

Machine Learning · Computer Science 2024-10-30 Jintang Li , Ruofan Wu , Xinzhou Jin , Boqun Ma , Liang Chen , Zibin Zheng

State-switching models such as hidden Markov models or Markov-switching regression models are routinely applied to analyse sequences of observations that are driven by underlying non-observable states. Coupled state-switching models extend…

Electromagnetic transient (EMT) simulation is a crucial tool for power system dynamic analysis because of its detailed component modeling and high simulation accuracy. However, it suffers from computational burdens for large power grids…

Systems and Control · Electrical Eng. & Systems 2023-12-21 Min Xiong , Kaiyang Huang , Yang Liu , Rui Yao , Kai Sun , Feng Qiu

Electroencephalogram (EEG) signals play a pivotal role in biomedical research and clinical applications, including epilepsy diagnosis, sleep disorder analysis, and brain-computer interfaces. However, the effective analysis and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jiahao Qin , Feng Liu

State Space Models (SSMs) and Hidden Markov Models (HMMs) are foundational frameworks for modeling sequential data with latent variables and are widely used in signal processing, control theory, and machine learning. Despite their shared…

Machine Learning · Computer Science 2026-01-21 Aydin Ghojogh , M. Hadi Sepanj , Benyamin Ghojogh

State space models (SSMs) provide a flexible framework for modeling complex time series via a latent stochastic process. Inference for nonlinear, non-Gaussian SSMs is often tackled with particle methods that do not scale well to long time…

Machine Learning · Statistics 2023-07-18 Christopher Aicher , Srshti Putcha , Christopher Nemeth , Paul Fearnhead , Emily B. Fox

Markov state models (MSMs) are valuable for studying dynamics of protein conformational changes via statistical analysis of molecular dynamics (MD) simulations. In MSMs, the complex configuration space is coarse-grained into conformational…

Biological Physics · Physics 2024-06-11 Dedi Wang , Yunrui Qiu , Eric Beyerle , Xuhui Huang , Pratyush Tiwary

Large language models have achieved remarkable success in time series prediction tasks, but their substantial computational and memory requirements limit deployment on lightweight platforms. In this paper, we propose the Symbolic Transition…

Machine Learning · Computer Science 2026-02-03 Namkyung Yoon , Hwangnam Kim

Despite the promising performance of state space models (SSMs) in long sequence modeling, limitations still exist. Advanced SSMs like S5 and S6 (Mamba) in addressing non-uniform sampling, their recursive structures impede efficient SSM…

Machine Learning · Computer Science 2024-06-11 Biqing Qi , Junqi Gao , Kaiyan Zhang , Dong Li , Jianxing Liu , Ligang Wu , Bowen Zhou

This paper proposes maximum (quasi)likelihood estimation for high dimensional factor models with regime switching in the loadings. The model parameters are estimated jointly by the EM (expectation maximization) algorithm, which in the…

Econometrics · Economics 2023-04-11 Giovanni Urga , Fa Wang

Learning a Markov Decision Process (MDP) from a fixed batch of trajectories is a non-trivial task whose outcome's quality depends on both the amount and the diversity of the sampled regions of the state-action space. Yet, many MDPs are…

Machine Learning · Computer Science 2022-03-08 Giorgio Angelotti , Nicolas Drougard , Caroline P. C. Chanel

Recently, recurrent models based on linear state space models (SSMs) have shown promising performance in language modeling (LM), competititve with transformers. However, there is little understanding of the in-principle abilities of such…

Computation and Language · Computer Science 2025-12-15 Yash Sarrof , Yana Veitsman , Michael Hahn

Markov state models (MSMs) have been successful in computing metastable states, slow relaxation timescales and associated structural changes, and stationary or kinetic experimental observables of complex molecules from large amounts of…

Chemical Physics · Physics 2015-06-17 Frank Noe , Hao Wu , Jan-Hendrik Prinz , Nuria Plattner