English
Related papers

Related papers: Self-Organizing State-Space Models with Artificial…

200 papers

State-space models (SSMs) have recently attention as an efficient alternative to computationally expensive attention-based models for sequence modeling. They rely on linear recurrences to integrate information over time, enabling fast…

Machine Learning · Computer Science 2026-01-01 Mahdi Karami , Ali Behrouz , Peilin Zhong , Razvan Pascanu , Vahab Mirrokni

With a specific emphasis on control design objectives, achieving accurate system modeling with limited complexity is crucial in parametric system identification. The recently introduced deep structured state-space models (SSM), which…

Machine Learning · Computer Science 2024-03-25 Marco Forgione , Manas Mejari , Dario Piga

Learning-based methods commonly treat state estimation in robotics as a sequence modeling problem. While this paradigm can be effective at maximizing end-to-end performance, models are often difficult to interpret and expensive to train,…

Robotics · Computer Science 2026-05-07 Lennart Röstel , Berthold Bäuml

Bayesian analysis of state-space models includes computing the posterior distribution of the system's parameters as well as filtering, smoothing, and predicting the system's latent states. When the latent states wander around $\mathbb{R}^n$…

Methodology · Statistics 2013-12-24 Jesse Windle , Carlos M. Carvalho

This paper considers the state estimation problem for nonlinear dynamic systems with unknown but bounded noises. Set membership filter (SMF) is a popular algorithm to solve this problem. In the set membership setting, we investigate the…

Optimization and Control · Mathematics 2022-11-10 Xiaowei Li , Xuqi Zhang , Zhiguo Wang , Xiaojing Shen

Dynamic inference problems in autoregressive (AR/ARMA/ARIMA), exponential smoothing, and navigation are often formulated and solved using state-space models (SSM), which allow a range of statistical distributions to inform innovations and…

Optimization and Control · Mathematics 2019-10-31 Jonathan Jonker , Peng Zheng , Aleksandr Y. Aravkin

In recent years, there has been a growing interest in integrating linear state-space models (SSM) in deep neural network architectures of foundation models. This is exemplified by the recent success of Mamba, showing better performance than…

Systems and Control · Electrical Eng. & Systems 2024-03-26 Carmen Amo Alonso , Jerome Sieber , Melanie N. Zeilinger

State Space Models (SSMs), particularly recent selective variants like Mamba, have emerged as a leading architecture for sequence modeling, challenging the dominance of Transformers. However, the success of these state-of-the-art models…

Machine Learning · Computer Science 2025-08-06 Yiyi Wang , Jian'an Zhang , Hongyi Duan , Haoyang Liu , Qingyang Li

State-space models (SSMs) are a powerful statistical tool for modelling time-varying systems via a latent state. In these models, the latent state is never directly observed. Instead, a sequence of observations related to the state is…

Computation · Statistics 2025-03-25 Benjamin Cox , Emilie Chouzenoux , Victor Elvira

Estimating hidden states in dynamical systems, also known as optimal filtering, is a long-standing problem in various fields of science and engineering. In this paper, we introduce a general filtering framework, \textbf{LLM-Filter}, which…

Machine Learning · Computer Science 2025-09-25 Shiqi Liu , Wenhan Cao , Chang Liu , Zeyu He , Tianyi Zhang , Shengbo Eben Li

In this paper, we introduce an SMT-based method that automatically synthesizes a distributed self-stabilizing protocol from a given high-level specification and network topology. Unlike existing approaches, where synthesis algorithms…

Software Engineering · Computer Science 2023-06-22 Fathiyeh Faghih , Borzoo Bonakdarpour , Sebastien Tixeuil , Sandeep Kulkarni

Self-organizing maps (SOMs) are a technique that has been used with high-dimensional data vectors to develop an archetypal set of states (nodes) that span, in some sense, the high-dimensional space. Noteworthy applications include weather…

Applications · Statistics 2009-01-23 Huiyan Sang , Alan E. Gelfand , Chris Lennard , Gabriele Hegerl , Bruce Hewitson

Deep state space models (SSMs) are an actively researched model class for temporal models developed in the deep learning community which have a close connection to classic SSMs. The use of deep SSMs as a black-box identification model can…

Systems and Control · Electrical Eng. & Systems 2021-06-21 Daniel Gedon , Niklas Wahlström , Thomas B. Schön , Lennart Ljung

A State Space Model (SSM) is a foundation model in time series analysis, which has recently been shown as an alternative to transformers in sequence modeling. In this paper, we theoretically study the generalization of SSMs and propose…

Machine Learning · Computer Science 2024-05-07 Fusheng Liu , Qianxiao Li

Joint state and parameter estimation is a core problem for dynamic Bayesian networks. Although modern probabilistic inference toolkits make it relatively easy to specify large and practically relevant probabilistic models, the silver…

Artificial Intelligence · Computer Science 2016-03-31 Yusuf Bugra Erol , Yi Wu , Lei Li , Stuart Russell

The objective of this article is to study the asymptotic behavior of a new particle filtering approach in the context of hidden Markov models (HMMs). In particular, we develop an algorithm where the latent-state sequence is segmented into…

Statistics Theory · Mathematics 2014-09-16 Hock Peng Chan , Chiang Wee Heng , Ajay Jasra

State-space models are used in a wide range of time series analysis formulations. Kalman filtering and smoothing are work-horse algorithms in these settings. While classic algorithms assume Gaussian errors to simplify estimation, recent…

Optimization and Control · Mathematics 2018-07-02 Jonathan Jonker , Aleksandr Y. Aravkin , James V. Burke , Gianluigi Pillonetto , Sarah Webster

We consider multi-state capture-recapture-recovery data where observed individuals are recorded in a set of possible discrete states. Traditionally, the Arnason-Schwarz model has been fitted to such data where the state process is modeled…

Applications · Statistics 2015-05-20 Ruth King , Roland Langrock

Structured State Space Models (SSMs), which are at the heart of the recently popular Mamba architecture, are powerful tools for sequence modeling. However, their theoretical foundation relies on a complex, multi-stage process of…

Machine Learning · Computer Science 2025-12-23 Sutashu Tomonaga , Kenji Doya , Noboru Murata

A state space representation of an environment is a classic and yet powerful tool used by many autonomous robotic systems for efficient and often optimal solution planning. However, designing these representations with high performance is…

Machine Learning · Computer Science 2020-12-23 Andrew Wilhelm , Aaron Wilhelm , Garrett Fosdick