English
Related papers

Related papers: Deep Learning-based Approaches for State Space Mod…

200 papers

In scanning microscopy based imaging techniques, there is a need to develop novel data acquisition schemes that can reduce the time for data acquisition and minimize sample exposure to the probing radiation. Sparse sampling schemes are…

Signal Processing · Electrical Eng. & Systems 2018-03-09 Yan Zhang , G. M. Dilshan Godaliyadda , Nicola Ferrier , Emine B. Gulsoy , Charles A. Bouman , Charudatta Phatak

We prove that Moore machines can be exactly realized as state-space models (SSMs), establishing a formal correspondence between symbolic automata and these continuous machine learning architectures. These Moore-SSMs preserve both the…

Machine Learning · Computer Science 2026-03-09 William Fishell , Sam Nicholas Kouteili , Mark Santolucito

Model-based reinforcement learning methods typically learn models for high-dimensional state spaces by aiming to reconstruct and predict the original observations. However, drawing inspiration from model-free reinforcement learning, we…

Machine Learning · Computer Science 2019-12-10 Aaron Havens , Yi Ouyang , Prabhat Nagarajan , Yasuhiro Fujita

Accurate knowledge of the state variables in a dynamical system is critical for effective control, diagnosis, and supervision, especially when direct measurements of all states are infeasible. This paper presents a novel approach to…

Dynamical Systems · Mathematics 2025-07-10 Ayoub Farkane , Mohamed Boutayeb , Mustapha Oudani , Mounir Ghogho

Latent space models are powerful statistical tools for modeling and understanding network data. While the importance of accounting for uncertainty in network analysis has been well recognized, the current literature predominantly focuses on…

Statistics Theory · Mathematics 2025-08-15 Jinming Li , Shihao Wu , Chengyu Cui , Gongjun Xu , Ji Zhu

A central challenge in sequence modeling is efficiently handling tasks with extended contexts. While recent state-space models (SSMs) have made significant progress in this area, they often lack input-dependent filtering or require…

Machine Learning · Computer Science 2024-10-07 Taylan Soydan , Nikola Zubić , Nico Messikommer , Siddhartha Mishra , Davide Scaramuzza

Mapping the surrounding environment is essential for the successful operation of autonomous robots. While extensive research has focused on mapping geometric structures and static objects, the environment is also influenced by the movement…

Robotics · Computer Science 2023-09-04 Junyi Shi , Tomasz Piotr Kucner

Multiscale stochastic dynamical systems have been widely adopted to a variety of scientific and engineering problems due to their capability of depicting complex phenomena in many real world applications. This work is devoted to…

Machine Learning · Statistics 2024-01-02 Lingyu Feng , Ting Gao , Min Dai , Jinqiao Duan

Sequence modeling is a crucial area across various domains, including Natural Language Processing (NLP), speech recognition, time series forecasting, music generation, and bioinformatics. Recurrent Neural Networks (RNNs) and Long Short Term…

Machine Learning · Computer Science 2024-04-26 Badri Narayana Patro , Vijay Srinivas Agneeswaran

Event cameras unlock new frontiers that were previously unthinkable with standard frame-based cameras. One notable example is low-latency motion estimation (optical flow), which is critical for many real-time applications. In such…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Muhammad Ahmed Humais , Xiaoqian Huang , Hussain Sajwani , Sajid Javed , Yahya Zweiri

Learning how complex dynamical systems evolve over time is a key challenge in system identification. For safety critical systems, it is often crucial that the learned model is guaranteed to converge to some equilibrium point. To this end,…

Machine Learning · Computer Science 2021-12-13 Andreas Schlaginhaufen , Philippe Wenk , Andreas Krause , Florian Dörfler

Machines that can replicate human intelligence with type 2 reasoning capabilities should be able to reason at multiple levels of spatio-temporal abstractions and scales using internal world models. Devising formalisms to develop such…

Artificial Intelligence · Computer Science 2025-07-01 Vaisakh Shaj

Modeling long range dependencies in sequential data is a fundamental step towards attaining human-level performance in many modalities such as text, vision, audio and video. While attention-based models are a popular and effective choice in…

Machine Learning · Computer Science 2022-05-20 Ankit Gupta , Albert Gu , Jonathan Berant

State-space models are ubiquitous in the statistical literature since they provide a flexible and interpretable framework for analyzing many time series. In most practical applications, the state-space model is specified through a…

Methodology · Statistics 2020-06-18 Thi Tuyet Trang Chau , Pierre Ailliot , Valérie Monbet

Marked temporal point processes (MTPPs) model sequences of events occurring at irregular time intervals, with wide-ranging applications in fields such as healthcare, finance and social networks. We propose the state-space point process…

Machine Learning · Statistics 2025-10-24 Yuxin Chang , Alex Boyd , Cao Xiao , Taha Kass-Hout , Parminder Bhatia , Padhraic Smyth , Andrew Warrington

Long-range dependencies are critical for understanding genomic structure and function, yet most conventional methods struggle with them. Widely adopted transformer-based models, while excelling at short-context tasks, are limited by the…

State Space Models (SSMs), particularly recent selective variants like Mamba, have emerged as a leading architecture for sequence modeling, challenging the dominance of Transformers. However, the success of these state-of-the-art models…

Machine Learning · Computer Science 2025-08-06 Yiyi Wang , Jian'an Zhang , Hongyi Duan , Haoyang Liu , Qingyang Li

Modern time series data often display complex nonlinear dependencies along with irregular regime-switching behaviors. These features present technical challenges in modeling, inference, and in offering insightful understanding into the…

Machine Learning · Computer Science 2025-01-13 Xiuqin Xu , Hanqiu Peng , Ying Chen

Modeling the dynamic behavior of deformable objects is crucial for creating realistic digital worlds. While conventional simulations produce high-quality motions, their computational costs are often prohibitive. Subspace simulation…

Recent works exploring deep learning application to dynamical systems modeling have demonstrated that embedding physical priors into neural networks can yield more effective, physically-realistic, and data-efficient models. However, in the…

Neural and Evolutionary Computing · Computer Science 2020-11-30 Elliott Skomski , Jan Drgona , Aaron Tuor