English
Related papers

Related papers: Neural State-Space Modeling with Latent Causal-Eff…

200 papers

We investigate neural ordinary and stochastic differential equations (neural ODEs and SDEs) to model stochastic dynamics in fully and partially observed environments within a model-based reinforcement learning (RL) framework. Through a…

Machine Learning · Computer Science 2026-03-25 Chao Han , Stefanos Ioannou , Luca Manneschi , T. J. Hayward , Michael Mangan , Aditya Gilra , Eleni Vasilaki

Time-varying linear state-space models are powerful tools for obtaining mathematically interpretable representations of neural signals. For example, switching and decomposed models describe complex systems using latent variables that evolve…

Neural recordings are nonstationary time series, i.e. their properties typically change over time. Identifying specific changes, e.g. those induced by a learning task, can shed light on the underlying neural processes. However, such changes…

Quantitative Methods · Quantitative Biology 2013-01-28 Duncan A. J. Blythe , Frank C. Meinecke , Paul von Buenau , Klaus-Robert Mueller

State-space models (SSMs) are a class of networks for sequence learning that benefit from fixed state size and linear complexity with respect to sequence length, contrasting the quadratic scaling of typical attention mechanisms. Inspired…

Machine Learning · Computer Science 2025-10-02 Jared Boyer , T. Konstantin Rusch , Daniela Rus

By interpreting the forward dynamics of the latent representation of neural networks as an ordinary differential equation, Neural Ordinary Differential Equation (Neural ODE) emerged as an effective framework for modeling a system dynamics…

Machine Learning · Computer Science 2020-10-19 Daehoon Gwak , Gyuhyeon Sim , Michael Poli , Stefano Massaroli , Jaegul Choo , Edward Choi

Discrete-time modeling of acoustic, mechanical and electrical systems is a prominent topic in the musical signal processing literature. Such models are mostly derived by discretizing a mathematical model, given in terms of ordinary or…

Recurrent neural networks (RNNs) with continuous-time hidden states are a natural fit for modeling irregularly-sampled time series. These models, however, face difficulties when the input data possess long-term dependencies. We prove that…

Machine Learning · Computer Science 2020-12-07 Mathias Lechner , Ramin Hasani

We introduce a foundational model for brain dynamics that utilizes stochastic optimal control (SOC) and amortized inference. Our method features a continuous-discrete state space model (SSM) that can robustly handle the intricate and noisy…

Machine Learning · Computer Science 2025-02-10 Joonhyeong Park , Byoungwoo Park , Chang-Bae Bang , Jungwon Choi , Hyungjin Chung , Byung-Hoon Kim , Juho Lee

Slow waves (SWs) are spatio-temporal patterns of cortical activity that occur both during natural sleep and anesthesia and are preserved across species. Even though electrophysiological recordings have been largely used to characterize…

Causal learning has long concerned itself with the accurate recovery of underlying causal mechanisms. Such causal modelling enables better explanations of out-of-distribution data. Prior works on causal learning assume that the high-level…

We propose a new class of waveform foundation models that departs from conventional sequence based representations by modeling physiological time series as realizations of latent event processes. Rather than treating signals as collections…

Machine Learning · Computer Science 2026-05-12 Li Na , Yuanyun Zhang , Shi Li

Epileptic seizure activity shows complicated dynamics in both space and time. To understand the evolution and propagation of seizures spatially extended sets of data need to be analysed. We have previously described an efficient filtering…

Machine Learning · Statistics 2017-11-15 Gerald K Cooray , Richard Rosch , Torsten Baldeweg , Louis Lemieux , Karl Friston , Biswa Sengupta

Learning interpretable representations of neural dynamics at a population level is a crucial first step to understanding how observed neural activity relates to perception and behavior. Models of neural dynamics often focus on either…

Machine Learning · Statistics 2025-01-13 Noga Mudrik , Yenho Chen , Eva Yezerets , Christopher J. Rozell , Adam S. Charles

Latent dynamics models have emerged as powerful tools for modeling and interpreting neural population activity. Recently, there has been a focus on incorporating simultaneously measured behaviour into these models to further disentangle…

Neurons and Cognition · Quantitative Biology 2021-10-29 Cole Hurwitz , Akash Srivastava , Kai Xu , Justin Jude , Matthew G. Perich , Lee E. Miller , Matthias H. Hennig

Here we introduce Partially Observed Structural Causal Models (POSCMs) that formalize causal systems where latent contexts co-determine both the interaction structure and downstream mechanisms on observed variables. POSCMs provide an…

Machine Learning · Computer Science 2026-05-06 Turan Orujlu , Jordan Matelsky , Martin V. Butz , Charley M. Wu , Konrad P. Kording

Spatiotemporal imaging has applications in e.g. cardiac diagnostics, surgical guidance, and radiotherapy monitoring, In this paper, we explain the temporal motion by identifying the underlying dynamics, only based on the sequential images.…

Medical Physics · Physics 2024-10-16 Niklas Gunnarsson , Peter Kimstrand , Jens Sjölund , Thomas B. Schön

World modelling, i.e. building a representation of the rules that govern the world so as to predict its evolution, is an essential ability for any agent interacting with the physical world. Despite their impressive performance, many…

Machine Learning · Computer Science 2025-05-06 Francesco Petri , Luigi Asprino , Aldo Gangemi

Sequential data often originates from diverse domains across which statistical regularities and domain specifics exist. To specifically learn cross-domain sequence representations, we introduce disentangled state space models (DSSM) -- a…

Event cameras unlock new frontiers that were previously unthinkable with standard frame-based cameras. One notable example is low-latency motion estimation (optical flow), which is critical for many real-time applications. In such…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Muhammad Ahmed Humais , Xiaoqian Huang , Hussain Sajwani , Sajid Javed , Yahya Zweiri

A major tenet in theoretical neuroscience is that cognitive and behavioral processes are ultimately implemented in terms of the neural system dynamics. Accordingly, a major aim for the analysis of neurophysiological measurements should lie…

Machine Learning · Computer Science 2020-07-01 Georgia Koppe , Hazem Toutounji , Peter Kirsch , Stefanie Lis , Daniel Durstewitz