English
Related papers

Related papers: Variational online learning of neural dynamics

200 papers

The identification of a nonlinear dynamic model is an open topic in control theory, especially from sparse input-output measurements. A fundamental challenge of this problem is that very few to zero prior knowledge is available on both the…

Systems and Control · Electrical Eng. & Systems 2022-06-13 Steeven Janny , Quentin Possamai , Laurent Bako , Madiha Nadri , Christian Wolf

We introduce a flexible, scalable Bayesian inference framework for nonlinear dynamical systems characterised by distinct and hierarchical variability at the individual, group, and population levels. Our model class is a generalisation of…

Machine Learning · Statistics 2019-10-03 Geoffrey Roeder , Paul K. Grant , Andrew Phillips , Neil Dalchau , Edward Meeds

Complex and nonlinear dynamical systems often involve parameters that change with time, accurate tracking of which is essential to tasks such as state estimation, prediction, and control. Existing machine-learning methods require full state…

Machine Learning · Computer Science 2023-11-16 Zheng-Meng Zhai , Mohammadamin Moradi , Bryan Glaz , Mulugeta Haile , Ying-Cheng Lai

We propose a novel gradient-based online optimization framework for solving stochastic programming problems that frequently arise in the context of cyber-physical and robotic systems. Our problem formulation accommodates constraints that…

Machine Learning · Computer Science 2026-01-06 Hao Ma , Melanie Zeilinger , Michael Muehlebach

Learning interpretable representations of neural dynamics at a population level is a crucial first step to understanding how observed neural activity relates to perception and behavior. Models of neural dynamics often focus on either…

Machine Learning · Statistics 2025-01-13 Noga Mudrik , Yenho Chen , Eva Yezerets , Christopher J. Rozell , Adam S. Charles

We propose a method for learning dynamical systems from high-dimensional empirical data that combines variational autoencoders and (spatio-)temporal attention within a framework designed to enforce certain scientifically-motivated…

Machine Learning · Computer Science 2023-06-22 Kai Lagemann , Christian Lagemann , Sach Mukherjee

The data-driven recovery of the unknown governing equations of dynamical systems has recently received an increasing interest. However, the identification of governing equations remains challenging when dealing with noisy and partial…

Machine Learning · Computer Science 2021-02-17 Duong Nguyen , Said Ouala , Lucas Drumetz , Ronan Fablet

We consider the problem of forecasting complex, nonlinear space-time processes when observations provide only partial information of on the system's state. We propose a natural data-driven framework, where the system's dynamics are modelled…

Systems and Control · Computer Science 2019-03-01 Ibrahim Ayed , Emmanuel de Bézenac , Arthur Pajot , Julien Brajard , Patrick Gallinari

Accurate knowledge of the state variables in a dynamical system is critical for effective control, diagnosis, and supervision, especially when direct measurements of all states are infeasible. This paper presents a novel approach to…

Dynamical Systems · Mathematics 2025-07-10 Ayoub Farkane , Mohamed Boutayeb , Mustapha Oudani , Mounir Ghogho

This work aims to improve generalization and interpretability of dynamical systems by recovering the underlying lower-dimensional latent states and their time evolutions. Previous work on disentangled representation learning within the…

Machine Learning · Computer Science 2024-06-07 Çağlar Hızlı , Çağatay Yıldız , Matthias Bethge , ST John , Pekka Marttinen

How to recognise whether an observed person walks or runs? We consider a dynamic environment where observations (e.g. the posture of a person) are caused by different dynamic processes (walking or running) which are active one at a time and…

Neurons and Cognition · Quantitative Biology 2012-11-06 Sebastian Bitzer , Izzet B. Yildiz , Stefan J. Kiebel

This manuscript presents an advanced framework for Bayesian learning by incorporating action and state-dependent signal variances into decision-making models. This framework is pivotal in understanding complex data-feedback loops and…

Methodology · Statistics 2023-11-29 Kaiwen Hou

This work proposes a Stochastic Variational Deep Kernel Learning method for the data-driven discovery of low-dimensional dynamical models from high-dimensional noisy data. The framework is composed of an encoder that compresses…

Machine Learning · Computer Science 2023-06-28 Nicolò Botteghi , Mengwu Guo , Christoph Brune

Online Passive-Aggressive (PA) learning is a class of online margin-based algorithms suitable for a wide range of real-time prediction tasks, including classification and regression. PA algorithms are formulated in terms of deterministic…

Machine Learning · Statistics 2015-09-09 Arnold Salas , Stephen J. Roberts , Michael A. Osborne

Discovering the underlying dynamics of complex systems from data is an important practical topic. Constrained optimization algorithms are widely utilized and lead to many successes. Yet, such purely data-driven methods may bring about…

Dynamical Systems · Mathematics 2023-05-17 Nan Chen , Yinling Zhang

Accuracy and generalization capabilities are key objectives when learning dynamical system models. To obtain such models from limited data, current works exploit prior knowledge and assumptions about the system. However, the fusion of…

Machine Learning · Statistics 2025-08-22 Björn Volkmann , Jan-Hendrik Ewering , Michael Meindl , Simon F. G. Ehlers , Thomas Seel

Motivated by neuroscience applications, we introduce the concept of qualitative detection, that is, the problem of determining on-line the current qualitative dynamical behavior (e.g., resting, oscillating, bursting, spiking etc.) of a…

Optimization and Control · Mathematics 2018-10-10 Ying Tang , Alessio Franci , Romain Postoyan

Autonomous robots operating in complex, unstructured environments face significant challenges due to latent, unobserved factors that obscure their understanding of both their internal state and the external world. Addressing this challenge…

Robotics · Computer Science 2026-04-02 Alejandro Murillo-Gonzalez , Lantao Liu

Intelligent real-world systems critically depend on expressive information about their system state and changing operation conditions, e.g., due to variation in temperature, location, wear, or aging. To provide this information, online…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Jan-Hendrik Ewering , Björn Volkmann , Simon F. G. Ehlers , Thomas Seel , Michael Meindl

Differentiable particle filters are an emerging class of sequential Bayesian inference techniques that use neural networks to construct components in state space models. Existing approaches are mostly based on offline supervised training…

Machine Learning · Computer Science 2023-12-19 Jiaxi Li , Xiongjie Chen , Yunpeng Li