English
Related papers

Related papers: Learning Dynamical Systems with Side Information

200 papers

Recovering dynamical equations from observed noisy data is the central challenge of system identification. We develop a statistical mechanics approach to analyze sparse equation discovery algorithms, which typically balance data fit and…

Statistical Mechanics · Physics 2025-09-16 Andrei A. Klishin , Joseph Bakarji , J. Nathan Kutz , Krithika Manohar

Self-organization is ubiquitous in nature and mind. However, machine learning and theories of cognition still barely touch the subject. The hurdle is that general patterns are difficult to define in terms of dynamical equations and…

Artificial Intelligence · Computer Science 2023-02-07 Danilo Vasconcellos Vargas , Tham Yik Foong , Heng Zhang

We present a novel approach for learning nonlinear dynamic models, which leads to a new set of tools capable of solving problems that are otherwise difficult. We provide theory showing this new approach is consistent for models with long…

Artificial Intelligence · Computer Science 2009-06-03 John Langford , Ruslan Salakhutdinov , Tong Zhang

The session-based recommendation (SBR) garners increasing attention due to its ability to predict anonymous user intents within limited interactions. Emerging efforts incorporate various kinds of side information into their methods for…

Information Retrieval · Computer Science 2024-02-28 Xiaokun Zhang , Bo Xu , Chenliang Li , Yao Zhou , Liangyue Li , Hongfei Lin

This paper develops a smooth model identification and self-learning strategy for dynamic systems taking into account possible parameter variations and uncertainties. We have tried to solve the problem such that the model follows the changes…

Systems and Control · Electrical Eng. & Systems 2025-01-07 Ebrahim Navid Sadjadi , Jesus Garcia , Jose M. Molina , Akbar Hashemi Borzabadi , Monireh Asadi Abchouyeh

Complex systems in science and engineering sometimes exhibit behavior that changes across different regimes. Traditional global models struggle to capture the full range of this complex behavior, limiting their ability to accurately…

Machine Learning · Computer Science 2023-07-24 Okezzi F. Ukorigho , Opeoluwa Owoyele

Non-linear dynamical systems represent a compact, flexible, and robust tool for reactive motion generation. The effectiveness of dynamical systems relies on their ability to accurately represent stable motions. Several approaches have been…

Robotics · Computer Science 2020-06-01 Matteo Saveriano

Many real-world scientific processes are governed by complex nonlinear dynamic systems that can be represented by differential equations. Recently, there has been increased interest in learning, or discovering, the forms of the equations…

Methodology · Statistics 2022-10-20 Joshua S. North , Christopher K. Wikle , Erin M. Schliep

This work proposes a novel and simple sequential learning strategy to train models on videos and texts for multimodal sentiment analysis. To estimate sentiment polarities on unseen out-of-distribution data, we introduce a multimodal model…

Machine Learning · Computer Science 2024-09-10 Xianbing Zhao , Lizhen Qu , Tao Feng , Jianfei Cai , Buzhou Tang

In this paper, we present a data-driven controller design method for continuous-time nonlinear systems, using no model knowledge but only measured data affected by noise. While most existing approaches focus on systems with polynomial…

Systems and Control · Electrical Eng. & Systems 2022-02-11 Robin Strässer , Julian Berberich , Frank Allgöwer

We describe the application of tools from statistical mechanics to analyse the dynamics of various classes of supervised learning rules in perceptrons. The character of this paper is mostly that of a cross between a biased non-encyclopedic…

Disordered Systems and Neural Networks · Physics 2008-02-03 C. W. H. Mace , A. C. C. Coolen

This paper focuses on learning a model of system dynamics online while satisfying safety constraints.Our motivation is to avoid offline system identification or hand-specified dynamics models and allowa system to safely and autonomously…

Robotics · Computer Science 2020-05-07 Mohammad Javad Khojasteh , Vikas Dhiman , Massimo Franceschetti , Nikolay Atanasov

Dynamical systems can autonomously adapt their organization so that the required target dynamics is reproduced. In the previous Rapid Communication [Phys. Rev. E 90,030901(R) (2014)], it was shown how such systems can be designed using…

Adaptation and Self-Organizing Systems · Physics 2016-11-04 Pablo Kaluza , Alexander S. Mikhailov

Linear dynamical systems are the foundational statistical model upon which control theory is built. Both the celebrated Kalman filter and the linear quadratic regulator require knowledge of the system dynamics to provide analytic…

Optimization and Control · Mathematics 2023-01-24 Ainesh Bakshi , Allen Liu , Ankur Moitra , Morris Yau

System identification of complex and nonlinear systems is a central problem for model predictive control and model-based reinforcement learning. Despite their complexity, such systems can often be approximated well by a set of linear…

Machine Learning · Statistics 2019-05-30 Philip Becker-Ehmck , Jan Peters , Patrick van der Smagt

Modal methods are a long-standing approach to physical modelling synthesis. Extensions to nonlinear problems are possible, leading to coupled nonlinear systems of ordinary differential equations. Recent work in scalar auxiliary variable…

Sound · Computer Science 2026-03-17 Victor Zheleznov , Stefan Bilbao , Alec Wright , Simon King

Understanding a complex system entails capturing the non-trivial collective phenomena that arise from interactions between its different parts. Information theory is a flexible and robust framework to study such behaviours, with several…

Dynamical systems are typically governed by a set of linear/nonlinear differential equations. Distilling the analytical form of these equations from very limited data remains intractable in many disciplines such as physics, biology, climate…

Machine Learning · Computer Science 2021-05-18 Fangzheng Sun , Yang Liu , Hao Sun

This article investigates the effect of explicitly adding auxiliary algebraic trajectory information to neural networks for dynamical systems. We draw inspiration from the field of differential-algebraic equations and differential equations…

Machine Learning · Computer Science 2024-03-13 Tue Boesen , Eldad Haber , Uri Michael Ascher

Data generated from dynamical systems with unknown dynamics enable the learning of state observers that are: robust to modeling error, computationally tractable to design, and capable of operating with guaranteed performance. In this paper,…

Systems and Control · Electrical Eng. & Systems 2021-06-28 Ankush Chakrabarty , Mouhacine Benosman