English
Related papers

Related papers: Learning neural state-space models: do we need a s…

200 papers

Modeling of physical systems includes extensive use of software packages that implement the accurate finite element method for solving differential equations considered along with the appropriate initial and boundary conditions. When the…

Computational Engineering, Finance, and Science · Computer Science 2018-03-20 O. Kononenko , I. Kononenko

Despite the recent success of stochastic gradient descent in deep learning, it is often difficult to train a deep neural network with an inappropriate choice of its initial parameters. Even if training is successful, it has been known that…

Machine Learning · Computer Science 2023-02-10 Cheolhyoung Lee , Kyunghyun Cho

Literatures in state space models focus on parametric inference and prediction, which fail if the state space model is not fully specified and the maximum likelihood estimation does not work. In this paper, we assume the state transition…

Statistics Theory · Mathematics 2020-12-15 Yunyi Zhang , Tingting Wang , Dimitris N. Politis

Although deep learning based approximation algorithms have been applied very successfully to numerous problems, at the moment the reasons for their performance are not entirely understood from a mathematical point of view. Recently,…

Machine Learning · Computer Science 2023-04-13 Arnulf Jentzen , Adrian Riekert

Recent advances in incorporating neural networks into particle filters provide the desired flexibility to apply particle filters in large-scale real-world applications. The dynamic and measurement models in this framework are learnable…

Machine Learning · Computer Science 2021-03-30 Hao Wen , Xiongjie Chen , Georgios Papagiannis , Conghui Hu , Yunpeng Li

State-space models (SSMs) have recently attention as an efficient alternative to computationally expensive attention-based models for sequence modeling. They rely on linear recurrences to integrate information over time, enabling fast…

Machine Learning · Computer Science 2026-01-01 Mahdi Karami , Ali Behrouz , Peilin Zhong , Razvan Pascanu , Vahab Mirrokni

Recent observations have advanced our understanding of the neural network optimization landscape, revealing the existence of (1) paths of high accuracy containing diverse solutions and (2) wider minima offering improved performance.…

Machine Learning · Computer Science 2021-09-14 Mitchell Wortsman , Maxwell Horton , Carlos Guestrin , Ali Farhadi , Mohammad Rastegari

In this paper, we study the system identification problem for sparse linear time-invariant systems. We propose a sparsity promoting block-regularized estimator to identify the dynamics of the system with only a limited number of input-state…

Systems and Control · Computer Science 2018-08-28 Salar Fattahi , Somayeh Sojoudi

State estimation is an important aspect in many robotics applications. In this work, we consider the task of obtaining accurate state estimates for robotic systems by enhancing the dynamics model used in state estimation algorithms.…

Robotics · Computer Science 2023-02-16 Kong Yao Chee , M. Ani Hsieh

Latent state space models are a fundamental and widely used tool for modeling dynamical systems. However, they are difficult to learn from data and learned models often lack performance guarantees on inference tasks such as filtering and…

Machine Learning · Computer Science 2016-05-31 Wen Sun , Arun Venkatraman , Byron Boots , J. Andrew Bagnell

Characterization of quantum systems from experimental data is a central problem in quantum science and technology. But which measurements should be used to gather data in the first place? While optimal measurement choices can be worked out…

Quantum Physics · Physics 2025-07-15 Jiaxin Huang , Yan Zhu , Giulio Chiribella , Ya-Dong Wu

In this paper, we consider the state estimation problem for nonlinear stochastic discrete-time systems. We combine Lyapunov's method in control theory and deep reinforcement learning to design the state estimator. We theoretically prove the…

Machine Learning · Computer Science 2021-01-08 Liang Hu , Chengwei Wu , Wei Pan

In contrast to conventional robots, accurately modeling the kinematics and statics of continuum robots is challenging due to partially unknown material properties, parasitic effects, or unknown forces acting on the continuous body.…

Robotics · Computer Science 2024-12-03 Sven Lilge , Timothy D. Barfoot , Jessica Burgner-Kahrs

Imitation learning is a control design paradigm that seeks to learn a control policy reproducing demonstrations from expert agents. By substituting expert demonstrations for optimal behaviours, the same paradigm leads to the design of…

Machine Learning · Computer Science 2024-12-20 Dharmesh Tailor , Dario Izzo

Random cost simulations were introduced as a method to investigate optimization problems in systems with conflicting constraints. Here I study the approach in connection with the training of a feed-forward multilayer perceptron, as used in…

High Energy Physics - Phenomenology · Physics 2009-10-28 Bernd A. Berg

Continuous-time (CT) modeling has proven to provide improved sample efficiency and interpretability in learning the dynamical behavior of physical systems compared to discrete-time (DT) models. However, even with numerous recent…

Machine Learning · Computer Science 2023-01-24 Gerben I. Beintema , Maarten Schoukens , Roland Tóth

Stochastic nonlinear dynamical systems are ubiquitous in modern, real-world applications. Yet, estimating the unknown parameters of stochastic, nonlinear dynamical models remains a challenging problem. The majority of existing methods…

Machine Learning · Statistics 2022-05-06 Anubhab Ghosh , Mohamed Abdalmoaty , Saikat Chatterjee , Håkan Hjalmarsson

In this paper, we focus on batch state estimation for linear systems. This problem is important in applications such as environmental field estimation, robotic navigation, and target tracking. Its difficulty lies on that limited operational…

Optimization and Control · Mathematics 2016-09-27 Vasileios Tzoumas , Ali Jadbabaie , George J. Pappas

We derive a reduced-order state estimator for discrete-time infinite dimensional linear systems with finite dimensional Gaussian input and output noise. This state estimator is the optimal one-step estimate that takes values in a fixed…

Optimization and Control · Mathematics 2014-10-08 Atte Aalto

The exploration of complex physical or technological processes usually requires exploiting available information from different sources: (i) physical laws often represented as a family of parameter dependent partial differential equations…

Numerical Analysis · Mathematics 2020-02-04 Albert Cohen , Wolfgang Dahmen , Ron DeVore