English
Related papers

Related papers: Memory-Efficient Learning of Stable Linear Dynamic…

200 papers

In recent years, nonlinear dynamic system identification using artificial neural networks has garnered attention due to its broad potential applications across science and engineering. However, purely data-driven approaches often struggle…

Machine Learning · Computer Science 2025-11-06 Fabian J. Roth , Dominik K. Klein , Maximilian Kannapinn , Jan Peters , Oliver Weeger

Combining model-based and model-free learning systems has been shown to improve the sample efficiency of learning to perform complex robotic tasks. However, dual-system approaches fail to consider the reliability of the learned model when…

Machine Learning · Computer Science 2020-11-03 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter

Learning-based optimal control algorithms control unknown systems using past trajectory data and a learned model of the system dynamics. These controllers use either a linear approximation of the learned dynamics, trading performance for…

Systems and Control · Electrical Eng. & Systems 2023-07-21 Adam W. Hall , Melissa Greeff , Angela P. Schoellig

In this paper, we consider the problem of stabilizing discrete-time linear systems by computing a nearby stable matrix to an unstable one. To do so, we provide a new characterization for the set of stable matrices. We show that a matrix $A$…

Optimization and Control · Mathematics 2019-03-29 Nicolas Gillis , Michael Karow , Punit Sharma

State-space models (SSMs) have recently attention as an efficient alternative to computationally expensive attention-based models for sequence modeling. They rely on linear recurrences to integrate information over time, enabling fast…

Machine Learning · Computer Science 2026-01-01 Mahdi Karami , Ali Behrouz , Peilin Zhong , Razvan Pascanu , Vahab Mirrokni

This paper demonstrates the benefits of imposing stability on data-driven Koopman operators. The data-driven identification of stable Koopman operators (DISKO) is implemented using an algorithm \cite{mamakoukas_stableLDS2020} that computes…

Robotics · Computer Science 2022-03-25 Giorgos Mamakoukas , Ian Abraham , Todd D. Murphey

Recent advances in learning for control allow to synthesize vehicle controllers from learned system dynamics and maintain robust stability guarantees. However, no approach is well-suited for training linear time-invariant (LTI) controllers…

Systems and Control · Electrical Eng. & Systems 2022-05-11 Marc-Antoine Beaudoin , Benoit Boulet

High-dimensional nonlinear systems pose considerable challenges for modeling and control across many domains, from fluid mechanics to advanced robotics. Such systems are typically approximated with reduced-order models, which often rely on…

Systems and Control · Electrical Eng. & Systems 2025-09-05 Hugo Buurmeijer , Luis A. Pabon , John Irvin Alora , Roshan S. Kaundinya , George Haller , Marco Pavone

We propose a new per-layer adaptive step-size procedure for stochastic first-order optimization methods for minimizing empirical loss functions in deep learning, eliminating the need for the user to tune the learning rate (LR). The proposed…

Machine Learning · Computer Science 2023-07-07 Achraf Bahamou , Donald Goldfarb

Accurate knowledge of the state variables in a dynamical system is critical for effective control, diagnosis, and supervision, especially when direct measurements of all states are infeasible. This paper presents a novel approach to…

Dynamical Systems · Mathematics 2025-07-10 Ayoub Farkane , Mohamed Boutayeb , Mustapha Oudani , Mounir Ghogho

This paper analyzes the stability-related properties of Long Short-Term Memory (LSTM) networks and investigates their use as the model of the plant in the design of Model Predictive Controllers (MPC). First, sufficient conditions…

Systems and Control · Electrical Eng. & Systems 2020-08-31 Enrico Terzi , Fabio Bonassi , Marcello Farina , Riccardo Scattolini

We address the problem of estimating the inputs of a dynamical system from measurements of the system's outputs. To this end, we introduce a novel estimation algorithm that explicitly trades off bias and variance to optimally reduce the…

Machine Learning · Computer Science 2019-09-20 Sebastian Curi , Kfir Y. Levy , Andreas Krause

Autonomous robots require high degrees of cognitive and motoric intelligence to come into our everyday life. In non-structured environments and in the presence of uncertainties, such degrees of intelligence are not easy to obtain.…

Sparse sampling schemes have the potential to dramatically reduce image acquisition time while simultaneously reducing radiation damage to samples. However, for a sparse sampling scheme to be useful it is important that we are able to…

Computer Vision and Pattern Recognition · Computer Science 2017-03-16 G. M. Dilshan P. Godaliyadda , Dong Hye Ye , Michael D. Uchic , Michael A. Groeber , Gregery T. Buzzard , Charles A. Bouman

Stiff dynamical systems represent a central challenge in multi scale modeling across combustion, chemical kinetics, and nonlinear dynamical systems. Neural operator learning has recently emerged as a promising approach to approximate…

Computational Physics · Physics 2026-01-06 Mauro Valorani

Efficient estimation of high-dimensional matrices-including covariance and precision matrices-is a cornerstone of modern multivariate statistics. Most existing studies have focused primarily on the theoretical properties of the estimators…

Machine Learning · Computer Science 2026-03-31 Wan Tian , Hui Yang , Zhouhui Lian , Lingyue Zhang , Yijie Peng

When learning stable linear dynamical systems from data, three important properties are desirable: i) predictive accuracy, ii) verifiable stability, and iii) computational efficiency. Unconstrained minimization of prediction errors leads to…

Robotics · Computer Science 2026-02-17 Hanyao Guo , Yunhai Han , Harish Ravichandar

A new statistical technique for constructing linear latent structure (LLS) models from available data, supported by well established theoretical results and an efficient algorithm, is presented. The method reduces the problem of estimating…

Statistics Theory · Mathematics 2007-06-13 I. Akushevich , M. Kovtun , A. I. Yashin , K. G. Manton

Low precision deep neural network (DNN) training is one of the most effective techniques for boosting DNNs' training efficiency, as it trims down the training cost from the finest bit level. While existing works mostly fix the model…

Machine Learning · Computer Science 2022-03-16 Zhongzhi Yu , Yonggan Fu , Shang Wu , Mengquan Li , Haoran You , Yingyan Lin

Data-driven inference of the generative dynamics underlying a set of observed time series is of growing interest in machine learning and the natural sciences. In neuroscience, such methods promise to alleviate the need to handcraft models…

Machine Learning · Computer Science 2024-11-06 Eric Volkmann , Alena Brändle , Daniel Durstewitz , Georgia Koppe