English
Related papers

Related papers: Dyna-Style Reinforcement Learning Modeling and Con…

200 papers

Reinforcement learning from expert demonstrations has long remained a challenging research problem, and existing state-of-the-art methods using behavioral cloning plus further RL training often suffer from poor generalization, low sample…

Machine Learning · Computer Science 2025-05-07 Borui Wang , Kathleen McKeown , Rex Ying

We present a weak formulation and discretization of the system discovery problem from noisy measurement data. This method of learning differential equations from data fits into a new class of algorithms that replace pointwise derivative…

Numerical Analysis · Mathematics 2022-05-03 Daniel A. Messenger , David M. Bortz

We present a three-step method to perform system identification and optimal control of non-linear systems. Our approach is mainly data driven and does not require active excitation of the system to perform system identification. In…

Systems and Control · Electrical Eng. & Systems 2020-09-16 Baptiste Schubnel , Rafael E. Carrillo , Pierre-Jean Alet , Andreas Hutter

In this paper, we introduce a self-supervised deep SLAM method that robustly operates in dynamic scenes while accurately identifying dynamic components. Our method leverages a dual-flow representation for static flow and dynamic flow,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Xingyuan Yu , Weicai Ye , Xiyue Guo , Yuhang Ming , Jinyu Li , Hujun Bao , Zhaopeng Cui , Guofeng Zhang

Modeling realistic fluid and plasma flows is computationally intensive, motivating the use of reduced-order models for a variety of scientific and engineering tasks. However, it is challenging to characterize, much less guarantee, the…

Deep reinforcement learning (DRL) finds extensive application in autonomous drone navigation within complex, high-risk environments. However, its practical deployment faces a safety-exploration dilemma: soft penalty mechanisms encourage…

Robotics · Computer Science 2026-05-04 Wentao Chen , Jingtang Chen , Mingjian Fu , Tiantian Li , Youfeng Su , Wenxi Liu , Yuanlong Yu

The capability to autonomously track a non-cooperative target is a key technological requirement for micro aerial vehicles. In this paper, we propose an output feedback control scheme based on deep reinforcement learning for controlling a…

Robotics · Computer Science 2024-02-08 Alberto Dionigi , Mirko Leomanni , Alessandro Saviolo , Giuseppe Loianno , Gabriele Costante

Recent progress in autoencoder-based sparse identification of nonlinear dynamics (SINDy) under $\ell_1$ constraints allows joint discoveries of governing equations and latent coordinate systems from spatio-temporal data, including simulated…

Machine Learning · Computer Science 2022-11-22 L. Mars Gao , J. Nathan Kutz

Despite the recent proliferation of machine learning methods like SINDy that promise automatic discovery of governing equations from time-series data, there remain significant challenges to discovering models from noisy datasets. One reason…

Methodology · Statistics 2025-08-01 Lloyd Fung

The dynamic mode decomposition (DMD) is a data-driven method used for identifying the dynamics of complex nonlinear systems. It extracts important characteristics of the underlying dynamics using measured time-domain data produced either by…

Numerical Analysis · Mathematics 2020-11-24 Ion Victor Gosea , Igor Pontes Duff

Reduced-order models are central to motion planning and control of quadruped robots, yet existing templates are often hand-crafted for a specific locomotion modality. This motivates the need for automatic methods that extract task-specific,…

Robotics · Computer Science 2026-01-14 Gioele Buriani , Jingyue Liu , Maximilian Stölzle , Cosimo Della Santina , Jiatao Ding

Robust control policy learning for autonomous driving requires training environments to be both physically realistic and computationally scalable, properties that existing simulators provide only in isolation. We introduce Sim2Sim2Sim, a…

Robotics · Computer Science 2026-05-05 Xunjiang Gu , Kashyap Chitta , Mahsa Golchoubian , Vladimir Suplin , Igor Gilitschenski

We compare the efficiency and ease-of-use of the Sparse Identification of Nonlinear Dynamics (SINDy) algorithm and Sparse Physics-Informed Discovery of Empirical Relations (SPIDER) framework in recovering the relevant governing equations…

Solar and Stellar Astrophysics · Physics 2025-05-16 Christopher J. Wareing , Alasdair T. Roy , Matthew Golden , Roman O. Grigoriev , Steven M. Tobias

We study data-driven identification of interpretable hybrid robot dynamics, where an analytical rigid-body dynamics model is complemented by a learned residual torque term. Using symbolic regression and sparse identification of nonlinear…

Robotics · Computer Science 2025-12-16 Christopher E. Mower , Rui Zong , Haitham Bou-Ammar

This work designs a scalable, parameter-aware sparse regression framework for discovering interpretable partial differential equations and subgrid-scale closures from multi-parameter simulation data. Building on SINDy (Sparse Identification…

Machine Learning · Computer Science 2025-09-03 Hanseul Kang , Ville Vuorinen , Shervin Karimkashi

Practitioners often rely on compute-intensive domain randomization to ensure reinforcement learning policies trained in simulation can robustly transfer to the real world. Due to unmodeled nonlinearities in the real system, however, even…

Machine Learning · Computer Science 2020-02-27 Gabriel I. Fernandez , Colin Togashi , Dennis W. Hong , Lin F. Yang

In this paper, we propose an adaptive event-triggered reinforcement learning control for continuous-time nonlinear systems, subject to bounded uncertainties, characterized by complex interactions. Specifically, the proposed method is…

Machine Learning · Computer Science 2024-10-01 Umer Siddique , Abhinav Sinha , Yongcan Cao

We propose a data-driven framework for learning reduced-order moment dynamics from PDE-governed systems using Neural ODEs. In contrast to derivative-based methods like SINDy, which necessitate densely sampled data and are sensitive to…

Pattern Formation and Solitons · Physics 2025-06-06 Shaoxuan Chen , Su Yang , Panayotis G. Kevrekidis , Wei Zhu

Model-free reinforcement learning (RL) is inherently a reactive method, operating under the assumption that it starts with no prior knowledge of the system and entirely depends on trial-and-error for learning. This approach faces several…

The learning inefficiency of reinforcement learning (RL) from scratch hinders its practical application towards continuous robotic tracking control, especially for high-dimensional robots. This work proposes a data-informed residual…

Systems and Control · Electrical Eng. & Systems 2024-06-10 Cong Li , Fangzhou Liu , Yongchao Wang , Martin Buss