English
Related papers

Related papers: Dyna-Style Reinforcement Learning Modeling and Con…

200 papers

This study explores data-driven modeling techniques to capture the dynamics of a grid-forming converter-based infinite bus system, critical for renewable-integrated power grids. Using sparse identification of nonlinear dynamics and deep…

Systems and Control · Electrical Eng. & Systems 2025-10-13 Amir Bahador Javadi , Philip Pong

Data-driven methods of model identification are able to discern governing dynamics of a system from data. Such methods are well suited to help us learn about systems with unpredictable evolution or systems with ambiguous governing dynamics…

Data Analysis, Statistics and Probability · Physics 2025-01-23 Gina Vasey , Daniel Messenger , David Bortz , Andrew Christlieb , Brian O'Shea

This paper presents a physics-informed deep learning approach for predicting the replicator equation, allowing accurate forecasting of population dynamics. This methodological innovation allows us to derive governing differential or…

Artificial Intelligence · Computer Science 2024-12-04 Advait Chandorkar

Interfacial fluctuations in a two-phase binary fluid mixture reveal signatures of underlying physical processes that occur within each phase and on a range of spatial and temporal scales. In this study, we investigate a model binary fluid…

Fluid Dynamics · Physics 2026-03-04 Samuel Z Khiangte , Triparna Sanyal , Sumantra Sarkar , Nairita Pal

Active suspension systems are critical for enhancing vehicle comfort, safety, and stability, yet their performance is often limited by fixed hardware designs and control strategies that cannot adapt to uncertain and dynamic operating…

Robotics · Computer Science 2025-12-04 Ying-Kuan Tsai , Yi-Ping Chen , Vispi Karkaria , Wei Chen

Scientific machine learning for inferring dynamical systems combines data-driven modeling, physics-based modeling, and empirical knowledge. It plays an essential role in engineering design and digital twinning. In this work, we primarily…

Machine Learning · Computer Science 2024-01-09 Pawan Goyal , Igor Pontes Duff , Peter Benner

This paper presents a novel model-reference reinforcement learning control method for uncertain autonomous surface vehicles. The proposed control combines a conventional control method with deep reinforcement learning. With the conventional…

Systems and Control · Electrical Eng. & Systems 2021-06-17 Qingrui Zhang , Wei Pan , Vasso Reppa

This paper presents a hierarchical path-planning and control framework that combines a high-level Deep Q-Network (DQN) for discrete sub-goal selection with a low-level Twin Delayed Deep Deterministic Policy Gradient (TD3) controller for…

Robotics · Computer Science 2025-10-31 Xiaoyi He , Danggui Chen , Zhenshuo Zhang , Zimeng Bai

Learning predictive models from observations using deep neural networks (DNNs) is a promising new approach to many real-world planning and control problems. However, common DNNs are too unstructured for effective planning, and current…

Robotics · Computer Science 2023-12-21 Ziang Liu , Genggeng Zhou , Jeff He , Tobia Marcucci , Li Fei-Fei , Jiajun Wu , Yunzhu Li

The SINDy algorithm has been successfully used to identify the governing equations of dynamical systems from time series data. In this paper, we argue that this makes SINDy a potentially useful tool for causal discovery and that existing…

Machine Learning · Computer Science 2023-01-02 Andrew O'Brien , Rosina Weber , Edward Kim

In recent years there has been a push to discover the governing equations dynamical systems directly from measurements of the state, often motivated by systems that are too complex to directly model. Although there has been substantial work…

Optimization and Control · Mathematics 2023-01-10 Jeffrey M. Hokanson , Gianluca Iaccarino , Alireza Doostan

Applying reinforcement learning (RL) to real-world applications requires addressing a trade-off between asymptotic performance, sample efficiency, and inference time. In this work, we demonstrate how to address this triple challenge by…

Machine Learning · Computer Science 2024-07-03 Zakariae El Asri , Olivier Sigaud , Nicolas Thome

Reinforcement learning in discrete-continuous hybrid action spaces presents fundamental challenges for robotic manipulation, where high-level task decisions and low-level joint-space execution must be jointly optimized. Existing approaches…

Robotics · Computer Science 2026-03-03 Thanh-Tuan Tran , Thanh Nguyen Canh , Nak Young Chong , Xiem HoangVan

The control of complex dynamical systems remains a fundamental challenge in science and engineering, where strong nonlinearities, the presence of noise, and computational constraints often pose significant obstacles in traditional control…

Bridging model-based safety and model-free reinforcement learning (RL) for dynamic robots is appealing since model-based methods are able to provide formal safety guarantees, while RL-based methods are able to exploit the robot agility by…

Robotics · Computer Science 2022-05-13 Zhongyu Li , Jun Zeng , Akshay Thirugnanam , Koushil Sreenath

The paper introduces an interactive machine learning mechanism to process the measurements of an uncertain, nonlinear dynamic process and hence advise an actuation strategy in real-time. For concept demonstration, a trajectory-following…

Systems and Control · Electrical Eng. & Systems 2023-03-16 Mohammed Abouheaf , Derek Boase , Wail Gueaieb , Davide Spinello , Salah Al-Sharhan

Nonlinear system identification often involves a fundamental trade-off between interpretability and flexibility, often requiring the incorporation of physical constraints. We propose a unified data-driven framework that combines the…

Machine Learning · Computer Science 2025-09-16 Federico J. Gonzalez , Luis P. Lara

Pattern-forming systems can exhibit a diverse array of complex behaviors as external parameters are varied, enabling a variety of useful functions in biological and engineered systems. First-principles derivations of the underlying…

Pattern Formation and Solitons · Physics 2023-11-20 Zachary G. Nicolaou , Guanyu Huo , Yihui Chen , Steven L. Brunton , J. Nathan Kutz

Spatiotemporal dynamics pervade the natural sciences, from the morphogen dynamics underlying patterning in animal pigmentation to the protein waves controlling cell division. A central challenge lies in understanding how controllable…

Pattern Formation and Solitons · Physics 2025-03-03 Matthew Ricci , Guy Pelc , Zoe Piran , Noa Moriel , Mor Nitzan

This work proposes a Stochastic Variational Deep Kernel Learning method for the data-driven discovery of low-dimensional dynamical models from high-dimensional noisy data. The framework is composed of an encoder that compresses…

Machine Learning · Computer Science 2023-06-28 Nicolò Botteghi , Mengwu Guo , Christoph Brune