English
Related papers

Related papers: Learning from Less: SINDy Surrogates in RL

200 papers

Reinforcement Learning (RL) environments can produce training data with spurious correlations between features due to the amount of training data or its limited feature coverage. This can lead to RL agents encoding these misleading…

Machine Learning · Computer Science 2023-10-13 Mhairi Dunion , Trevor McInroe , Kevin Sebastian Luck , Josiah P. Hanna , Stefano V. Albrecht

In robotic systems, the performance of reinforcement learning depends on the rationality of predefined reward functions. However, manually designed reward functions often lead to policy failures due to inaccuracies. Inverse Reinforcement…

Robotics · Computer Science 2025-09-12 Yongkai Tian , Yirong Qi , Xin Yu , Wenjun Wu , Jie Luo

Model parsimony is an important \emph{cognitive bias} in data-driven modelling that aids interpretability and helps to prevent over-fitting. Sparse identification of nonlinear dynamics (SINDy) methods are able to learn sparse…

Machine Learning · Statistics 2025-06-26 Max D. Champneys , Timothy J. Rogers

We develop a data-driven model discovery and system identification technique for spatially-dependent boundary value problems (BVPs). Specifically, we leverage the sparse identification of nonlinear dynamics (SINDy) algorithm and group…

Computational Engineering, Finance, and Science · Computer Science 2021-07-07 Daniel E. Shea , Steven L. Brunton , J. Nathan Kutz

Data scarcity is a bottleneck to machine learning-based perception modules, usually tackled by augmenting real data with synthetic data from simulators. Realistic models of the vehicle perception sensors are hard to formulate in closed…

Image and Video Processing · Electrical Eng. & Systems 2019-12-03 Ahmad El Sallab , Ibrahim Sobh , Mohamed Zahran , Mohamed Shawky

Safe and efficient autonomous driving maneuvers in an interactive and complex environment can be considerably challenging due to the unpredictable actions of other surrounding agents that may be cooperative or adversarial in their…

Robotics · Computer Science 2019-01-28 Pin Wang , Ching-Yao Chan , Hanhan Li

The discovery of governing differential equations from data is an open frontier in machine learning. The sparse identification of nonlinear dynamics (SINDy) \citep{brunton_discovering_2016} framework enables data-driven discovery of…

Machine Learning · Computer Science 2023-10-10 Mozes Jacobs , Bingni W. Brunton , Steven L. Brunton , J. Nathan Kutz , Ryan V. Raut

Reinforcement learning for training end-to-end autonomous driving models in closed-loop simulations is gaining growing attention. However, most simulation environments differ significantly from real-world conditions, creating a substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Chaojun Ni , Guosheng Zhao , Xiaofeng Wang , Zheng Zhu , Wenkang Qin , Xinze Chen , Guanghong Jia , Guan Huang , Wenjun Mei

Challenging problems of deep reinforcement learning systems with regard to the application on real systems are their adaptivity to changing environments and their efficiency w.r.t. computational resources and data. In the application of…

Machine Learning · Computer Science 2022-02-18 Maria Kalweit , Gabriel Kalweit , Moritz Werling , Joschka Boedecker

Phase mixing is a fundamental kinetic process that governs dissipation and stability in collisionless plasmas, but its inherent filamentation in velocity space creates major challenges for both high-fidelity simulations and reduced-order…

Plasma Physics · Physics 2025-09-23 Darian Figuera-Michal , Sungpil Yum , Jae-Min Kwon , Eisung Yoon

This work explores learning agent-agnostic synthetic environments (SEs) for Reinforcement Learning. SEs act as a proxy for target environments and allow agents to be trained more efficiently than when directly trained on the target…

Machine Learning · Computer Science 2021-02-09 Fabio Ferreira , Thomas Nierhoff , Frank Hutter

Exploration with sparse rewards remains a challenging research problem in reinforcement learning (RL). Especially for sequential object manipulation tasks, the RL agent always receives negative rewards until completing all sub-tasks, which…

Robotics · Computer Science 2022-11-04 Yongle Luo , Yuxin Wang , Kun Dong , Qiang Zhang , Erkang Cheng , Zhiyong Sun , Bo Song

Model-based reinforcement learning has attracted much attention due to its high sample efficiency and is expected to be applied to real-world robotic applications. In the real world, as unobservable disturbances can lead to unexpected…

Robotics · Computer Science 2025-05-26 Taisuke Kobayashi

RaNNDy is a randomized neural network architecture for the data-driven approximation of transfer operators associated with complex dynamical systems. The weights and biases of the hidden layers of the network are randomly initialized and…

Machine Learning · Computer Science 2026-05-25 Mohammad Tabish , Stefan Klus

Reinforcement Learning (RL) is an area of growing interest in the field of artificial intelligence due to its many notable applications in diverse fields. Particularly within the context of intelligent vehicle control, RL has made…

Machine Learning · Computer Science 2023-11-07 Rafael Pina , Corentin Artaud , Xiaolan Liu , Varuna De Silva

Robotic assembly presents a long-standing challenge due to its requirement for precise, contact-rich manipulation. While simulation-based learning has enabled the development of robust assembly policies, their performance often degrades…

Robotics · Computer Science 2026-02-27 Yijie Guo , Iretiayo Akinola , Lars Johannsmeier , Hugo Hadfield , Abhishek Gupta , Yashraj Narang

Reinforcement learning (RL) offers a principled way to enhance the reasoning capabilities of large language models, yet its effectiveness hinges on training signals that remain informative as models evolve. In practice, RL progress often…

Artificial Intelligence · Computer Science 2026-05-05 Caijun Xu , Changyi Xiao , Zhongyuan Peng , Xinrun Wang , Yixin Cao

In many real-world reinforcement learning (RL) problems, the environment exhibits inherent symmetries that can be exploited to improve learning efficiency. This paper develops a theoretical and algorithmic framework for incorporating known…

Machine Learning · Computer Science 2026-04-29 Alexandru Cioba , Aya Kayal , Laura Toni , Sattar Vakili , Alberto Bernacchia

Rheology plays a pivotal role in understanding the flow behavior of fluids by discovering governing equations that relate deformation and stress, known as constitutive equations. Despite the importance of these equations, current methods…

Soft Condensed Matter · Physics 2024-12-06 Takeshi Sato , Souta Miyamoto , Shota Kato

Sparse reward environments in reinforcement learning (RL) pose significant challenges for exploration, often leading to inefficient or incomplete learning processes. To tackle this issue, this work proposes a teacher-student RL framework…

Artificial Intelligence · Computer Science 2024-10-14 Unai Ruiz-Gonzalez , Alain Andres , Pedro G. Bascoy , Javier Del Ser