English
Related papers

Related papers: Control Synthesis with Reinforcement Learning: A M…

200 papers

Sim-to-real transfer for contact-rich manipulation remains challenging due to the inherent discrepancy in contact dynamics. While existing methods often rely on costly real-world data or utilize blind compliance through fixed controllers,…

Robotics · Computer Science 2026-02-17 Yifei Yang , Anzhe Chen , Zhenjie Zhu , Kechun Xu , Yunxuan Mao , Yufei Wei , Lu Chen , Rong Xiong , Yue Wang

Function approximation has been an indispensable component in modern reinforcement learning algorithms designed to tackle problems with large state spaces in high dimensions. This paper reviews recent results on error analysis for these…

Machine Learning · Computer Science 2024-02-27 Jihao Long , Jiequn Han

This survey (re)introduces reinforcement learning methods to economists. The curse of dimensionality limits how far exact dynamic programming can be effectively applied, forcing us to rely on suitably "small" problems or our ability to…

General Economics · Economics 2026-03-25 Pranjal Rawat

Traditional control methods are inadequate in many deployment settings involving control of Cyber-Physical Systems (CPS). In such settings, CPS controllers must operate and respond to unpredictable interactions, conditions, or failure…

Machine Learning · Computer Science 2019-09-17 William Koch

LLMs have shown strong in-context learning (ICL) abilities, but have not yet been extended to signal processing systems. Inspired by their design, we have proposed for the first time ICL using transformer models applicable to motor…

Machine Learning · Computer Science 2026-02-10 Tong Jian , Tianyu Dai , Tao Yu

Animals and robots exist in a physical world and must coordinate their bodies to achieve behavioral objectives. With recent developments in deep reinforcement learning, it is now possible for scientists and engineers to obtain sensorimotor…

Robotics · Computer Science 2024-05-21 Yusheng Jiao , Feng Ling , Sina Heydari , Nicolas Heess , Josh Merel , Eva Kanso

Learning-based control methods typically assume stationary system dynamics, an assumption often violated in real-world systems due to drift, wear, or changing operating conditions. We study reinforcement learning for control under…

Machine Learning · Computer Science 2026-04-03 Klemens Iten , Bruce Lee , Chenhao Li , Lenart Treven , Andreas Krause , Bhavya Sukhija

The requirements for real-world manipulation tasks are diverse and often conflicting; some tasks require precise motion while others require force compliance; some tasks require avoidance of certain regions, while others require convergence…

Robotics · Computer Science 2024-12-13 Tianhao Wei , Liqian Ma , Rui Chen , Weiye Zhao , Changliu Liu

Deep reinforcement learning enables algorithms to learn complex behavior, deal with continuous action spaces and find good strategies in environments with high dimensional state spaces. With deep reinforcement learning being an active area…

Machine Learning · Computer Science 2018-10-17 Winfried Lötzsch

Robots have to face challenging perceptual settings, including changes in viewpoint, lighting, and background. Current simulated reinforcement learning (RL) benchmarks such as DM Control provide visual input without such complexity, which…

Robotics · Computer Science 2021-01-11 Austin Stone , Oscar Ramirez , Kurt Konolige , Rico Jonschkowski

We propose a two-component data-driven controller to safely perform docking maneuvers for satellites. Reinforcement Learning is used to deduce an optimal control policy based on measurement data. To safeguard the learning phase, an…

Optimization and Control · Mathematics 2024-07-30 Simon Gottschalk , Lukas Lanza , Karl Worthmann , Kerstin Lux-Gottschalk

Learned representations of dynamical systems reduce dimensionality, potentially supporting downstream reinforcement learning (RL). However, no established methods predict a representation's suitability for control and evaluation is largely…

Machine Learning · Computer Science 2020-11-25 Kevin Haninger , Raul Vicente Garcia , Joerg Krueger

Machine learning (especially reinforcement learning) methods for trading are increasingly reliant on simulation for agent training and testing. Furthermore, simulation is important for validation of hand-coded trading strategies and for…

Trading and Market Microstructure · Quantitative Finance 2019-12-12 Svitlana Vyetrenko , David Byrd , Nick Petosa , Mahmoud Mahfouz , Danial Dervovic , Manuela Veloso , Tucker Hybinette Balch

In the era of Industry 4.0 and smart manufacturing, process systems engineering must adapt to digital transformation. While reinforcement learning offers a model-free approach to process control, its applications are limited by the…

Systems and Control · Electrical Eng. & Systems 2025-05-28 Runze Lin , Junghui Chen , Biao Huang , Lei Xie , Hongye Su

Practitioners often rely on compute-intensive domain randomization to ensure reinforcement learning policies trained in simulation can robustly transfer to the real world. Due to unmodeled nonlinearities in the real system, however, even…

Machine Learning · Computer Science 2020-02-27 Gabriel I. Fernandez , Colin Togashi , Dennis W. Hong , Lin F. Yang

A data-efficient learning-based control design method is proposed in this paper. It is based on learning a system dynamics model that is then leveraged in a two-level procedure. On the higher level, a simple but powerful optimization…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Ludvig Svedlund , Constantin Cronrath , Jonas Fredriksson , Bengt Lennartson

Model-free reinforcement learning based methods such as Proximal Policy Optimization, or Q-learning typically require thousands of interactions with the environment to approximate the optimum controller which may not always be feasible in…

Machine Learning · Computer Science 2019-05-16 Narendra Patwardhan , Zequn Wang

Adoption of machine learning (ML)-enabled cyber-physical systems (CPS) are becoming prevalent in various sectors of modern society such as transportation, industrial, and power grids. Recent studies in deep reinforcement learning (DRL) have…

Machine Learning · Computer Science 2020-07-15 Kai Liang Tan , Yasaman Esfandiari , Xian Yeow Lee , Aakanksha , Soumik Sarkar

Human locomotion emerges from high-dimensional neuromuscular control, making predictive musculoskeletal simulation challenging. We present a physiology-informed reinforcement-learning framework that constrains control using muscle…

Machine Learning · Computer Science 2026-05-29 Ilseung Park , Eunsik Choi , Jangwhan Ahn , Jooeun Ahn

The interest in using reinforcement learning (RL) controllers in safety-critical applications such as robot navigation around pedestrians motivates the development of additional safety mechanisms. Running RL-enabled systems among uncertain…

Robotics · Computer Science 2023-12-08 Kegan J. Strawn , Nora Ayanian , Lars Lindemann