English
Related papers

Related papers: Residual Reinforcement Learning for Robot Control

200 papers

This paper introduces an efficient Residual Reinforcement Learning (RRL) framework for voltage control in active distribution grids. Voltage control remains a critical challenge in distribution grids, where conventional Reinforcement…

Systems and Control · Electrical Eng. & Systems 2025-12-30 Sarra Bouchkati , Ramil Sabirov , Steffen Kortmann , Andreas Ulbig

Deep learning has provided new ways of manipulating, processing and analyzing data. It sometimes may achieve results comparable to, or surpassing human expert performance, and has become a source of inspiration in the era of artificial…

Robots and autonomous agents often complete goal-based tasks with limited resources, relying on imperfect models and sensor measurements. In particular, reinforcement learning (RL) and feedback control can be used to help a robot achieve a…

Artificial Intelligence · Computer Science 2018-09-26 Aleksandra Faust , James B. Aimone , Conrad D. James , Lydia Tapia

Reinforcement learning (RL) is used to directly design a control policy using data collected from the system. This paper considers the robustness of controllers trained via model-free RL. The discussion focuses on the standard model-based…

Systems and Control · Computer Science 2019-04-09 Harish K. Venkataraman , Peter J. Seiler

Flexibility design problems are a class of problems that appear in strategic decision-making across industries, where the objective is to design a ($e.g.$, manufacturing) network that affords flexibility and adaptivity. The underlying…

Machine Learning · Computer Science 2021-01-19 Yehua Wei , Lei Zhang , Ruiyi Zhang , Shijing Si , Hao Zhang , Lawrence Carin

Many real-world control problems involve both discrete decision variables - such as the choice of control modes, gear switching or digital outputs - as well as continuous decision variables - such as velocity setpoints, control gains or…

We propose a simple, practical and intuitive approach to improve the performance of a conventional controller in uncertain environments using deep reinforcement learning while maintaining safe operation. Our approach is motivated by the…

Systems and Control · Electrical Eng. & Systems 2021-10-07 Tom Staessens , Tom Lefebvre , Guillaume Crevecoeur

We present a deep reinforcement learning (deep RL) algorithm that consists of learning-based motion planning and imitation to tackle challenging control problems. Deep RL has been an effective tool for solving many high-dimensional…

Robotics · Computer Science 2023-03-02 Nitish Sontakke , Sehoon Ha

Model-free reinforcement learning (RL) is inherently a reactive method, operating under the assumption that it starts with no prior knowledge of the system and entirely depends on trial-and-error for learning. This approach faces several…

Controlling contact forces during interactions is critical for locomotion and manipulation tasks. While sim-to-real reinforcement learning (RL) has succeeded in many contact-rich problems, current RL methods achieve forceful interactions…

Robotics · Computer Science 2024-05-21 Tifanny Portela , Gabriel B. Margolis , Yandong Ji , Pulkit Agrawal

Learning contact-rich manipulation skills is essential. Such skills require the robots to interact with the environment with feasible manipulation trajectories and suitable compliance control parameters to enable safe and stable contact.…

Robotics · Computer Science 2023-10-17 Xiang Zhang , Changhao Wang , Lingfeng Sun , Zheng Wu , Xinghao Zhu , Masayoshi Tomizuka

There is an increased demand for task automation in robots. Contact-rich tasks, wherein multiple contact transitions occur in a series of operations, are extensively being studied to realize high accuracy. In this study, we propose a…

Robotics · Computer Science 2020-02-28 Masahide Oikawa , Kyo Kutsuzawa , Sho Sakaino , Toshiaki Tsuji

Current end-to-end deep Reinforcement Learning (RL) approaches require jointly learning perception, decision-making and low-level control from very sparse reward signals and high-dimensional inputs, with little capability of incorporating…

Machine Learning · Computer Science 2019-10-10 Vibhavari Dasagi , Robert Lee , Serena Mou , Jake Bruce , Niko Sünderhauf , Jürgen Leitner

Model-free or learning-based control, in particular, reinforcement learning (RL), is expected to be applied for complex robotic tasks. Traditional RL requires a policy to be optimized is state-dependent, that means, the policy is a kind of…

Machine Learning · Computer Science 2022-08-09 Taisuke Kobayashi , Kenta Yoshizawa

Reinforcement Learning (RL) algorithms can in principle acquire complex robotic skills by learning from large amounts of data in the real world, collected via trial and error. However, most RL algorithms use a carefully engineered setup in…

Machine Learning · Computer Science 2021-04-23 Abhishek Gupta , Justin Yu , Tony Z. Zhao , Vikash Kumar , Aaron Rovinsky , Kelvin Xu , Thomas Devlin , Sergey Levine

While reinforcement learning has made great improvements, state-of-the-art algorithms can still struggle with seemingly simple set-point feedback control problems. One reason for this is that the learned controller may not be able to excite…

Systems and Control · Electrical Eng. & Systems 2023-04-21 Ruoqi Zhang , Per Mattsson , Torbjörn Wigren

Reinforcement learning is a powerful technique for developing new robot behaviors. However, typical lack of safety guarantees constitutes a hurdle for its practical application on real robots. To address this issue, safe reinforcement…

Machine Learning · Computer Science 2024-04-29 Maeva Guerrier , Hassan Fouad , Giovanni Beltrame

This work presents a distributed algorithm for resolving cooperative multi-vehicle conflicts in highly constrained spaces. By formulating the conflict resolution problem as a Multi-Agent Reinforcement Learning (RL) problem, we can train a…

Robotics · Computer Science 2023-02-06 Xu Shen , Francesco Borrelli

Reinforcement learning (RL) has become widely adopted in robot control. Despite many successes, one major persisting problem can be very low data efficiency. One solution is interactive feedback, which has been shown to speed up RL…

Robotics · Computer Science 2026-04-29 Daniel Harnack , Julie Pivin-Bachler , Nicolás Navarro-Guerrero

Safety-critical robot systems need thorough testing to expose design flaws and software bugs which could endanger humans. Testing in simulation is becoming increasingly popular, as it can be applied early in the development process and does…