English
Related papers

Related papers: Constraint-aware Policy for Compliant Manipulation

200 papers

Reinforcement learning (RL) agents need to explore their environments in order to learn optimal policies. In many environments and tasks, safety is of critical importance. The widespread use of simulators offers a number of advantages,…

Robotics · Computer Science 2024-03-01 Luka Kovač , Igor Farkaš

Using Reinforcement Learning (RL) in simulation to construct policies useful in real life is challenging. This is often attributed to the sequential decision making aspect: inaccuracies in simulation accumulate over multiple steps, hence…

Machine Learning · Computer Science 2017-06-09 Rika Antonova , Silvia Cruciani

Contact-rich manipulation plays an important role in daily human activities. However, uncertain physical parameters often pose significant challenges for both planning and control. A promising strategy is to develop policies that are robust…

Robotics · Computer Science 2025-05-29 Teng Xue , Amirreza Razmjoo , Suhan Shetty , Sylvain Calinon

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Human-AI shared control allows human to interact and collaborate with AI to accomplish control tasks in complex environments. Previous Reinforcement Learning (RL) methods attempt the goal-conditioned design to achieve human-controllable…

Robotics · Computer Science 2023-03-06 Quanyi Li , Zhenghao Peng , Haibin Wu , Lan Feng , Bolei Zhou

Modern lightweight dual-arm robots bring the physical capabilities to quickly take over tasks at typical industrial workplaces designed for workers. In times of mass-customization, low setup times including the instructing/specifying of new…

Robotics · Computer Science 2024-03-22 Jan Kristof Behrens , Ralph Lange , Masoumeh Mansouri

General-purpose robotic manipulation, including reach and grasp, is essential for deployment into households and workspaces involving diverse and evolving tasks. Recent advances propose using large pre-trained models, such as Large Language…

Robotics · Computer Science 2025-07-16 Huiyi Wang , Fahim Shahriar , Alireza Azimi , Gautham Vasan , Rupam Mahmood , Colin Bellinger

Robot manipulation is an important part of human-robot interaction technology. However, traditional pre-programmed methods can only accomplish simple and repetitive tasks. To enable effective communication between robots and humans, and to…

Robotics · Computer Science 2023-09-12 Haoxu Zhang , Parham M. Kebria , Shady Mohamed , Samson Yu , Saeid Nahavandi

We apply reinforcement learning (RL) to robotics tasks. One of the drawbacks of traditional RL algorithms has been their poor sample efficiency. One approach to improve the sample efficiency is model-based RL. In our model-based RL…

Machine Learning · Computer Science 2023-05-16 Adithya Ramesh , Balaraman Ravindran

Shifting from traditional control strategies to Deep Reinforcement Learning (RL) for legged robots poses inherent challenges, especially when addressing real-world physical constraints during training. While high-fidelity simulations…

Robotics · Computer Science 2023-09-28 Joonho Lee , Lukas Schroth , Victor Klemm , Marko Bjelonic , Alexander Reske , Marco Hutter

The ability to autonomously learn behaviors via direct interactions in uninstrumented environments can lead to generalist robots capable of enhancing productivity or providing care in unstructured settings like homes. Such uninstrumented…

Robotics · Computer Science 2021-11-15 Rutav Shah , Vikash Kumar

Reinforcement learning (RL) has achieved remarkable success in various robotic tasks; however, its deployment in real-world scenarios, particularly in contact-rich environments, often overlooks critical safety and stability aspects.…

Robotics · Computer Science 2025-06-13 Heng Zhang , Gokhan Solak , Sebastian Hjorth , Arash Ajoudani

Agile control of mobile manipulator is challenging because of the high complexity coupled by the robotic system and the unstructured working environment. Tracking and grasping a dynamic object with a random trajectory is even harder. In…

Robotics · Computer Science 2020-06-09 Cong Wang , Qifeng Zhang , Qiyan Tian , Shuo Li , Xiaohui Wang , David Lane , Yvan Petillot , Ziyang Hong , Sen Wang

Robotic collaborative carrying could greatly benefit human activities like warehouse and construction site management. However, coordinating the simultaneous motion of multiple robots represents a significant challenge. Existing works…

Robotics · Computer Science 2026-03-25 Francesca Bray , Simone Tolomei , Andrei Cramariuc , Cesar Cadena , Marco Hutter

Constrained Reinforcement Learning (CRL) is a subset of machine learning that introduces constraints into the traditional reinforcement learning (RL) framework. Unlike conventional RL which aims solely to maximize cumulative rewards, CRL…

Artificial Intelligence · Computer Science 2024-12-02 Xiaoshan Lin , Sadık Bera Yüksel , Yasin Yazıcıoğlu , Derya Aksaray

Although Reinforcement Learning (RL) algorithms have found tremendous success in simulated domains, they often cannot directly be applied to physical systems, especially in cases where there are hard constraints to satisfy (e.g. on safety…

Machine Learning · Computer Science 2020-08-28 Harsh Satija , Philip Amortila , Joelle Pineau

Control barrier functions have been demonstrated to be a useful method of ensuring constraint satisfaction for a wide class of controllers, however existing results are mostly restricted to continuous time systems of relative degree one.…

Robotics · Computer Science 2019-03-26 Wenceslao Shaw Cortez , Denny Oetomo , Chris Manzie , Peter Choong

This study introduces a novel approach to autonomous motion planning, informing an analytical algorithm with a reinforcement learning (RL) agent within a Frenet coordinate system. The combination directly addresses the challenges of…

Robotics · Computer Science 2024-07-31 Rainer Trauth , Alexander Hobmeier , Johannes Betz

Multi-task reinforcement learning (RL) aims to find a single policy that effectively solves multiple tasks at the same time. This paper presents a constrained formulation for multi-task RL where the goal is to maximize the average…

Optimization and Control · Mathematics 2024-05-07 Sihan Zeng , Thinh T. Doan , Justin Romberg

Reinforcement learning holds the promise of enabling autonomous robots to learn large repertoires of behavioral skills with minimal human intervention. However, robotic applications of reinforcement learning often compromise the autonomy of…

Robotics · Computer Science 2016-11-24 Shixiang Gu , Ethan Holly , Timothy Lillicrap , Sergey Levine