English
Related papers

Related papers: Reinforcement Learning for Safe Robot Control usin…

200 papers

Safety and stability are common requirements for robotic control systems; however, designing safe, stable controllers remains difficult for nonlinear and uncertain models. We develop a model-based learning approach to synthesize robust…

Systems and Control · Electrical Eng. & Systems 2021-10-08 Charles Dawson , Zengyi Qin , Sicun Gao , Chuchu Fan

Reinforcement learning (RL) can improve control performance by seeking to learn optimal control policies in the end-use environment for vehicles and other systems. To accomplish this, RL algorithms need to sufficiently explore the state and…

Systems and Control · Electrical Eng. & Systems 2024-05-21 Habtamu Hailemichael , Beshah Ayalew , Andrej Ivanco

This paper proposes an on-policy reinforcement learning (RL) control algorithm that solves the optimal regulation problem for a class of uncertain continuous-time nonlinear systems under user-defined state constraints. We formulate the safe…

Systems and Control · Electrical Eng. & Systems 2022-09-20 Soutrik Bandyopadhyay , Shubhendu Bhasin

Reinforcement learning is a powerful technique for developing new robot behaviors. However, typical lack of safety guarantees constitutes a hurdle for its practical application on real robots. To address this issue, safe reinforcement…

Machine Learning · Computer Science 2024-04-29 Maeva Guerrier , Hassan Fouad , Giovanni Beltrame

Reinforcement learning (RL) agents need to explore their environment to learn optimal behaviors and achieve maximum rewards. However, exploration can be risky when training RL directly on real systems, while simulation-based training…

Robotics · Computer Science 2024-10-10 Dvij Kalaria , Qin Lin , John M. Dolan

Model-free Deep Reinforcement Learning (DRL) controllers have demonstrated promising results on various challenging non-linear control tasks. While a model-free DRL algorithm can solve unknown dynamics and high-dimensional problems, it…

Robotics · Computer Science 2022-03-03 Zikang Xiong , Joe Eappen , Ahmed H. Qureshi , Suresh Jagannathan

Reinforcement Learning (RL) methods have been proven successful in solving manipulation tasks autonomously. However, RL is still not widely adopted on real robotic systems because working with real hardware entails additional challenges,…

Reinforcement Learning (RL) and its integration with deep learning have achieved impressive performance in various robotic control tasks, ranging from motion planning and navigation to end-to-end visual manipulation. However, stability is…

Robotics · Computer Science 2020-07-16 Minghao Han , Lixian Zhang , Jun Wang , Wei Pan

Recent methods using Reinforcement Learning (RL) have proven to be successful for training intelligent agents in unknown environments. However, RL has not been applied widely in real-world robotics scenarios. This is because current…

Systems and Control · Electrical Eng. & Systems 2024-03-20 Antonio Lopez , David Fridovich-Keil

In this paper we address the problem of control Lyapunov-barrier function (CLBF)-based safe stabilization for a class of nonlinear control-affine systems. A difficulty may arise for the case when a constraint has the relative degree larger…

Systems and Control · Electrical Eng. & Systems 2025-09-19 Haechan Pyon , Gyunghoon Park

Safe navigation in unknown and cluttered environments remains a challenging problem in robotics. Model Predictive Contour Control (MPCC) has shown promise for performant obstacle avoidance by enabling precise and agile trajectory tracking,…

Robotics · Computer Science 2025-07-22 Nicholas Mohammad , Nicola Bezzo

Control Lyapunov functions are traditionally used to design a controller which ensures convergence to a desired state, yet deriving these functions for nonlinear systems remains a complex challenge. This paper presents a novel,…

Robotics · Computer Science 2025-03-21 Luc McCutcheon , Bahman Gharesifard , Saber Fallah

Reinforcement learning (RL) has shown a promising performance in learning optimal policies for a variety of sequential decision-making tasks. However, in many real-world RL problems, besides optimizing the main objectives, the agent is…

Machine Learning · Computer Science 2021-07-30 Ashkan B. Jeddi , Nariman L. Dehghani , Abdollah Shafieezadeh

This paper presents a reinforcement learning-based neuroadaptive control framework for robotic manipulators operating under deferred constraints. The proposed approach improves traditional barrier Lyapunov functions by introducing a smooth…

Robotics · Computer Science 2025-03-20 Hamed Rahimi Nohooji , Abolfazl Zaraki , Holger Voos

In this paper we present the implementation of a Control Barrier Function (CBF) using a quadratic program (QP) formulation that provides obstacle avoidance for a robotic manipulator arm system. CBF is a control technique that has emerged…

Robotics · Computer Science 2022-11-22 Stephen McIlvanna , Nhat Nguyen Minh , Yuzhu Sun , Mien Van , Wasif Naeem

We propose a method for combining Harmonic Control Lyapunov-Barrier Functions (HCLBFs) derived from Signal Temporal Logic (STL) specifications with any given robot policy to turn an unsafe policy into a safe one with formal guarantees. The…

Robotics · Computer Science 2025-11-19 Marlow Fawn , Matthias Scheutz

Reinforcement learning (RL)-based driver assistance systems seek to improve fuel consumption via continual improvement of powertrain control actions considering experiential data from the field. However, the need to explore diverse…

Robotics · Computer Science 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

Learning from Demonstration (LfD) is a powerful method for enabling robots to perform novel tasks as it is often more tractable for a non-roboticist end-user to demonstrate the desired skill and for the robot to efficiently learn from the…

Robotics · Computer Science 2023-03-08 Yue Yang , Letian Chen , Matthew Gombolay

This paper introduces harmonic control Lyapunov barrier functions (harmonic CLBF) that aid in constrained control problems such as reach-avoid problems. Harmonic CLBFs exploit the maximum principle that harmonic functions satisfy to encode…

Optimization and Control · Mathematics 2024-03-27 Amartya Mukherjee , Ruikun Zhou , Haocheng Chang , Jun Liu

The lack of stability guarantee restricts the practical use of learning-based methods in core control problems in robotics. We develop new methods for learning neural control policies and neural Lyapunov critic functions in the model-free…

Robotics · Computer Science 2021-07-13 Ya-Chien Chang , Sicun Gao