English
Related papers

Related papers: Learning Robot Safety from Sparse Human Feedback u…

200 papers

Learning robot objective functions from human input has become increasingly important, but state-of-the-art techniques assume that the human's desired objective lies within the robot's hypothesis space. When this is not true, even methods…

Machine Learning · Computer Science 2018-10-29 Andreea Bobu , Andrea Bajcsy , Jaime F. Fisac , Anca D. Dragan

Reinforcement Learning (RL) algorithms show amazing performance in recent years, but placing RL in real-world applications such as self-driven vehicles may suffer safety problems. A self-driven vehicle moving to a target position following…

Systems and Control · Electrical Eng. & Systems 2022-07-05 Huanhui Cao , Zhiyuan Cai , Hairuo Wei , Wenjie Lu , Lin Zhang , Hao Xiong

Human-robot co-carrying tasks reveal their potential in both industrial and everyday applications by leveraging the strengths of both parties. Effective control of robots in these tasks requires managing the energy level in the closed-loop…

Robotics · Computer Science 2025-11-18 Dang Van Trong , Hiroki Kotake , Sumitaka Honji , Takahiro Wada

The last half-decade has seen a steep rise in the number of contributions on safe learning methods for real-world robotic deployments from both the control and reinforcement learning communities. This article provides a concise but holistic…

Robust planning in interactive scenarios requires predicting the uncertain future to make risk-aware decisions. Unfortunately, due to long-tail safety-critical events, the risk is often under-estimated by finite-sampling approximations of…

Machine Learning · Computer Science 2023-01-13 Haruki Nishimura , Jean Mercat , Blake Wulfe , Rowan McAllister , Adrien Gaidon

Safety is a core challenge of autonomous robot motion planning, especially in the presence of dynamic and uncertain obstacles. Many recent results use learning and deep learning-based motion planners and prediction modules to predict…

Robotics · Computer Science 2023-09-19 Sleiman Safaoui , Tyler H. Summers

In this paper, we investigate the synthesis of piecewise affine feedback controllers to address the problem of safe and robust controller design in robotics based on high-level controls specifications. The methodology is based on…

Robotics · Computer Science 2016-10-10 Marijan Vukosavljev , Ivo Jansen , Mireille E. Broucke , Angela P. Schoellig

Typically, machine learning models are trained and evaluated without making any distinction between users (e.g, using traditional hold-out and cross-validation). However, this produces inaccurate performance metrics estimates in multi-user…

Machine Learning · Computer Science 2023-12-11 Enrique Garcia-Ceja , Luciano Garcia-Banuelos , Nicolas Jourdan

Safety concerns during the operation of legged robots must be addressed to enable their widespread use. Machine learning-based control methods that use model-based constraints provide promising means to improve robot safety. This study…

Robotics · Computer Science 2023-03-07 Berk Tosun , Evren Samur

Recent research has examined the possibility of using robots to guide evacuees to safe exits during emergencies. Yet, there are many factors that can impact a person's decision to follow a robot. Being able to model how an evacuee follows…

Robotics · Computer Science 2023-07-03 Mollik Nayyar , Ghanghoon Paik , Zhenyuan Yuan , Tongjia Zheng , Minghui Zhu , Hai Lin , Alan R. Wagner

Autonomous robots that are capable of operating safely in the presence of imperfect model knowledge or external disturbances are vital in safety-critical applications. In this paper, we present a planner-agnostic framework to design and…

Systems and Control · Electrical Eng. & Systems 2020-05-26 Arun Lakshmanan , Aditya Gahlawat , Naira Hovakimyan

We address the problem of safely learning controlled stochastic dynamics from discrete-time trajectory observations, ensuring system trajectories remain within predefined safe regions during both training and deployment. Safety-critical…

Machine Learning · Statistics 2026-02-03 Luc Brogat-Motte , Alessandro Rudi , Riccardo Bonalli

Learning from demonstration is widely used for robot navigation, yet it suffers from a fundamental limitation: demonstrations consist predominantly of successful behaviors and provide limited coverage of unsafe states. This limitation leads…

Robotics · Computer Science 2026-04-28 Xianghui Wang , Siwei Cheng , Shanze Wang , Xinming Zhang , Dan Zhang , Wei Zhang

Uncertainty-aware prediction is essential for safe motion planning, especially when using learned models to forecast the behavior of surrounding agents. Conformal prediction is a statistical tool often used to produce uncertainty-aware…

Systems and Control · Electrical Eng. & Systems 2025-11-19 Allen Emmanuel Binny , Anushri Dixit

Designing hierarchical reinforcement learning algorithms that exhibit safe behaviour is not only vital for practical applications but also, facilitates a better understanding of an agent's decisions. We tackle this problem in the options…

Artificial Intelligence · Computer Science 2021-07-01 Arushi Jain , Khimya Khetarpal , Doina Precup

Moving in dynamic pedestrian environments is one of the important requirements for autonomous mobile robots. We present a model-based reinforcement learning approach for robots to navigate through crowded environments. The navigation policy…

Robotics · Computer Science 2020-11-10 Yuxiang Cui , Haodong Zhang , Yue Wang , Rong Xiong

The paradigm of robot-assisted surgery is shifting toward data-driven autonomy, where policies learned via Reinforcement Learning (RL) or Imitation Learning (IL) enable the execution of complex tasks. However, these ``black-box" policies…

Robotics · Computer Science 2026-03-10 Jianshu Hu , ZhiYuan Guan , Lei Song , Kantaphat Leelakunwet , Hesheng Wang , Wei Xiao , Qi Dou , Yutong Ban

During learning trials, systems are exposed to different failure conditions which may break robotic parts before a safe behavior is discovered. Humans contour this problem by grounding their learning to a safer structure/control first and…

Robotics · Computer Science 2021-04-06 Keyan Zhai , Chu'an Li , Andre Rosendo

In order to collaborate safely and efficiently, robots need to anticipate how their human partners will behave. Some of today's robots model humans as if they were also robots, and assume users are always optimal. Other robots account for…

Robotics · Computer Science 2020-01-14 Minae Kwon , Erdem Biyik , Aditi Talati , Karan Bhasin , Dylan P. Losey , Dorsa Sadigh

Autonomous systems like aircraft and assistive robots often operate in scenarios where guaranteeing safety is critical. Methods like Hamilton-Jacobi reachability can provide guaranteed safe sets and controllers for such systems. However,…