English
Related papers

Related papers: Towards Safe Robot Foundation Models

200 papers

Offline Safe Reinforcement Learning (RL) seeks to address safety constraints by learning from static datasets and restricting exploration. However, these approaches heavily rely on the dataset and struggle to generalize to unseen scenarios…

Robotics · Computer Science 2025-03-04 Chenyang Cao , Yucheng Xin , Silang Wu , Longxiang He , Zichen Yan , Junbo Tan , Xueqian Wang

For the task with complicated manipulation in unstructured environments, traditional hand-coded methods are ineffective, while reinforcement learning can provide more general and useful policy. Although the reinforcement learning is able to…

Robotics · Computer Science 2025-12-03 Nan Lin , Linrui Zhang , Yuxuan Chen , Zhenrui Chen , Yujun Zhu , Ruoxi Chen , Peichen Wu , Xiaoping Chen

In order for autonomous mobile robots to navigate in human spaces, they must abide by our social norms. Reinforcement learning (RL) has emerged as an effective method to train sequential decision-making policies that are able to respect…

Robotics · Computer Science 2024-03-01 Adam Sigal , Hsiu-Chin Lin , AJung Moon

Robots are more capable of achieving manipulation tasks for everyday activities than before. But the safety of manipulation skills that robots employ is still an open problem. Considering all possible failures during skill learning…

Robotics · Computer Science 2023-05-05 Abdullah Cihan Ak , Eren Erdal Aksoy , Sanem Sariel

Reinforcement learning shows great potential to solve complex contact-rich robot manipulation tasks. However, the safety of using RL in the real world is a crucial problem, since unexpected dangerous collisions might happen when the RL…

Robotics · Computer Science 2025-05-27 Xiang Zhu , Shucheng Kang , Jianyu Chen

Shared autonomy provides an effective framework for human-robot collaboration that takes advantage of the complementary strengths of humans and robots to achieve common goals. Many existing approaches to shared autonomy make restrictive…

Robotics · Computer Science 2020-07-13 Charles Schaff , Matthew R. Walter

Reinforcement learning (RL) has demonstrated impressive performance in legged locomotion over various challenging environments. However, due to the sim-to-real gap and lack of explainability, unconstrained RL policies deployed in the real…

Robotics · Computer Science 2025-06-06 Haoyu Wang , Ruyi Zhou , Liang Ding , Tie Liu , Zhelin Zhang , Peng Xu , Haibo Gao , Zongquan Deng

Reinforcement learning often requires extensive training data. Simulation-to-real transfer offers a promising approach to address this challenge in robotics. While differentiable simulators offer improved sample efficiency through exact…

Robotics · Computer Science 2024-12-02 Severin Bochem , Eduardo Gonzalez-Sanchez , Yves Bicker , Gabriele Fadini

Safe reinforcement learning is a promising path toward applying reinforcement learning algorithms to real-world problems, where suboptimal behaviors may lead to actual negative consequences. In this work, we focus on the setting where…

Machine Learning · Computer Science 2022-02-17 Garrett Thomas , Yuping Luo , Tengyu Ma

Policy search reinforcement learning allows robots to acquire skills by themselves. However, the learning procedure is inherently unsafe as the robot has no a-priori way to predict the consequences of the exploratory actions it takes.…

Robotics · Computer Science 2018-10-09 Jens Lundell , Robert Krug , Erik Schaffernicht , Todor Stoyanov , Ville Kyrki

Teams of people coordinate to perform complex tasks by forming abstract mental models of world and agent dynamics. The use of abstract models contrasts with much recent work in robot learning that uses a high-fidelity simulator and…

Robotics · Computer Science 2025-03-10 Adam Labiosa , Josiah P. Hanna

In principle, reinforcement learning and policy search methods can enable robots to learn highly complex and general skills that may allow them to function amid the complexity and diversity of the real world. However, training a policy that…

Machine Learning · Computer Science 2019-05-29 Ali Yahya , Adrian Li , Mrinal Kalakrishnan , Yevgen Chebotar , Sergey Levine

Artificial intelligence (AI) systems possess significant potential to drive societal progress. However, their deployment often faces obstacles due to substantial safety concerns. Safe reinforcement learning (SafeRL) emerges as a solution to…

Artificial Intelligence · Computer Science 2024-10-08 Jiaming Ji , Borong Zhang , Jiayi Zhou , Xuehai Pan , Weidong Huang , Ruiyang Sun , Yiran Geng , Yifan Zhong , Juntao Dai , Yaodong Yang

Reinforcement Learning (RL) algorithms show amazing performance in recent years, but placing RL in real-world applications such as self-driven vehicles may suffer safety problems. A self-driven vehicle moving to a target position following…

Systems and Control · Electrical Eng. & Systems 2022-07-05 Huanhui Cao , Zhiyuan Cai , Hairuo Wei , Wenjie Lu , Lin Zhang , Hao Xiong

Learning a risk-aware policy is essential but rather challenging in unstructured robotic tasks. Safe reinforcement learning methods open up new possibilities to tackle this problem. However, the conservative policy updates make it…

Machine Learning · Computer Science 2022-12-15 Linrui Zhang , Zichen Yan , Li Shen , Shoujie Li , Xueqian Wang , Dacheng Tao

Policy optimization in high-dimensional continuous control for robotics remains a challenging problem. Predominant methods are inherently local and often require extensive tuning and carefully chosen initial guesses for good performance,…

Robotics · Computer Science 2026-05-01 Buqing Ou , Frederike Dümbgen

The deployment of Large Language Models (LLMs) in robotic systems presents unique safety challenges, particularly in unpredictable environments. Although LLMs, leveraging zero-shot learning, enhance human-robot interaction and…

Robotics · Computer Science 2025-03-07 Ahmad Hafez , Alireza Naderi Akhormeh , Amr Hegazy , Amr Alanwar

The framework of Simulation-to-real learning, i.e, learning policies in simulation and transferring those policies to the real world is one of the most promising approaches towards data-efficient learning in robotics. However, due to the…

Robotics · Computer Science 2022-02-01 Rituraj Kaushik , Karol Arndt , Ville Kyrki

Learned robot policies have consistently been shown to be versatile, but they typically have no built-in mechanism for handling the complexity of open environments, making them prone to execution failures; this implies that deploying…

Robotics · Computer Science 2025-11-18 Bharath Santhanam , Alex Mitrevski , Santosh Thoduka , Sebastian Houben , Teena Hassan

Simulations are attractive environments for training agents as they provide an abundant source of data and alleviate certain safety concerns during the training process. But the behaviours developed by agents in simulation are often…

Robotics · Computer Science 2018-09-21 Xue Bin Peng , Marcin Andrychowicz , Wojciech Zaremba , Pieter Abbeel