English
Related papers

Related papers: Probabilistically Safe Policy Transfer

200 papers

Safety in reinforcement learning (RL) is a key property in both training and execution in many domains such as autonomous driving or finance. In this paper, we formalize it with a constrained RL formulation in the distributional RL setting.…

Machine Learning · Computer Science 2021-03-01 Jianyi Zhang , Paul Weng

Large-scale self-supervised models have recently revolutionized our ability to perform a variety of tasks within the vision and language domains. However, using such models for autonomous systems is challenging because of safety…

Robotics · Computer Science 2023-03-09 Yue Meng , Sai Vemprala , Rogerio Bonatti , Chuchu Fan , Ashish Kapoor

As drones and autonomous cars become more widespread it is becoming increasingly important that robots can operate safely under realistic conditions. The noisy information fed into real systems means that robots must use estimates of the…

Robotics · Computer Science 2017-06-01 Brian Axelrod , Leslie Pack Kaelbling , Tomás Lozano-Pérez

Safety-critical applications require controllers/policies that can guarantee safety with high confidence. The control barrier function is a useful tool to guarantee safety if we have access to the ground-truth system dynamics. In practice,…

Machine Learning · Computer Science 2021-12-30 Athindran Ramesh Kumar , Sulin Liu , Jaime F. Fisac , Ryan P. Adams , Peter J. Ramadge

We address the problem of safely learning controlled stochastic dynamics from discrete-time trajectory observations, ensuring system trajectories remain within predefined safe regions during both training and deployment. Safety-critical…

Machine Learning · Statistics 2026-02-03 Luc Brogat-Motte , Alessandro Rudi , Riccardo Bonalli

Computer simulation provides an automatic and safe way for training robotic control policies to achieve complex tasks such as locomotion. However, a policy trained in simulation usually does not transfer directly to the real hardware due to…

Machine Learning · Computer Science 2018-12-05 Wenhao Yu , C. Karen Liu , Greg Turk

Reinforcement learning algorithms typically necessitate extensive exploration of the state space to find optimal policies. However, in safety-critical applications, the risks associated with such exploration can lead to catastrophic…

Machine Learning · Computer Science 2025-02-28 Kaustubh Mani , Vincent Mai , Charlie Gauthier , Annie Chen , Samer Nashed , Liam Paull

Unthinking execution of human instructions in robotic manipulation can lead to severe safety risks, such as poisonings, fires, and even explosions. In this paper, we present responsible robotic manipulation, which requires robots to…

Robotics · Computer Science 2025-06-03 Minheng Ni , Lei Zhang , Zihan Chen , Kaixin Bai , Zhaopeng Chen , Jianwei Zhang , Lei Zhang , Wangmeng Zuo

For the task with complicated manipulation in unstructured environments, traditional hand-coded methods are ineffective, while reinforcement learning can provide more general and useful policy. Although the reinforcement learning is able to…

Robotics · Computer Science 2025-12-03 Nan Lin , Linrui Zhang , Yuxuan Chen , Zhenrui Chen , Yujun Zhu , Ruoxi Chen , Peichen Wu , Xiaoping Chen

Optimizing the body and brain of a robot is a coupled challenge: the morphology determines what control strategies are effective, while the control parameters influence how well the morphology performs. This joint optimization can be done…

Robotics · Computer Science 2026-04-21 K. Ege de Bruin , Kyrre Glette , Kai Olav Ellefsen , Giorgia Nadizar , Eric Medvet

Safe reinforcement learning is a promising path toward applying reinforcement learning algorithms to real-world problems, where suboptimal behaviors may lead to actual negative consequences. In this work, we focus on the setting where…

Machine Learning · Computer Science 2022-02-17 Garrett Thomas , Yuping Luo , Tengyu Ma

The emerging integration of robots into everyday life brings several major challenges. Compared to classical industrial applications, more flexibility is needed in combination with real-time reactivity. Learning-based methods can train…

Robotics · Computer Science 2026-02-18 Thies Oelerich , Gerald Ebmer , Christian Hartl-Nesic , Andreas Kugi

Algorithmic recommendations and decisions have become ubiquitous in today's society. Many of these data-driven policies, especially in the realm of public policy, are based on known, deterministic rules to ensure their transparency and…

Machine Learning · Statistics 2025-04-02 Eli Ben-Michael , D. James Greiner , Kosuke Imai , Zhichao Jiang

Reinforcement learning is a powerful paradigm for learning optimal policies from experimental data. However, to find optimal policies, most reinforcement learning algorithms explore all possible actions, which may be harmful for real-world…

Machine Learning · Statistics 2017-11-15 Felix Berkenkamp , Matteo Turchetta , Angela P. Schoellig , Andreas Krause

The framework of Simulation-to-real learning, i.e, learning policies in simulation and transferring those policies to the real world is one of the most promising approaches towards data-efficient learning in robotics. However, due to the…

Robotics · Computer Science 2022-02-01 Rituraj Kaushik , Karol Arndt , Ville Kyrki

We consider the challenge of finding a deterministic policy for a Markov decision process that uniformly (in all states) maximizes one reward subject to a probabilistic constraint over a different reward. Existing solutions do not fully…

Machine Learning · Computer Science 2022-01-21 Jaeyoung Lee , Sean Sedwards , Krzysztof Czarnecki

We present an optimization-based method to plan the motion of an autonomous robot under the uncertainties associated with dynamic obstacles, such as humans. Our method bounds the marginal risk of collisions at each point in time by…

Robotics · Computer Science 2021-03-24 O. de Groot , B. Brito , L. Ferranti , D. Gavrila , J. Alonso-Mora

When learning policies for robotic systems from data, safety is a major concern, as violation of safety constraints may cause hardware damage. SafeOpt is an efficient Bayesian optimization (BO) algorithm that can learn policies while…

Robotics · Computer Science 2021-05-28 Dominik Baumann , Alonso Marco , Matteo Turchetta , Sebastian Trimpe

Learning from Demonstration is increasingly used for transferring operator manipulation skills to robots. In practice, it is important to cater for limited data and imperfect human demonstrations, as well as underlying safety constraints.…

Robotics · Computer Science 2020-04-03 Ya-Yen Tsai , Bo Xiao , Edward Johns , Guang-Zhong Yang

In this paper, we consider the problem of learning safe policies for probabilistic-constrained reinforcement learning (RL). Specifically, a safe policy or controller is one that, with high probability, maintains the trajectory of the agent…

Machine Learning · Computer Science 2024-03-14 Weiqin Chen , Dharmashankar Subramanian , Santiago Paternain