中文
相关论文

相关论文: Progressive Safeguards for Safe and Model-Agnostic…

200 篇论文

Providing Reinforcement Learning agents with expert advice can dramatically improve various aspects of learning. Prior work has developed teaching protocols that enable agents to learn efficiently in complex environments; many of these…

机器学习 · 计算机科学 2017-01-17 David Abel , John Salvatier , Andreas Stuhlmüller , Owain Evans

The increasing adoption of Reinforcement Learning in safety-critical systems domains such as autonomous vehicles, health, and aviation raises the need for ensuring their safety. Existing safety mechanisms such as adversarial training,…

机器学习 · 计算机科学 2021-11-11 Paulina Stevia Nouwou Mindom , Amin Nikanjam , Foutse Khomh , John Mullins

End-to-end models for autonomous driving hold the promise of learning complex behaviors directly from sensor data, but face critical challenges in safety and handling long-tail events. Reinforcement Learning (RL) offers a promising path to…

The emergence of Large Reasoning Models (LRMs) introduces a new paradigm of explicit reasoning, enabling remarkable advances yet posing unique risks such as reasoning manipulation and information leakage. To mitigate these risks, current…

人工智能 · 计算机科学 2026-02-03 Jingnan Zheng , Jingjun Xu , Yanzhen Luo , Chenhang Cui , Gelei Deng , Zhenkai Liang , Xiang Wang , An Zhang , Tat-Seng Chua

While safe reinforcement learning (RL) holds great promise for many practical applications like robotics or autonomous cars, current approaches require specifying constraints in mathematical form. Such specifications demand domain…

计算与语言 · 计算机科学 2021-08-05 Tsung-Yen Yang , Michael Hu , Yinlam Chow , Peter J. Ramadge , Karthik Narasimhan

Training a model-free reinforcement learning agent requires allowing the agent to sufficiently explore the environment to search for an optimal policy. In safety-constrained environments, utilizing unsupervised exploration or a non-optimal…

人工智能 · 计算机科学 2024-08-05 Erfan Entezami , Mahsa Sahebdel , Dhawal Gupta

The last half-decade has seen a steep rise in the number of contributions on safe learning methods for real-world robotic deployments from both the control and reinforcement learning communities. This article provides a concise but holistic…

机器人学 · 计算机科学 2021-12-08 Lukas Brunke , Melissa Greeff , Adam W. Hall , Zhaocong Yuan , Siqi Zhou , Jacopo Panerati , Angela P. Schoellig

Model-based reinforcement learning (RL) has emerged as a promising tool for developing controllers for real world systems (e.g., robotics, autonomous driving, etc.). However, real systems often have constraints imposed on their state space…

机器学习 · 计算机科学 2020-10-22 Akshita Gupta , Inseok Hwang

Reinforcement Learning (RL) is essentially a trial-and-error learning procedure which may cause unsafe behavior during the exploration-and-exploitation process. This hinders the application of RL to real-world control problems, especially…

机器学习 · 计算机科学 2021-05-03 Yutong Li , Nan Li , H. Eric Tseng , Anouck Girard , Dimitar Filev , Ilya Kolmanovsky

Merely pursuing performance may adversely affect the safety, while a conservative policy for safe exploration will degrade the performance. How to balance the safety and performance in learning-based control problems is an interesting yet…

系统与控制 · 电气工程与系统科学 2025-01-28 Xinyang Wang , Hongwei Zhang , Shimin Wang , Wei Xiao , Martin Guay

Deploying deep reinforcement learning in safety-critical settings requires developing algorithms that obey hard constraints during exploration. This paper contributes a first approach toward enforcing formal safety constraints on end-to-end…

人工智能 · 计算机科学 2020-07-03 Nathan Hunt , Nathan Fulton , Sara Magliacane , Nghia Hoang , Subhro Das , Armando Solar-Lezama

Meta-reinforcement learning has widely been used as a learning-to-learn framework to solve unseen tasks with limited experience. However, the aspect of constraint violations has not been adequately addressed in the existing works, making…

机器学习 · 计算机科学 2024-05-28 Vanshaj Khattar , Yuhao Ding , Bilgehan Sel , Javad Lavaei , Ming Jin

Learning-based quadruped controllers achieve impressive agility but typically lack formal safety guarantees under model uncertainty, perception noise, and unstructured contact conditions. We introduce SafeMind, a differentiable stochastic…

机器人学 · 计算机科学 2026-04-13 Zukun Zhang , Kai Shu , Mingqiao Mo

Meta-Reinforcement Learning (Meta-RL) aims to acquire meta-knowledge for quick adaptation to diverse tasks. However, applying these policies in real-world environments presents a significant challenge in balancing rapid adaptability with…

机器学习 · 计算机科学 2024-06-21 Karam Daaboul , Florian Kuhm , Tim Joseph , J. Marius Zoellner

The objective of this research is to enable safety-critical systems to simultaneously learn and execute optimal control policies in a safe manner to achieve complex autonomy. Learning optimal policies via trial and error, i.e., traditional…

系统与控制 · 电气工程与系统科学 2022-04-05 S M Nahid Mahmud , Moad Abudia , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

This paper studies the constrained/safe reinforcement learning (RL) problem with sparse indicator signals for constraint violations. We propose a model-based approach to enable RL agents to effectively explore the environment with unknown…

人工智能 · 计算机科学 2021-03-09 Zuxin Liu , Hongyi Zhou , Baiming Chen , Sicheng Zhong , Martial Hebert , Ding Zhao

Safety is one of the main challenges in applying reinforcement learning to realistic environmental tasks. To ensure safety during and after training process, existing methods tend to adopt overly conservative policy to avoid unsafe…

机器学习 · 计算机科学 2023-06-27 Xiao Zhang , Hai Zhang , Hongtu Zhou , Chang Huang , Di Zhang , Chen Ye , Junqiao Zhao

Meta reinforcement learning (RL) allows agents to leverage experience across a distribution of tasks on which the agent can train at will, enabling faster learning of optimal policies on new test tasks. Despite its success in improving…

机器学习 · 计算机科学 2026-05-27 Tingting Ni , Maryam Kamgarpour

Obtaining safety guarantees for reinforcement learning is a major challenge to achieve applicability for real-world tasks. Safety shields extend standard reinforcement learning and achieve hard safety guarantees. However, existing safety…

机器学习 · 计算机科学 2025-11-27 Jin Pin , Krasowski Hanna , Vanneaux Elena

Designing control policies for legged locomotion is complex due to the under-actuated and non-continuous robot dynamics. Model-free reinforcement learning provides promising tools to tackle this challenge. However, a major bottleneck of…

机器人学 · 计算机科学 2022-03-08 Tsung-Yen Yang , Tingnan Zhang , Linda Luu , Sehoon Ha , Jie Tan , Wenhao Yu