中文
相关论文

相关论文: Meta SAC-Lag: Towards Deployable Safe Reinforcemen…

200 篇论文

Generalizability and stability are two key objectives for operating reinforcement learning (RL) agents in the real world. Designing RL algorithms that optimize these objectives can be a costly and painstaking process. This paper presents…

Reinforcement Learning (RL) has shown promise in control tasks but faces significant challenges in real-world applications, primarily due to the absence of safety guarantees during the learning process. Existing methods often struggle with…

机器学习 · 计算机科学 2025-04-29 Donghe Chen , Han Wang , Lin Cheng , Shengping Gong

During initial iterations of training in most Reinforcement Learning (RL) algorithms, agents perform a significant number of random exploratory steps. In the real world, this can limit the practicality of these algorithms as it can lead to…

机器学习 · 计算机科学 2022-10-17 Ashish Kumar Jayant , Shalabh Bhatnagar

Safe reinforcement learning (RL) seeks to mitigate unsafe behaviors that arise from exploration during training by reducing constraint violations while maintaining task performance. Existing approaches typically rely on a single policy to…

机器人学 · 计算机科学 2026-05-12 Murad Dawood , Usama Ahmed Siddiquie , Shahram Khorshidi , Maren Bennewitz

Reinforcement learning (RL) offers a compelling data-driven paradigm for synthesizing controllers for complex systems when accurate physical models are unavailable; however, most existing control-oriented RL methods assume stationarity and,…

机器学习 · 计算机科学 2026-04-22 Austin Coursey , Abel Diaz-Gonzalez , Marcos Quinones-Grueiro , Gautam Biswas

In-context reinforcement learning (ICRL) is an emerging RL paradigm where an agent, after pretraining, can adapt to out-of-distribution test tasks without any parameter updates, instead relying on an expanding context of interaction…

机器学习 · 计算机科学 2026-05-28 Amir Moeini , Minjae Kwon , Alper Kamil Bozkurt , Yuichi Motai , Rohan Chandra , Lu Feng , Shangtong Zhang

Modern meta-reinforcement learning (Meta-RL) methods are mainly developed based on model-agnostic meta-learning, which performs policy gradient steps across tasks to maximize policy performance. However, the gradient conflict problem is…

人工智能 · 计算机科学 2022-09-22 Haozhi Wang , Qing Wang , Yunfeng Shao , Dong Li , Jianye Hao , Yinchuan Li

We consider the safe reinforcement learning (RL) problem of maximizing utility with extremely low constraint violation rates. Assuming no prior knowledge or pre-training of the environment safety model given a task, an agent has to learn,…

机器学习 · 计算机科学 2022-10-12 Haonan Yu , Wei Xu , Haichao Zhang

With the development of large language models (LLMs), striking a balance between the performance and safety of AI systems has never been more critical. However, the inherent tension between the objectives of helpfulness and harmlessness…

人工智能 · 计算机科学 2023-10-20 Josef Dai , Xuehai Pan , Ruiyang Sun , Jiaming Ji , Xinbo Xu , Mickel Liu , Yizhou Wang , Yaodong Yang

Meta reinforcement learning (Meta-RL) is an approach wherein the experience gained from solving a variety of tasks is distilled into a meta-policy. The meta-policy, when adapted over only a small (or just a single) number of steps, is able…

机器学习 · 计算机科学 2022-09-28 Desik Rengarajan , Sapana Chaudhary , Jaewon Kim , Dileep Kalathil , Srinivas Shakkottai

The performance of deep reinforcement learning methods prone to degenerate when applied to environments with non-stationary dynamics. In this paper, we utilize the latent context recurrent encoders motivated by recent Meta-RL materials, and…

机器学习 · 计算机科学 2021-05-11 Yuan Pu , Shaochen Wang , Xin Yao , Bin Li

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

机器学习 · 计算机科学 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Deploying Reinforcement Learning (RL) agents to solve real-world applications often requires satisfying complex system constraints. Often the constraint thresholds are incorrectly set due to the complex nature of a system or the inability…

机器学习 · 计算机科学 2020-11-30 Dan A. Calian , Daniel J. Mankowitz , Tom Zahavy , Zhongwen Xu , Junhyuk Oh , Nir Levine , Timothy Mann

Safe reinforcement learning (RL) has achieved significant success on risk-sensitive tasks and shown promise in autonomous driving (AD) as well. Considering the distinctiveness of this community, efficient and reproducible baselines are…

机器学习 · 计算机科学 2022-06-20 Linrui Zhang , Qin Zhang , Li Shen , Bo Yuan , Xueqian Wang

Intelligent agents should have the ability to leverage knowledge from previously learned tasks in order to learn new ones quickly and efficiently. Meta-learning approaches have emerged as a popular solution to achieve this. However,…

机器学习 · 计算机科学 2023-02-17 Zhao Mandi , Pieter Abbeel , Stephen James

Safe reinforcement learning (Safe RL) aims to ensure policy performance while satisfying safety constraints. However, most existing Safe RL methods assume benign environments, making them vulnerable to adversarial perturbations commonly…

机器学习 · 计算机科学 2026-02-19 Jialiang Fan , Shixiong Jiang , Mengyu Liu , Fanxin Kong

Reinforcement learning (RL) has demonstrated impressive performance in various areas such as video games and robotics. However, ensuring safety and stability, which are two critical properties from a control perspective, remains a…

系统与控制 · 电气工程与系统科学 2023-10-02 Liqun Zhao , Konstantinos Gatsis , Antonis Papachristodoulou

Ensuring safety in Reinforcement Learning (RL), typically framed as a Constrained Markov Decision Process (CMDP), is crucial for real-world exploration applications. Current approaches in handling CMDP struggle to balance optimality and…

机器人学 · 计算机科学 2024-03-07 Zhaorun Chen , Zhuokai Zhao , Tairan He , Binhao Chen , Xuhao Zhao , Liang Gong , Chengliang Liu

Reinforcement Learning (RL) has shown great potential in complex control tasks, particularly when combined with deep neural networks within the Actor-Critic (AC) framework. However, in practical applications, balancing exploration, learning…

机器人学 · 计算机科学 2026-02-25 Zhiwei Shang , Xinyi Yuan , Wenjun Huang , Yunduan Cui , Di Chen , Meixin Zhu

Deep reinforcement learning (RL) has been endowed with high expectations in tackling challenging manipulation tasks in an autonomous and self-directed fashion. Despite the significant strides made in the development of reinforcement…

机器人学 · 计算机科学 2023-04-27 Zhenshan Bing , Aleksandr Mavrichev , Sicong Shen , Xiangtong Yao , Kejia Chen , Kai Huang , Alois Knoll