中文
相关论文

相关论文: Statistical Guarantees for Lifelong Reinforcement …

200 篇论文

In lifelong learning, an agent learns throughout its entire life without resets, in a constantly changing environment, as we humans do. Consequently, lifelong learning comes with a plethora of research problems such as continual domain…

We present an algorithm for local, regularized, policy improvement in reinforcement learning (RL) that allows us to formulate model-based and model-free variants in a single framework. Our algorithm can be interpreted as a natural extension…

Deep reinforcement learning (RL) algorithms can learn complex policies to optimize agent operation over time. RL algorithms have shown promising results in solving complicated problems in recent years. However, their application on…

机器学习 · 计算机科学 2021-09-29 Hamed Khorasgani , Haiyan Wang , Chetan Gupta , Susumu Serita

This paper presents the concept of an adaptive safe padding that forces Reinforcement Learning (RL) to synthesise optimal control policies while ensuring safety during the learning process. Policies are synthesised to satisfy a goal,…

机器学习 · 计算机科学 2020-03-24 Mohammadhosein Hasanbeig , Alessandro Abate , Daniel Kroening

Offline Reinforcement Learning (RL) is a promising approach for learning optimal policies in environments where direct exploration is expensive or unfeasible. However, the adoption of such policies in practice is often challenging, as they…

机器学习 · 计算机科学 2020-11-03 Aaron Sonabend-W , Junwei Lu , Leo A. Celi , Tianxi Cai , Peter Szolovits

The ability to autonomously explore and resolve tasks with minimal human guidance is crucial for the self-development of embodied intelligence. Although reinforcement learning methods can largely ease human effort, it's challenging to…

机器人学 · 计算机科学 2024-12-19 Changxin Huang , Yanbin Chang , Junfan Lin , Junyang Liang , Runhao Zeng , Jianqiang Li

While reinforcement learning (RL) algorithms are achieving state-of-the-art performance in various challenging tasks, they can easily encounter catastrophic forgetting or interference when faced with lifelong streaming information. In the…

机器学习 · 计算机科学 2022-05-24 Zhi Wang , Chunlin Chen , Daoyi Dong

Randomized experiments (a.k.a. A/B tests) are a powerful tool for estimating treatment effects, to inform decisions making in business, healthcare and other applications. In many problems, the treatment has a lasting effect that evolves…

机器学习 · 计算机科学 2022-10-17 Ziyang Tang , Yiheng Duan , Stephanie Zhang , Lihong Li

Reinforcement learning (RL) is a framework to optimize a control policy using rewards that are revealed by the system as a response to a control action. In its standard form, RL involves a single agent that uses its policy to accomplish a…

系统与控制 · 电气工程与系统科学 2021-11-24 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

Classical reinforcement learning (RL) techniques are generally concerned with the design of decision-making policies driven by the maximisation of the expected outcome. Nevertheless, this approach does not take into consideration the…

机器学习 · 计算机科学 2023-01-02 Thibaut Théate , Damien Ernst

A lifelong reinforcement learning system is a learning system that has the ability to learn through trail-and-error interaction with the environment over its lifetime. In this paper, I give some arguments to show that the traditional…

机器学习 · 计算机科学 2020-01-28 Changjian Li

Continual Reinforcement Learning (CRL) aims to develop lifelong learning agents to continuously acquire knowledge across diverse tasks while mitigating catastrophic forgetting. This requires efficiently managing the stability-plasticity…

机器学习 · 计算机科学 2026-02-02 Yuxuan Li , Qijun He , Mingqi Yuan , Wen-Tse Chen , Jeff Schneider , Jiayu Chen

Deep Reinforcement Learning (Deep RL) and Evolutionary Algorithms (EA) are two major paradigms of policy optimization with distinct learning principles, i.e., gradient-based v.s. gradient-free. An appealing research direction is integrating…

神经与进化计算 · 计算机科学 2023-07-03 Jianye Hao , Pengyi Li , Hongyao Tang , Yan Zheng , Xian Fu , Zhaopeng Meng

In this article, we aim to provide a literature review of different formulations and approaches to continual reinforcement learning (RL), also known as lifelong or non-stationary RL. We begin by discussing our perspective on why RL is a…

机器学习 · 计算机科学 2022-11-15 Khimya Khetarpal , Matthew Riemer , Irina Rish , Doina Precup

Reinforcement Learning (RL) has proven a stunning ability to learn optimal policies from data without any prior knowledge on the process. The main drawback of RL is that it is typically very difficult to guarantee stability and safety. On…

系统与控制 · 电气工程与系统科学 2020-05-12 Mario Zanon , Vyacheslav Kungurtsev , Sébastien Gros

Reinforcement Learning (RL) has emerged as an efficient method of choice for solving complex sequential decision making problems in automatic control, computer science, economics, and biology. In this paper we present a model-free RL…

计算机科学中的逻辑 · 计算机科学 2019-09-13 Mohammadhosein Hasanbeig , Yiannis Kantaros , Alessandro Abate , Daniel Kroening , George J. Pappas , Insup Lee

This paper addresses the problem of learning optimal control policies for systems with uncertain dynamics and high-level control objectives specified as Linear Temporal Logic (LTL) formulas. Uncertainty is considered in the workspace…

机器人学 · 计算机科学 2024-10-17 Yiannis Kantaros , Jun Wang

Reinforcement learning (RL) enables an agent interacting with an unknown MDP $M$ to optimise its behaviour by observing transitions sampled from $M$. A natural entity that emerges in the agent's reasoning is $\widehat{M}$, the maximum…

机器学习 · 计算机科学 2025-02-24 Shivaram Kalyanakrishnan , Sheel Shah , Santhosh Kumar Guguloth

Real-world reinforcement learning (RL) problems often demand that agents behave safely by obeying a set of designed constraints. We address the challenge of safe RL by coupling a safety guide based on model predictive control (MPC) with a…

机器学习 · 计算机科学 2022-03-30 Samuel Pfrommer , Tanmay Gautam , Alec Zhou , Somayeh Sojoudi

We establish a new connection between value and policy based reinforcement learning (RL) based on a relationship between softmax temporal value consistency and policy optimality under entropy regularization. Specifically, we show that…

人工智能 · 计算机科学 2017-11-27 Ofir Nachum , Mohammad Norouzi , Kelvin Xu , Dale Schuurmans