English
Related papers

Related papers: A Continual Offline Reinforcement Learning Benchma…

200 papers

We are interested in the design of autonomous robot behaviors that learn the preferences of users over continued interactions, with the goal of efficiently executing navigation behaviors in a way that the user expects. In this paper, we…

Robotics · Computer Science 2020-11-06 Cory Hayes , Matthew Marge

Reinforcement Learning is an area of Machine Learning focused on how agents can be trained to make sequential decisions, and achieve a particular goal within an arbitrary environment. While learning, they repeatedly take actions based on…

Continual learning (CL) is a particular machine learning paradigm where the data distribution and learning objective changes through time, or where all the training data and objective criteria are never available at once. The evolution of…

Machine Learning · Computer Science 2019-11-25 Timothée Lesort , Vincenzo Lomonaco , Andrei Stoian , Davide Maltoni , David Filliat , Natalia Díaz-Rodríguez

Future deep learning models will be distinguished by systems that perpetually learn through interaction, imagination, and cooperation, blurring the line between training and inference. This makes continual learning a critical challenge, as…

Machine Learning · Computer Science 2025-05-20 Truman Hickok

Novel reinforcement learning algorithms, or improvements on existing ones, are commonly justified by evaluating their performance on benchmark environments and are compared to an ever-changing set of standard algorithms. However, despite…

Machine Learning · Computer Science 2024-06-25 Scott M. Jordan , Adam White , Bruno Castro da Silva , Martha White , Philip S. Thomas

Humans learn all their life long. They accumulate knowledge from a sequence of learning experiences and remember the essential concepts without forgetting what they have learned previously. Artificial neural networks struggle to learn…

Machine Learning · Computer Science 2020-12-09 Timothée Lesort

Conventional deep learning models have limited capacity in learning multiple tasks sequentially. The issue of forgetting the previously learned tasks in continual learning is known as catastrophic forgetting or interference. When the input…

Machine Learning · Computer Science 2020-07-14 Honglin Li , Payam Barnaghi , Shirin Enshaeifar , Frieder Ganz

Continual learning, also known as lifelong learning or incremental learning, refers to the process by which a model learns from a stream of incoming data over time. A common problem in continual learning is the classification layer's bias…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Haoran Chen , Micah Goldblum , Zuxuan Wu , Yu-Gang Jiang

In many reinforcement learning (RL) applications one cannot easily let the agent act in the world; this is true for autonomous vehicles, healthcare applications, and even some recommender systems, to name a few examples. Offline RL provides…

Machine Learning · Computer Science 2024-07-02 Ori Linial , Guy Tennenholtz , Uri Shalit

Continual learning refers to the problem where the training data is available in sequential chunks, termed "tasks". The majority of progress in continual learning has been stunted by the problem of catastrophic forgetting, which is caused…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Rajas Chitale , Ankit Vaidya , Aditya Kane , Archana Ghotkar

Adapting a Reinforcement Learning (RL) agent to an unseen environment is a difficult task due to typical over-fitting on the training environment. RL agents are often capable of solving environments very close to the trained environment,…

Artificial Intelligence · Computer Science 2022-07-04 Olivier Moulin , Vincent Francois-Lavet , Paul Elbers , Mark Hoogendoorn

Reinforcement learning serves as a potent tool for modeling dynamic user interests within recommender systems, garnering increasing research attention of late. However, a significant drawback persists: its poor data efficiency, stemming…

Information Retrieval · Computer Science 2023-08-23 Xiaocong Chen , Siyu Wang , Julian McAuley , Dietmar Jannach , Lina Yao

Continual learning (CL) is a branch of machine learning that aims to enable agents to adapt and generalise previously learned abilities so that these can be reapplied to new tasks or environments. This is particularly useful in multi-task…

Machine Learning · Computer Science 2025-11-20 Kim N. Nolle , Ivana Dusparic , Rhodri Cusack , Vinny Cahill

Continual learning studies agents that learn from streams of tasks without forgetting previous ones while adapting to new ones. Two recent continual-learning scenarios have opened new avenues of research. In meta-continual learning, the…

Deep reinforcement learning (RL) has brought many successes for autonomous robot navigation. However, there still exists important limitations that prevent real-world use of RL-based navigation systems. For example, most learning approaches…

Robotics · Computer Science 2023-06-28 Zifan Xu , Bo Liu , Xuesu Xiao , Anirudh Nair , Peter Stone

Many relevant tasks require an agent to reach a certain state, or to manipulate objects into a desired configuration. For example, we might want a robot to align and assemble a gear onto an axle or insert and turn a key in a lock. These…

Artificial Intelligence · Computer Science 2018-07-24 Carlos Florensa , David Held , Markus Wulfmeier , Michael Zhang , Pieter Abbeel

We propose a method for tackling catastrophic forgetting in deep reinforcement learning that is \textit{agnostic} to the timescale of changes in the distribution of experiences, does not require knowledge of task boundaries, and can adapt…

Machine Learning · Computer Science 2019-06-18 Christos Kaplanis , Murray Shanahan , Claudia Clopath

Continual learning aims to learn new tasks without forgetting previously learned ones. We hypothesize that representations learned to solve each task in a sequence have a shared structure while containing some task-specific properties. We…

Machine Learning · Computer Science 2020-07-22 Sayna Ebrahimi , Franziska Meier , Roberto Calandra , Trevor Darrell , Marcus Rohrbach

The performance of reinforcement learning depends upon designing an appropriate action space, where the effect of each action is measurable, yet, granular enough to permit flexible behavior. So far, this process involved non-trivial user…

Machine Learning · Computer Science 2021-06-08 Edoardo Cetin , Oya Celiktutan

Reinforcement learning has emerged as an important approach for autonomous driving. A reward function is used in reinforcement learning to establish the learned skill objectives and guide the agent toward the optimal policy. Since…

Robotics · Computer Science 2026-03-05 Ahmed Abouelazm , Jonas Michel , J. Marius Zoellner
‹ Prev 1 4 5 6 7 8 10 Next ›