English
Related papers

Related papers: Universal Successor Representations for Transfer R…

200 papers

Meta-Reinforcement Learning addresses the critical limitations of conventional Reinforcement Learning in multi-task and non-stationary environments by enabling fast policy adaptation and improved generalization. We introduce a novel Meta-RL…

Machine Learning · Computer Science 2026-03-10 Théo Zangato , Aomar Osmani , Pegah Alizadeh

In this paper we introduce a simple approach for exploration in reinforcement learning (RL) that allows us to develop theoretically justified algorithms in the tabular case but that is also extendable to settings where function…

Machine Learning · Computer Science 2019-11-27 Marlos C. Machado , Marc G. Bellemare , Michael Bowling

Experience replay is one of the most commonly used approaches to improve the sample efficiency of reinforcement learning algorithms. In this work, we propose an approach to select and replay sequences of transitions in order to accelerate…

Artificial Intelligence · Computer Science 2022-09-29 Thommen George Karimpanal , Roland Bouffanais

Representation learning algorithms are designed to learn abstract features that characterize data. State representation learning (SRL) focuses on a particular kind of representation learning where learned features are in low dimension,…

Artificial Intelligence · Computer Science 2018-10-30 Timothée Lesort , Natalia Díaz-Rodríguez , Jean-François Goudou , David Filliat

In this paper, we advocate for representation learning as the key to mitigating unfair prediction outcomes downstream. Motivated by a scenario where learned representations are used by third parties with unknown objectives, we propose and…

Machine Learning · Computer Science 2018-10-23 David Madras , Elliot Creager , Toniann Pitassi , Richard Zemel

Transferring knowledge across a sequence of reinforcement-learning tasks is challenging, and has a number of important applications. Though there is encouraging empirical evidence that transfer can improve performance in subsequent…

Machine Learning · Computer Science 2013-09-27 Emma Brunskill , Lihong Li

Reinforcement Learning enables agents to learn optimal behaviors through interactions with environments. However, real-world environments are typically non-stationary, requiring agents to continuously adapt to new tasks and changing…

Artificial Intelligence · Computer Science 2026-01-21 Jinwu Hu , Zihao Lian , Zhiquan Wen , Chenghao Li , Guohao Chen , Xutao Wen , Bin Xiao , Mingkui Tan

Continual learning (CL) aims to learn a sequence of tasks without forgetting the previously acquired knowledge. However, recent CL advances are restricted to supervised continual learning (SCL) scenarios. Consequently, they are not scalable…

Machine Learning · Computer Science 2022-04-06 Divyam Madaan , Jaehong Yoon , Yuanchun Li , Yunxin Liu , Sung Ju Hwang

Representation learning is a central challenge across a range of machine learning areas. In reinforcement learning, effective and functional representations have the potential to tremendously accelerate learning progress and solve more…

Machine Learning · Computer Science 2019-01-30 Dibya Ghosh , Abhishek Gupta , Sergey Levine

Humans are masters at quickly learning many complex tasks, relying on an approximate understanding of the dynamics of their environments. In much the same way, we would like our learning agents to quickly adapt to new tasks. In this paper,…

This paper explores a new research problem of unsupervised transfer learning across multiple spatiotemporal prediction tasks. Unlike most existing transfer learning methods that focus on fixing the discrepancy between supervised tasks, we…

Machine Learning · Computer Science 2020-09-25 Zhiyu Yao , Yunbo Wang , Mingsheng Long , Jianmin Wang

Traditionally, reinforcement learning (RL) agents learn to solve new tasks by updating their neural network parameters through interactions with the task environment. However, recent works demonstrate that some RL agents, after certain…

Machine Learning · Computer Science 2025-02-26 Jiuqi Wang , Ethan Blaser , Hadi Daneshmand , Shangtong Zhang

Learning auxiliary tasks, such as multiple predictions about the world, can provide many benefits to reinforcement learning systems. A variety of off-policy learning algorithms have been developed to learn such predictions, but as yet there…

Machine Learning · Computer Science 2022-02-24 Matthew McLeod , Chunlok Lo , Matthew Schlegel , Andrew Jacobsen , Raksha Kumaraswamy , Martha White , Adam White

Transfer learning is a conceptually-enticing paradigm in pursuit of truly intelligent embodied agents. The core concept -- reusing prior knowledge to learn in and from novel situations -- is successfully leveraged by humans to handle novel…

Effective task representations should facilitate compositionality, such that after learning a variety of basic tasks, an agent can perform compound tasks consisting of multiple steps simply by composing the representations of the…

Robotics · Computer Science 2025-02-14 Vivek Myers , Bill Chunyuan Zheng , Anca Dragan , Kuan Fang , Sergey Levine

User modeling, which learns to represent users into a low-dimensional representation space based on their past behaviors, got a surge of interest from the industry for providing personalized services to users. Previous efforts in user…

Information Retrieval · Computer Science 2023-08-24 Sein Kim , Namkyeong Lee , Donghyun Kim , Minchul Yang , Chanyoung Park

Recently, a novel paradigm has been proposed for reinforcement learning-based NAS agents, that revolves around the incremental improvement of a given architecture. We assess the abilities of such reinforcement learning agents to transfer…

Machine Learning · Computer Science 2024-12-20 Amber Cassimon , Siegfried Mercelis , Kevin Mets

Methods of transfer learning try to combine knowledge from several related tasks (or domains) to improve performance on a test task. Inspired by causal methodology, we relax the usual covariate shift assumption and assume that it holds true…

Machine Learning · Statistics 2018-09-25 Mateo Rojas-Carulla , Bernhard Schölkopf , Richard Turner , Jonas Peters

The growing popularity of transfer learning, due to the availability of models pre-trained on vast amounts of data, makes it imperative to understand when the knowledge of these pre-trained models can be transferred to obtain…

Machine Learning · Computer Science 2024-10-30 Akshay Mehra , Yunbei Zhang , Jihun Hamm

Reinforcement Learning (RL) can enable agents to learn complex tasks. However, it is difficult to interpret the knowledge and reuse it across tasks. Inductive biases can address such issues by explicitly providing generic yet useful…

Artificial Intelligence · Computer Science 2022-12-13 Thomas Schnürer , Malte Probst , Horst-Michael Gross