English
Related papers

Related papers: Universal Successor Features for Transfer Reinforc…

200 papers

Supervised fine-tuning (SFT) and reinforcement learning (RL) are widely used post-training techniques for foundation models. However, their roles in enhancing model generalization capabilities remain unclear. This paper studies the…

Artificial Intelligence · Computer Science 2025-05-27 Tianzhe Chu , Yuexiang Zhai , Jihan Yang , Shengbang Tong , Saining Xie , Dale Schuurmans , Quoc V. Le , Sergey Levine , Yi Ma

Reinforcement learning (RL) can automate a wide variety of robotic skills, but learning each new skill requires considerable real-world data collection and manual representation engineering to design policy classes or features. Using deep…

Machine Learning · Computer Science 2016-09-23 Coline Devin , Abhishek Gupta , Trevor Darrell , Pieter Abbeel , Sergey Levine

Many important tasks are defined in terms of object. To generalize across these tasks, a reinforcement learning (RL) agent needs to exploit the structure that the objects induce. Prior work has either hard-coded object-centric features,…

Machine Learning · Computer Science 2023-11-06 Wilka Carvalho , Andrew Lampinen , Kyriacos Nikiforou , Felix Hill , Murray Shanahan

The successor representation (SR) provides a powerful framework for decoupling predictive dynamics from rewards, enabling rapid generalisation across reward configurations. However, the classical SR is limited by its inherent policy…

Machine Learning · Computer Science 2026-02-16 Changmin Yu , Máté Lengyel

The options framework in reinforcement learning models the notion of a skill or a temporally extended sequence of actions. The discovery of a reusable set of skills has typically entailed building options, that navigate to bottleneck…

Machine Learning · Computer Science 2019-05-15 Rahul Ramesh , Manan Tomar , Balaraman Ravindran

In deep learning, transfer learning (TL) has become the de facto approach when dealing with image related tasks. Visual features learnt for one task have been shown to be reusable for other tasks, improving performance significantly. By…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Adrian Tormos , Dario Garcia-Gasulla , Victor Gimenez-Abalos , Sergio Alvarez-Napagao

Reinforcement Learning (RL) provides a framework in which agents can be trained, via trial and error, to solve complex decision-making problems. Learning with little supervision causes RL methods to require large amounts of data, rendering…

Machine Learning · Computer Science 2024-11-22 Sergio A. Serrano , Jose Martinez-Carranza , L. Enrique Sucar

Temporal distances lie at the heart of many algorithms for planning, control, and reinforcement learning that involve reaching goals, allowing one to estimate the transit time between two states. However, prior attempts to define such…

Machine Learning · Computer Science 2025-03-11 Vivek Myers , Chongyi Zheng , Anca Dragan , Sergey Levine , Benjamin Eysenbach

Reinforcement Learning (RL) enables an intelligent agent to optimise its performance in a task by continuously taking action from an observed state and receiving a feedback from the environment in form of rewards. RL typically uses tables…

Artificial Intelligence · Computer Science 2025-01-28 Alberto Castagna

Multitask Representation Learning (MRL) has emerged as a prevalent technique to improve sample efficiency in Reinforcement Learning (RL). Empirical studies have found that training agents on multiple tasks simultaneously within online and…

Machine Learning · Computer Science 2025-03-04 Rui Lu , Yang Yue , Andrew Zhao , Simon Du , Gao Huang

Transfer learning across different reinforcement learning (RL) tasks is becoming an increasingly valuable area of research. We consider a goal-based multi-task RL framework and mechanisms by which previously solved tasks can reduce sample…

Machine Learning · Computer Science 2019-07-02 Nick Denis

A hallmark of intelligence is the ability to adapt in non-stationary environments, yet deep Reinforcement Learning (RL) agents often struggle in such settings. Prior studies introduce non-stationarity through abrupt shifts in features or…

Machine Learning · Computer Science 2026-05-28 Raymond Chua , Doina Precup , Blake Richards

We present models for encoding sentences into embedding vectors that specifically target transfer learning to other NLP tasks. The models are efficient and result in accurate performance on diverse transfer tasks. Two variants of the…

With the increasing power of computers and the rapid development of self-learning methodologies such as machine learning and artificial intelligence, the problem of constructing an automatic Financial Trading Systems (FTFs) becomes an…

Trading and Market Microstructure · Quantitative Finance 2019-08-29 Haoqian Li , Thomas Lau

Modern ransomware exhibits polymorphic and evasive behaviors by frequently modifying execution patterns to evade detection. This dynamic nature disrupts feature spaces and limits the effectiveness of static or predefined models. To address…

Cryptography and Security · Computer Science 2026-04-23 Jannatul Ferdous , Rafiqul Islam , Arash Mahboubi , Md Zahidul Islam

A representation is supposed universal if it encodes any element of the visual world (e.g., objects, scenes) in any configuration (e.g., scale, context). While not expecting pure universal representations, the goal in the literature is to…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Youssef Tamaazousti , Hervé Le Borgne , Céline Hudelot , Mohamed El Amine Seddik , Mohamed Tamaazousti

A challenging problem in many modern machine learning tasks is to process weight-space features, i.e., to transform or extract information from the weights and gradients of a neural network. Recent works have developed promising…

Machine Learning · Computer Science 2024-02-09 Allan Zhou , Chelsea Finn , James Harrison

Recent approaches to multi-task learning (MTL) have focused on modelling connections between tasks at the decoder level. This leads to a tight coupling between tasks, which need retraining if a new task is inserted or removed. We argue that…

Machine Learning · Computer Science 2022-04-13 Jaime Spencer , Richard Bowden , Simon Hadfield

Model-based reinforcement learning (RL) enjoys several benefits, such as data-efficiency and planning, by learning a model of the environment's dynamics. However, learning a global model that can generalize across different dynamics is a…

Machine Learning · Computer Science 2020-06-30 Kimin Lee , Younggyo Seo , Seunghyun Lee , Honglak Lee , Jinwoo Shin

We propose a probabilistic framework to directly insert prior knowledge in reinforcement learning (RL) algorithms by defining the behaviour policy as a Bayesian posterior distribution. Such a posterior combines task specific information…

Machine Learning · Computer Science 2018-10-02 Michalis K. Titsias , Sotirios Nikoloutsopoulos