中文
相关论文

相关论文: Universal Successor Features for Transfer Reinforc…

200 篇论文

Agents trained with deep reinforcement learning algorithms are capable of performing highly complex tasks including locomotion in continuous environments. We investigate transferring the learning acquired in one task to a set of previously…

机器学习 · 计算机科学 2024-03-06 Suzan Ece Ada , Emre Ugur , H. Levent Akin

There have been key advancements to building universal approximators for multi-goal collections of reinforcement learning value functions -- key elements in estimating long-term returns of states in a parameterized manner. We extend this to…

机器学习 · 计算机科学 2024-10-29 Rushiv Arora

This work investigates the entanglement between Continual Learning (CL) and Transfer Learning (TL). In particular, we shed light on the widespread application of network pretraining, highlighting that it is itself subject to catastrophic…

In this paper, we study the Tiered Reinforcement Learning setting, a parallel transfer learning framework, where the goal is to transfer knowledge from the low-tier (source) task to the high-tier (target) task to reduce the exploration risk…

机器学习 · 计算机科学 2024-06-14 Jiawei Huang , Niao He

Lifelong Reinforcement Learning (LRL) holds significant potential for addressing sequential tasks, but it still faces considerable challenges. A key difficulty lies in effectively preventing catastrophic forgetting and facilitating…

机器学习 · 计算机科学 2025-03-18 Zhiyi Huang , Xiaohan Shan , Jianmin Li

Meta reinforcement learning (meta-RL) aims to learn a policy solving a set of training tasks simultaneously and quickly adapting to new tasks. It requires massive amounts of data drawn from training tasks to infer the common structure…

机器学习 · 计算机科学 2022-07-21 Yijie Guo , Qiucheng Wu , Honglak Lee

Reinforcement learning (RL) has shown its strength in challenging sequential decision-making problems. The reward function in RL is crucial to the learning performance, as it serves as a measure of the task completion degree. In real-world…

机器学习 · 计算机科学 2024-02-13 Siyuan Li , Shijie Han , Yingnan Zhao , By Liang , Peng Liu

Transfer learning can address the learning tasks of unlabeled data in the target domain by leveraging plenty of labeled data from a different but related source domain. A core issue in transfer learning is to learn a shared feature space in…

机器学习 · 计算机科学 2019-01-10 Peng Xu , Zhaohong Deng , Jun Wang , Qun Zhang , Shitong Wang

The focus of this study is to investigate the impact of different initialization strategies for the weight matrix of Successor Features (SF) on learning efficiency and convergence in Reinforcement Learning (RL) agents. Using a grid-world…

神经元与认知 · 定量生物学 2024-02-08 Hyunsu Lee

It has been established that diverse behaviors spanning the controllable subspace of an Markov decision process can be trained by rewarding a policy for being distinguishable from other policies \citep{gregor2016variational,…

机器学习 · 计算机科学 2020-01-28 Steven Hansen , Will Dabney , Andre Barreto , Tom Van de Wiele , David Warde-Farley , Volodymyr Mnih

Zero-shot reinforcement learning (RL) has emerged as a setting for developing general agents, capable of solving downstream tasks without additional training or planning at test-time. While conventional RL optimizes policies for fixed…

机器学习 · 计算机科学 2026-03-10 Jacopo Di Ventura , Jan Felix Kleuker , Aske Plaat , Thomas Moerland

Reinforcement Learning (RL) is an important machine learning paradigm for solving sequential decision-making problems. Recent years have witnessed remarkable progress in this field due to the rapid development of deep neural networks.…

机器学习 · 计算机科学 2026-04-08 Chaofan Pan , Xin Yang , Yanhua Li , Wei Wei , Tianrui Li , Bo An , Jiye Liang

Recurrent neural networks (RNNs) sequentially process data by updating their state with each new data point, and have long been the de facto choice for sequence modeling tasks. However, their inherently sequential computation makes them…

计算与语言 · 计算机科学 2019-03-06 Mostafa Dehghani , Stephan Gouws , Oriol Vinyals , Jakob Uszkoreit , Łukasz Kaiser

Quadrupeds have gained rapid advancement in their capability of traversing across complex terrains. The adoption of deep Reinforcement Learning (RL), transformers and various knowledge transfer techniques can greatly reduce the sim-to-real…

机器人学 · 计算机科学 2025-08-05 Dikai Liu , Tianwei Zhang , Jianxiong Yin , Simon See

How to learn a universal facial representation that boosts all face analysis tasks? This paper takes one step toward this goal. In this paper, we study the transfer performance of pre-trained models on face analysis tasks and introduce a…

计算机视觉与模式识别 · 计算机科学 2022-04-04 Yinglin Zheng , Hao Yang , Ting Zhang , Jianmin Bao , Dongdong Chen , Yangyu Huang , Lu Yuan , Dong Chen , Ming Zeng , Fang Wen

Upside down reinforcement learning (UDRL) flips the conventional use of the return in the objective function in RL upside down, by taking returns as input and predicting actions. UDRL is based purely on supervised learning, and bypasses…

机器学习 · 计算机科学 2022-02-25 Kai Arulkumaran , Dylan R. Ashley , Jürgen Schmidhuber , Rupesh K. Srivastava

Contrastive learning has achieved great success in skeleton-based representation learning recently. However, the prevailing methods are predominantly negative-based, necessitating additional momentum encoder and memory bank to get negative…

计算机视觉与模式识别 · 计算机科学 2024-12-17 Wanjiang Weng , Hongsong Wang , Junbo Wang , Lei He , Guosen Xie

Reinforcement fine-tuning (RFT) has shown promise for training LLM agents to perform multi-turn decision-making based on environment feedback. However, most existing evaluations remain largely in-domain: training and testing are conducted…

We provide new statistical guarantees for transfer learning via representation learning--when transfer is achieved by learning a feature representation shared across different tasks. This enables learning on new tasks using far less data…

机器学习 · 计算机科学 2020-10-23 Nilesh Tripuraneni , Michael I. Jordan , Chi Jin

Transformers have significantly impacted domains like natural language processing, computer vision, and robotics, where they improve performance compared to other neural networks. This survey explores how transformers are used in…