中文
相关论文

相关论文: Universal Successor Representations for Transfer R…

200 篇论文

Representation learning based on multi-task pretraining has become a powerful approach in many domains. In particular, task-aware representation learning aims to learn an optimal representation for a specific target task by sampling data…

机器学习 · 计算机科学 2023-06-16 Yifang Chen , Yingbing Huang , Simon S. Du , Kevin Jamieson , Guanya Shi

Reinforcement learning (RL) has shown its strength in challenging sequential decision-making problems. The reward function in RL is crucial to the learning performance, as it serves as a measure of the task completion degree. In real-world…

机器学习 · 计算机科学 2024-02-13 Siyuan Li , Shijie Han , Yingnan Zhao , By Liang , Peng Liu

The successor representation (SR) provides a powerful framework for decoupling predictive dynamics from rewards, enabling rapid generalisation across reward configurations. However, the classical SR is limited by its inherent policy…

机器学习 · 计算机科学 2026-02-16 Changmin Yu , Máté Lengyel

Reinforcement learning is a learning paradigm for solving sequential decision-making problems. Recent years have witnessed remarkable progress in reinforcement learning upon the fast development of deep neural networks. Along with the…

机器学习 · 计算机科学 2023-07-06 Zhuangdi Zhu , Kaixiang Lin , Anil K. Jain , Jiayu Zhou

A long-standing goal of reinforcement learning is to acquire agents that can learn on training tasks and generalize well on unseen tasks that may share a similar dynamic but with different reward functions. The ability to generalize across…

机器学习 · 计算机科学 2026-01-26 Chengyang Ying , Xinning Zhou , Zhongkai Hao , Hang Su , Songming Liu , Dong Yan , Jun Zhu

We transform reinforcement learning (RL) into a form of supervised learning (SL) by turning traditional RL on its head, calling this Upside Down RL (UDRL). Standard RL predicts rewards, while UDRL instead uses rewards as task-defining…

人工智能 · 计算机科学 2020-06-24 Juergen Schmidhuber

Ensuring generalization to unseen environments remains a challenge. Domain shift can lead to substantially degraded performance unless shifts are well-exercised within the available training environments. We introduce a simple robust…

机器学习 · 计算机科学 2021-10-20 Yilun Xu , Tommi Jaakkola

Deep Reinforcement Learning (RL) has demonstrated success in solving complex sequential decision-making problems by integrating neural networks with the RL framework. However, training deep RL models poses several challenges, such as the…

机器学习 · 计算机科学 2025-09-30 Sooraj Sathish , Keshav Goyal , Raghuram Bharadwaj Diddigi

In reinforcement learning, state representations are used to tractably deal with large problem spaces. State representations serve both to approximate the value function with few parameters, but also to generalize to newly encountered…

机器学习 · 计算机科学 2022-03-02 Charline Le Lan , Stephen Tu , Adam Oberman , Rishabh Agarwal , Marc G. Bellemare

In most of the transfer learning approaches to reinforcement learning (RL) the distribution over the tasks is assumed to be stationary. Therefore, the target and source tasks are i.i.d. samples of the same distribution. In the context of…

机器学习 · 计算机科学 2020-06-19 Giuseppe Canonaco , Andrea Soprani , Manuel Roveri , Marcello Restelli

When robots learn reward functions using high capacity models that take raw state directly as input, they need to both learn a representation for what matters in the task -- the task ``features" -- as well as how to combine these features…

机器人学 · 计算机科学 2023-03-20 Andreea Bobu , Yi Liu , Rohin Shah , Daniel S. Brown , Anca D. Dragan

In manufacturing, assembly tasks have been a challenge for learning algorithms due to variant dynamics of different environments. Reinforcement learning (RL) is a promising framework to automatically learn these tasks, yet it is still not…

机器人学 · 计算机科学 2022-10-07 Quantao Yang , Johannes A. Stork , Todor Stoyanov

Understanding visual inputs for a given task amidst varied changes is a key challenge posed by visual reinforcement learning agents. We propose \textit{Value Explicit Pretraining} (VEP), a method that learns generalizable representations…

机器学习 · 计算机科学 2026-05-04 Kiran Lekkala , Henghui Bao , Sumedh A. Sontakke , Erdem Biyik , Laurent Itti

We are interested in how to design reinforcement learning agents that provably reduce the sample complexity for learning new tasks by transferring knowledge from previously-solved ones. The availability of solutions to related problems…

机器学习 · 计算机科学 2020-07-03 Andrea Tirinzoni , Riccardo Poiani , Marcello Restelli

Representation learning has significantly driven the field to develop pretrained models that can act as a valuable starting point when transferring to new datasets. With the rising demand for reliable machine learning and uncertainty…

机器学习 · 计算机科学 2023-10-20 Michael Kirchhof , Bálint Mucsányi , Seong Joon Oh , Enkelejda Kasneci

Learning robust value functions given raw observations and rewards is now possible with model-free and model-based deep reinforcement learning algorithms. There is a third alternative, called Successor Representations (SR), which decomposes…

机器学习 · 统计学 2016-06-09 Tejas D. Kulkarni , Ardavan Saeedi , Simanta Gautam , Samuel J. Gershman

Here we propose using the successor representation (SR) to accelerate learning in a constructive knowledge system based on general value functions (GVFs). In real-world settings like robotics for unstructured and dynamic environments, it is…

机器学习 · 计算机科学 2018-03-28 Craig Sherstan , Marlos C. Machado , Patrick M. Pilarski

Reinforcement Learning (RL) enables an intelligent agent to optimise its performance in a task by continuously taking action from an observed state and receiving a feedback from the environment in form of rewards. RL typically uses tables…

人工智能 · 计算机科学 2025-01-28 Alberto Castagna

Learning policies which are robust to changes in the environment are critical for real world deployment of Reinforcement Learning agents. They are also necessary for achieving good generalization across environment shifts. We focus on…

机器学习 · 计算机科学 2023-06-08 Anuj Mahajan , Amy Zhang

Visual Reinforcement Learning is a popular and powerful framework that takes full advantage of the Deep Learning breakthrough. It is known that variations in input domains (e.g., different panorama colors due to seasonal changes) or task…

机器学习 · 计算机科学 2025-02-19 Antonio Pio Ricciardi , Valentino Maiorca , Luca Moschella , Riccardo Marin , Emanuele Rodolà