中文
相关论文

相关论文: Improving Zero-shot Generalization in Offline Rein…

200 篇论文

Automatic code generation has been a longstanding research topic. With the advancement of general-purpose large language models (LLMs), the ability to code stands out as one important measure to the model's reasoning performance. Usually, a…

软件工程 · 计算机科学 2024-12-18 Jie Chen , Xintian Han , Yu Ma , Xun Zhou , Liang Xiang

Deep neural networks coupled with fast simulation and improved computation have led to recent successes in the field of reinforcement learning (RL). However, most current RL-based approaches fail to generalize since: (a) the gap between…

机器学习 · 计算机科学 2017-03-09 Lerrel Pinto , James Davidson , Rahul Sukthankar , Abhinav Gupta

Zero-shot learning (ZSL) is a challenging task aiming at recognizing novel classes without any training instances. In this paper we present a simple but high-performance ZSL approach by generating pseudo feature representations (GPFR).…

计算机视觉与模式识别 · 计算机科学 2018-09-11 Jiang Lu , Jin Li , Ziang Yan , Changshui Zhang

Reinforcement learning (RL) is a sub-domain of machine learning, mainly concerned with solving sequential decision-making problems by a learning agent that interacts with the decision environment to improve its behavior through the reward…

机器学习 · 计算机科学 2025-09-23 Hossein Hassani , Ehsan Hallaji , Roozbeh Razavi-Far , Mehrdad Saif , Liang Lin

Can we pre-train a generalist agent from a large amount of unlabeled offline trajectories such that it can be immediately adapted to any new downstream tasks in a zero-shot manner? In this work, we present a functional reward encoding (FRE)…

机器学习 · 计算机科学 2024-02-28 Kevin Frans , Seohong Park , Pieter Abbeel , Sergey Levine

In generalized zero shot learning (GZSL), the set of classes are split into seen and unseen classes, where training relies on the semantic features of the seen and unseen classes and the visual representations of only the seen classes,…

计算机视觉与模式识别 · 计算机科学 2018-08-03 Rafael Felix , B. G. Vijay Kumar , Ian Reid , Gustavo Carneiro

With the widespread adoption of deep learning, reinforcement learning (RL) has experienced a dramatic increase in popularity, scaling to previously intractable problems, such as playing complex games from pixel observations, sustaining…

机器学习 · 计算机科学 2023-04-20 Rafael Figueiredo Prudencio , Marcos R. O. A. Maximo , Esther Luna Colombini

Reinforcement learning (RL) has achieved enormous progress in solving various sequential decision-making problems, such as control tasks in robotics. Since policies are overfitted to training environments, RL methods have often failed to be…

机器人学 · 计算机科学 2023-03-21 Xiao Wang , Saasha Nair , Matthias Althoff

Offline reinforcement learning (RL) methods strike a balance between exploration and exploitation by conservative value estimation -- penalizing values of unseen states and actions. Model-free methods penalize values at all unseen actions,…

机器学习 · 计算机科学 2023-09-26 Nirbhay Modhe , Qiaozi Gao , Ashwin Kalyan , Dhruv Batra , Govind Thattai , Gaurav Sukhatme

Offline RL algorithms aim to improve upon the behavior policy that produces the collected data while constraining the learned policy to be within the support of the dataset. However, practical offline datasets often contain examples with…

机器学习 · 计算机科学 2026-02-12 Jianxun Wang , Grant C. Forbes , Leonardo Villalobos-Arias , David L. Roberts

We present Q-chunking, a simple yet effective recipe for improving reinforcement learning (RL) algorithms for long-horizon, sparse-reward tasks. Our recipe is designed for the offline-to-online RL setting, where the goal is to leverage an…

机器学习 · 计算机科学 2026-05-12 Qiyang Li , Zhiyuan Zhou , Sergey Levine

Reinforcement Learning (RL) is notoriously data-inefficient, which makes training on a real robot difficult. While model-based RL algorithms (world models) improve data-efficiency to some extent, they still require hours or days of…

机器学习 · 计算机科学 2023-10-25 Yunhai Feng , Nicklas Hansen , Ziyan Xiong , Chandramouli Rajagopalan , Xiaolong Wang

Deep Reinforcement Learning (DRL) aims to create intelligent agents that can learn to solve complex problems efficiently in a real-world environment. Typically, two learning goals: adaptation and generalization are used for baselining DRL…

机器学习 · 计算机科学 2022-02-18 Pamul Yadav , Ashutosh Mishra , Junyong Lee , Shiho Kim

Offline reinforcement learning (RL) harnesses the power of massive datasets for resolving sequential decision problems. Most existing papers only discuss defending against out-of-distribution (OOD) actions while we investigate a broader…

机器学习 · 计算机科学 2023-11-02 Zhihong Deng , Zuyue Fu , Lingxiao Wang , Zhuoran Yang , Chenjia Bai , Tianyi Zhou , Zhaoran Wang , Jing Jiang

Offline goal-conditioned reinforcement learning (GCRL) is a major problem in reinforcement learning (RL) because it provides a simple, unsupervised, and domain-agnostic way to acquire diverse behaviors and representations from unlabeled…

机器学习 · 计算机科学 2025-02-14 Seohong Park , Kevin Frans , Benjamin Eysenbach , Sergey Levine

We consider a challenging theoretical problem in offline reinforcement learning (RL): obtaining sample-efficiency guarantees with a dataset lacking sufficient coverage, under only realizability-type assumptions for the function…

机器学习 · 计算机科学 2022-06-16 Jinglin Chen , Nan Jiang

Agents trained by reinforcement learning (RL) often fail to generalize beyond the environment they were trained in, even when presented with new scenarios that seem similar to the training environment. We study the query complexity required…

机器学习 · 计算机科学 2021-10-27 Dhruv Malik , Yuanzhi Li , Pradeep Ravikumar

In reinforcement learning (RL) research, it is common to assume access to direct online interactions with the environment. However in many real-world applications, access to the environment is limited to a fixed offline dataset of logged…

机器学习 · 计算机科学 2019-11-27 Yifan Wu , George Tucker , Ofir Nachum

Recent years have witnessed significant progresses in deep Reinforcement Learning (RL). Empowered with large scale neural networks, carefully designed architectures, novel training algorithms and massively parallel computing devices,…

机器学习 · 计算机科学 2018-04-23 Chiyuan Zhang , Oriol Vinyals , Remi Munos , Samy Bengio

Federated learning (FL) has recently emerged as a transformative paradigm that jointly train a model with distributed data sets in IoT while avoiding the need for central data collection. Due to the limited observation range, such data sets…

机器学习 · 计算机科学 2021-12-13 Shuo Wan , Jiaxun Lu , Pingyi Fan , Yunfeng Shao , Chenghui Peng , Khaled B. Letaief