中文
相关论文

相关论文: SMORE: Score Models for Offline Goal-Conditioned R…

200 篇论文

Offline reinforcement learning (RL) harnesses the power of massive datasets for resolving sequential decision problems. Most existing papers only discuss defending against out-of-distribution (OOD) actions while we investigate a broader…

机器学习 · 计算机科学 2023-11-02 Zhihong Deng , Zuyue Fu , Lingxiao Wang , Zhuoran Yang , Chenjia Bai , Tianyi Zhou , Zhaoran Wang , Jing Jiang

Offline reinforcement learning (RL) seeks to learn optimal policies from static datasets without interacting with the environment. A common challenge is handling multi-modal action distributions, where multiple behaviours are represented in…

机器学习 · 计算机科学 2025-03-20 Mianchu Wang , Yue Jin , Giovanni Montana

In critical care settings such as the Intensive Care Unit, clinicians face the complex challenge of balancing conflicting objectives, primarily maximizing patient survival while minimizing resource utilization (e.g., length of stay).…

机器学习 · 计算机科学 2025-12-10 Aryaman Bansal , Divya Sharma

Recently, Offline Reinforcement Learning (RL) has achieved remarkable progress with the emergence of various algorithms and datasets. However, these methods usually focus on algorithmic advancements, ignoring that many low-level…

机器学习 · 计算机科学 2023-06-02 Bingyi Kang , Xiao Ma , Yirui Wang , Yang Yue , Shuicheng Yan

Offline goal-conditioned reinforcement learning (GCRL) can be challenging due to overfitting to the given dataset. To generalize agents' skills outside the given dataset, we propose a goal-swapping procedure that generates additional…

机器学习 · 计算机科学 2023-02-20 Wenyan Yang , Huiling Wang , Dingding Cai , Joni Pajarinen , Joni-Kristen Kämäräinen

Offline reinforcement learning (RL) aims to infer sequential decision policies using only offline datasets. This is a particularly difficult setup, especially when learning to achieve multiple different goals or outcomes under a given…

机器学习 · 计算机科学 2024-05-17 Mianchu Wang , Yue Jin , Giovanni Montana

Model-based offline Reinforcement Learning (RL) constructs environment models from offline datasets to perform conservative policy optimization. Existing approaches focus on learning state transitions through ensemble models, rollouting…

机器学习 · 计算机科学 2025-03-27 Hongye Cao , Fan Feng , Jing Huo , Shangdong Yang , Meng Fang , Tianpei Yang , Yang Gao

Learning to reach goal states and learning diverse skills through mutual information (MI) maximization have been proposed as principled frameworks for self-supervised reinforcement learning, allowing agents to acquire broadly applicable…

机器学习 · 计算机科学 2021-06-04 Jongwook Choi , Archit Sharma , Honglak Lee , Sergey Levine , Shixiang Shane Gu

In classic Reinforcement Learning (RL), the agent maximizes an additive objective of the visited states, e.g., a value function. Unfortunately, objectives of this type cannot model many real-world applications such as experiment design,…

机器学习 · 计算机科学 2024-07-16 Riccardo De Santi , Manish Prajapat , Andreas Krause

Many advances that have improved the robustness and efficiency of deep reinforcement learning (RL) algorithms can, in one way or another, be understood as introducing additional objectives or constraints in the policy optimization step.…

Goal-Conditioned Reinforcement Learning (GCRL) can enable agents to spontaneously set diverse goals to learn a set of skills. Despite the excellent works proposed in various fields, reaching distant goals in temporally extended tasks…

机器人学 · 计算机科学 2023-07-21 Zhifeng Qian , Mingyu You , Hongjun Zhou , Xuanhui Xu , Bin He

Offline reinforcement learning requires reconciling two conflicting aims: learning a policy that improves over the behavior policy that collected the dataset, while at the same time minimizing the deviation from the behavior policy so as to…

机器学习 · 计算机科学 2021-10-13 Ilya Kostrikov , Ashvin Nair , Sergey Levine

Real-world wireless data are expensive to collect and often lack sufficient expert demonstrations, causing existing offline RL methods to overfit suboptimal behaviors and exhibit unstable performance. To address this issue, we propose CORE,…

网络与互联网体系结构 · 计算机科学 2025-12-23 Lipeng Zu , Hansong Zhou , Yu Qian , Shayok Chakraborty , Yukun Yuan , Linke Guo , Xiaonan Zhang

Learning a precise dynamics model can be crucial for offline reinforcement learning, which, unfortunately, has been found to be quite challenging. Dynamics models that are learned by fitting historical transitions often struggle to…

机器学习 · 计算机科学 2023-10-10 Fan-Ming Luo , Tian Xu , Xingchen Cao , Yang Yu

Offline Reinforcement Learning (RL) aims to turn large datasets into powerful decision-making engines without any online interactions with the environment. This great promise has motivated a large amount of research that hopes to replicate…

Offline reinforcement learning (RL) is an effective tool for real-world recommender systems with its capacity to model the dynamic interest of users and its interactive nature. Most existing offline RL recommender systems focus on…

信息检索 · 计算机科学 2025-05-13 Yi Zhang , Ruihong Qiu , Jiajun Liu , Sen Wang

Goal-conditioned reinforcement learning (GCRL), related to a set of complex RL problems, trains an agent to achieve different goals under particular scenarios. Compared to the standard RL solutions that learn a policy solely depending on…

人工智能 · 计算机科学 2022-09-05 Minghuan Liu , Menghui Zhu , Weinan Zhang

Offline reinforcement learning (RL) enables learning control policies by utilizing only prior experience, without any online interaction. This can allow robots to acquire generalizable skills from large and diverse datasets, without any…

机器学习 · 计算机科学 2021-09-24 Aviral Kumar , Anikait Singh , Stephen Tian , Chelsea Finn , Sergey Levine

Reinforcement learning (RL) is central to improving reasoning in large language models (LLMs) but typically requires ground-truth rewards. Test-Time Reinforcement Learning (TTRL) removes this need by using majority-vote rewards, but relies…

机器学习 · 计算机科学 2025-10-06 Aleksei Arzhantsev , Otmane Sakhi , Flavian Vasile

Reinforcement learning algorithms typically utilize an interactive simulator (i.e., environment) with a predefined reward function for policy training. Developing such simulators and manually defining reward functions, however, is often…

机器学习 · 计算机科学 2026-03-26 Woo-Jin Ahn , Sang-Ryul Baek , Yong-Jun Lee , Hyun-Duck Choi , Myo-Taeg Lim