中文
相关论文

相关论文: WorldCompass: Reinforcement Learning for Long-Hori…

200 篇论文

Recently, model-free reinforcement learning algorithms have been shown to solve challenging problems by learning from extensive interaction with the environment. A significant issue with transferring this success to the robotics domain is…

人工智能 · 计算机科学 2017-11-30 Jake Bruce , Niko Suenderhauf , Piotr Mirowski , Raia Hadsell , Michael Milford

Learning physical dynamics in a series of non-stationary environments is a challenging but essential task for model-based reinforcement learning (MBRL) with visual inputs. It requires the agent to consistently adapt to novel tasks without…

机器学习 · 计算机科学 2025-07-08 Minting Pan , Wendong Zhang , Geng Chen , Xiangming Zhu , Siyu Gao , Yunbo Wang , Xiaokang Yang

Designing dense rewards is crucial for reinforcement learning (RL), yet in robotics it often demands extensive manual effort and lacks scalability. One promising solution is to view task progress as a dense reward signal, as it quantifies…

人工智能 · 计算机科学 2026-05-21 Yuyang Liu , Chuan Wen , Yihang Hu , Dinesh Jayaraman , Yang Gao

Learning-based approaches, such as reinforcement learning (RL) and imitation learning (IL), have indicated superiority over rule-based approaches in complex urban autonomous driving environments, showing great potential to make intelligent…

机器人学 · 计算机科学 2022-05-31 Haochen Liu , Zhiyu Huang , Jingda Wu , Chen Lv

As the demand for mobile robots continues to increase, social navigation has emerged as a critical task, driving active research into deep reinforcement learning (RL) approaches. However, because pedestrian dynamics and social conventions…

机器人学 · 计算机科学 2026-04-10 Haruto Nagahisa , Kohei Matsumoto , Yuki Tomita , Yuki Hyodo , Ryo Kurazume

We present GoLongRL, a fully open-source, capability-oriented post-training recipe for long-context reinforcement learning with verifiable rewards (RLVR). Existing long-context RL methods often treat data construction as a matter of…

计算与语言 · 计算机科学 2026-05-20 Minxuan Lv , Tiehua Mei , Tanlong Du , Junmin Chen , Zhenpeng Su , Ziyang Chen , Ziqi Wang , Zhennan Wu , Ruotong Pan , jian Liang , Ruiming Tang , Han Li

Generating explanations for reinforcement learning (RL) is challenging as actions may produce long-term effects on the future. In this paper, we develop a novel framework for explainable RL by learning a causal world model without prior…

机器学习 · 计算机科学 2024-01-19 Zhongwei Yu , Jingqing Ruan , Dengpeng Xing

While deep reinforcement learning methods have shown impressive results in robot learning, their sample inefficiency makes the learning of complex, long-horizon behaviors with real robot systems infeasible. To mitigate this issue,…

机器学习 · 计算机科学 2022-04-26 Taewook Nam , Shao-Hua Sun , Karl Pertsch , Sung Ju Hwang , Joseph J Lim

Off-road navigation on vertically challenging terrain, involving steep slopes and rugged boulders, presents significant challenges for wheeled robots both at the planning level to achieve smooth collision-free trajectories and at the…

机器人学 · 计算机科学 2024-10-29 Tong Xu , Chenhui Pan , Xuesu Xiao

Autoregressive video world models predict future visual observations conditioned on actions. While effective over short horizons, these models often struggle with long-horizon generation, as small prediction errors accumulate over time.…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Junchao Huang , Ziyang Ye , Xinting Hu , Tianyu He , Guiyu Zhang , Shaoshuai Shi , Jiang Bian , Li Jiang

Though significant advancements have been achieved in developing long-context large language models (LLMs), the compromised quality of LLM-synthesized data for supervised fine-tuning (SFT) often affects the long-context performance of SFT…

计算与语言 · 计算机科学 2024-10-29 Jiajie Zhang , Zhongni Hou , Xin Lv , Shulin Cao , Zhenyu Hou , Yilin Niu , Lei Hou , Yuxiao Dong , Ling Feng , Juanzi Li

Vision-Language-Action (VLA) models have demonstrated potential in autonomous driving. However, two critical challenges hinder their development: (1) Existing VLA architectures are typically based on imitation learning in open-loop setup…

Reinforcement Learning (RL) is a rapidly growing area of machine learning that finds its application in a broad range of domains, from finance and healthcare to robotics and gaming. Compared to other machine learning techniques, RL agents…

人工智能 · 计算机科学 2024-11-14 Geetansh Kalra , Divye Singh , Justin Jose

Offline reinforcement learning (RL) has emerged as a prevalent and effective methodology for real-world recommender systems, enabling learning policies from historical data and capturing user preferences. In offline RL, reward shaping…

信息检索 · 计算机科学 2025-07-01 Wenzheng Shu , Yanxiang Zeng , Yongxiang Tang , Teng Sha , Ning Luo , Yanhua Cheng , Xialong Liu , Fan Zhou , Peng Jiang

Reinforcement learning (RL) post-training has become a trending paradigm for enhancing the capabilities of large language models (LLMs). Most existing RL systems for LLMs operate in a fully synchronous manner, where training must wait for…

机器学习 · 计算机科学 2025-11-11 Zekai Qu , Yinxu Pan , Ao Sun , Chaojun Xiao , Xu Han

End-to-end autonomous driving models based on Vision-Language-Action (VLA) architectures have shown promising results by learning driving policies through behavior cloning on expert demonstrations. However, imitation learning inherently…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Zihao Sheng , Xin Ye , Jingru Luo , Sikai Chen , Liu Ren

Reinforcement Learning (RL) is notoriously data-inefficient, which makes training on a real robot difficult. While model-based RL algorithms (world models) improve data-efficiency to some extent, they still require hours or days of…

机器学习 · 计算机科学 2023-10-25 Yunhai Feng , Nicklas Hansen , Ziyan Xiong , Chandramouli Rajagopalan , Xiaolong Wang

Action-conditioned video prediction models (often referred to as world models) have shown strong potential for robotics applications, but existing approaches are often slow and struggle to capture physically consistent interactions over…

Meta-reinforcement learning (meta-RL) has proven to be a successful framework for leveraging experience from prior tasks to rapidly learn new related tasks, however, current meta-RL approaches struggle to learn in sparse reward…

人工智能 · 计算机科学 2021-12-03 Charles Packer , Pieter Abbeel , Joseph E. Gonzalez

Large language models excel at short-horizon reasoning tasks, but performance drops as reasoning horizon lengths increase. Existing approaches to combat this rely on inference-time scaffolding or costly step-level supervision, neither of…