中文
相关论文

相关论文: Transformers are Sample-Efficient World Models

200 篇论文

Agents must be able to adapt quickly as an environment changes. We find that existing model-based reinforcement learning agents are unable to do this well, in part because of how they use past experiences to train their world model. Here,…

机器学习 · 计算机科学 2023-06-29 Isaac Kauvar , Chris Doyle , Linqi Zhou , Nick Haber

Learning from offline task demonstrations is a problem of great interest in robotics. For simple short-horizon manipulation tasks with modest variation in task instances, offline learning from a small set of demonstrations can produce…

机器人学 · 计算机科学 2020-02-25 Ajay Mandlekar , Fabio Ramos , Byron Boots , Silvio Savarese , Li Fei-Fei , Animesh Garg , Dieter Fox

Reinforcement learning is a general and powerful framework with which to study and implement artificial intelligence. Recent advances in deep learning have enabled RL algorithms to achieve impressive performance in restricted domains such…

人工智能 · 计算机科学 2017-05-23 John Aslanides

Reinforcement learning (RL) studies how an agent comes to achieve reward in an environment through interactions over time. Recent advances in machine RL have surpassed human expertise at the world's oldest board games and many classic video…

Deep reinforcement learning (deep RL) has achieved superior performance in complex sequential tasks by using deep neural networks as function approximators to learn directly from raw input images. However, learning directly from raw images…

机器学习 · 计算机科学 2019-07-31 Gabriel V. de la Cruz , Yunshu Du , Matthew E. Taylor

Imitation learning (IL) enables agents to acquire skills directly from expert demonstrations, providing a compelling alternative to reinforcement learning. However, prior online IL approaches struggle with complex tasks characterized by…

机器学习 · 计算机科学 2025-05-13 Shangzhe Li , Zhiao Huang , Hao Su

Autonomous and learning systems based on Deep Reinforcement Learning have firmly established themselves as a foundation for approaches to creating resilient and efficient Cyber-Physical Energy Systems. However, most current approaches…

人工智能 · 计算机科学 2024-04-03 Eric MSP Veith , Torben Logemann , Aleksandr Berezin , Arlena Wellßow , Stephan Balduin

While recent model-free Reinforcement Learning (RL) methods have demonstrated human-level effectiveness in gaming environments, their success in everyday tasks like visual navigation has been limited, particularly under significant…

机器学习 · 计算机科学 2024-04-04 Rudra P. K. Poudel , Harit Pandya , Stephan Liwicki , Roberto Cipolla

Acquiring complex behaviors is essential for artificially intelligent agents, yet learning these behaviors in high-dimensional settings poses a significant challenge due to the vast search space. Traditional reinforcement learning (RL)…

机器学习 · 计算机科学 2025-04-22 Mert Albaba , Sammy Christen , Thomas Langarek , Christoph Gebhardt , Otmar Hilliges , Michael J. Black

Interactive Information Retrieval (IIR) and Reinforcement Learning (RL) share many commonalities, including an agent who learns while interacts, a long-term and complex goal, and an algorithm that explores and adapts. To successfully apply…

信息检索 · 计算机科学 2021-06-10 Limin Chen , Zhiwen Tang , Grace Hui Yang

Model-free Reinforcement Learning (RL) generally suffers from poor sample complexity, mostly due to the need to exhaustively explore the state-action space to find well-performing policies. On the other hand, we postulate that expert…

机器学习 · 计算机科学 2023-09-13 Loris Di Natale , Bratislav Svetozarevic , Philipp Heer , Colin N. Jones

The paradigm of learning-based robotics holds immense promise, yet its translation to real-world applications is critically hindered by the sample inefficiency and brittleness of conventional model-free reinforcement learning algorithms. In…

机器人学 · 计算机科学 2025-12-02 Agniprabha Chakraborty

Transformer models have achieved remarkable empirical successes, largely due to their in-context learning capabilities. Inspired by this, we explore training an autoregressive transformer for in-context reinforcement learning (ICRL). In…

机器学习 · 计算机科学 2026-01-29 Juncheng Dong , Moyang Guo , Ethan X. Fang , Zhuoran Yang , Vahid Tarokh

Scaling issues are mundane yet irritating for practitioners of reinforcement learning. Error scales vary across domains, tasks, and stages of learning; sometimes by many orders of magnitude. This can be detrimental to learning speed and…

机器学习 · 计算机科学 2021-05-13 Tom Schaul , Georg Ostrovski , Iurii Kemaev , Diana Borsa

Deep artificial neural networks, trained with labeled data sets are widely used in numerous vision and robotics applications today. In terms of AI, these are called reflex models, referring to the fact that they do not self-evolve or…

计算机视觉与模式识别 · 计算机科学 2020-02-20 Hai Xiao , Jin Shang , Mengyuan Huang

A fundamental challenge in multi-task reinforcement learning (MTRL) is achieving sample efficiency in visual domains where tasks exhibit substantial heterogeneity in both observations and dynamics. Model-based reinforcement learning offers…

机器学习 · 计算机科学 2026-02-03 Boxuan Zhang , Weipu Zhang , Zhaohan Feng , Wei Xiao , Jian Sun , Jie Chen , Gang Wang

Reinforcement learning allows solving complex tasks, however, the learning tends to be task-specific and the sample efficiency remains a challenge. We present Plan2Explore, a self-supervised reinforcement learning agent that tackles both…

机器学习 · 计算机科学 2020-07-02 Ramanan Sekar , Oleh Rybkin , Kostas Daniilidis , Pieter Abbeel , Danijar Hafner , Deepak Pathak

To overcome the sim-to-real gap in reinforcement learning (RL), learned policies must maintain robustness against environmental uncertainties. While robust RL has been widely studied in single-agent regimes, in multi-agent environments, the…

机器学习 · 计算机科学 2024-05-10 Laixi Shi , Eric Mazumdar , Yuejie Chi , Adam Wierman

In this paper, we leverage ideas from model-based control to address the sample efficiency problem of reinforcement learning (RL) algorithms. Accelerating learning is an active field of RL highly relevant in the context of time-varying…

系统与控制 · 电气工程与系统科学 2023-05-23 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

Assistive agents should make humans' lives easier. Classically, such assistance is studied through the lens of inverse reinforcement learning, where an assistive agent (e.g., a chatbot, a robot) infers a human's intention and then selects…

人工智能 · 计算机科学 2025-01-17 Vivek Myers , Evan Ellis , Sergey Levine , Benjamin Eysenbach , Anca Dragan