中文
相关论文

相关论文: Beware of Instantaneous Dependence in Reinforcemen…

200 篇论文

When an agent cannot represent a perfectly accurate model of its environment's dynamics, model-based reinforcement learning (MBRL) can fail catastrophically. Planning involves composing the predictions of the model; when flawed predictions…

机器学习 · 计算机科学 2017-07-28 Erik Talvitie

In this paper, we leverage ideas from model-based control to address the sample efficiency problem of reinforcement learning (RL) algorithms. Accelerating learning is an active field of RL highly relevant in the context of time-varying…

系统与控制 · 电气工程与系统科学 2023-05-23 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

Model-based reinforcement learning (MBRL) has demonstrated superior sample efficiency compared to model-free reinforcement learning (MFRL). However, the presence of inaccurate models can introduce biases during policy learning, resulting in…

机器学习 · 计算机科学 2025-03-27 Yongshuai Liu , Xin Liu

Autonomous vehicles inevitably encounter a vast array of scenarios in real-world environments. Addressing long-tail scenarios, particularly those involving intensive interactions with numerous traffic participants, remains one of the most…

机器人学 · 计算机科学 2024-12-16 Guanzhou Li , Jianping Wu , Yujing He

Hierarchical model-based reinforcement learning (HMBRL) aims to combine the benefits of better sample efficiency of model based reinforcement learning (MBRL) with the abstraction capability of hierarchical reinforcement learning (HRL) to…

机器学习 · 计算机科学 2024-06-04 Robin Schiewer , Anand Subramoney , Laurenz Wiskott

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

机器学习 · 统计学 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

Traditionally, reinforcement learning (RL) agents learn to solve new tasks by updating their neural network parameters through interactions with the task environment. However, recent works demonstrate that some RL agents, after certain…

机器学习 · 计算机科学 2025-02-26 Jiuqi Wang , Ethan Blaser , Hadi Daneshmand , Shangtong Zhang

We investigate robust model-free reinforcement learning algorithms designed for environments that may be dynamic or even adversarial. Traditional state-based policies often struggle to accommodate the challenges imposed by the presence of…

机器学习 · 计算机科学 2023-11-02 Udaya Ghai , Arushi Gupta , Wenhan Xia , Karan Singh , Elad Hazan

The relationship between a reinforcement learning (RL) agent and an asynchronous environment is often ignored. Frequently used models of the interaction between an agent and its environment, such as Markov Decision Processes (MDP) or…

人工智能 · 计算机科学 2018-06-29 Jaden B. Travnik , Kory W. Mathewson , Richard S. Sutton , Patrick M. Pilarski

Reinforcement learning (RL) agents typically optimize their policies by performing expensive backward passes to update their network parameters. However, some agents can solve new tasks without updating any parameters by simply conditioning…

机器学习 · 计算机科学 2025-02-13 Amir Moeini , Jiuqi Wang , Jacob Beck , Ethan Blaser , Shimon Whiteson , Rohan Chandra , Shangtong Zhang

In Model-based Reinforcement Learning (MBRL), model learning is critical since an inaccurate model can bias policy learning via generating misleading samples. However, learning an accurate model can be difficult since the policy is…

机器学习 · 计算机科学 2023-01-23 Zifan Wu , Chao Yu , Chen Chen , Jianye Hao , Hankz Hankui Zhuo

We study a class of reinforcement learning problems where the reward signals for policy learning are generated by an internal reward model that is dependent on and jointly optimized with the policy. This interdependence between the policy…

机器学习 · 计算机科学 2023-08-28 Mengdi Li , Xufeng Zhao , Jae Hee Lee , Cornelius Weber , Stefan Wermter

Interacting with the actual environment to acquire data is often costly and time-consuming in robotic tasks. Model-based offline reinforcement learning (RL) provides a feasible solution. On the one hand, it eliminates the requirements of…

机器学习 · 计算机科学 2023-10-17 Pengqin Wang , Meixin Zhu , Shaojie Shen

As humans, our goals and our environment are persistently changing throughout our lifetime based on our experiences, actions, and internal and external drives. In contrast, typical reinforcement learning problem set-ups consider decision…

机器学习 · 计算机科学 2020-06-19 Annie Xie , James Harrison , Chelsea Finn

In reinforcement learning (RL), an autonomous agent learns to perform complex tasks by maximizing an exogenous reward signal while interacting with its environment. In real-world applications, test conditions may differ substantially from…

机器人学 · 计算机科学 2019-10-30 Matteo Turchetta , Andreas Krause , Sebastian Trimpe

Autonomous driving has achieved significant progress in recent years, but autonomous cars are still unable to tackle high-risk situations where a potential accident is likely. In such near-accident scenarios, even a minor change in the…

机器学习 · 计算机科学 2020-07-02 Zhangjie Cao , Erdem Bıyık , Woodrow Z. Wang , Allan Raventos , Adrien Gaidon , Guy Rosman , Dorsa Sadigh

The inverse reinforcement learning approach to imitation learning is a double-edged sword. On the one hand, it can enable learning from a smaller number of expert demonstrations with more robustness to error compounding than behavioral…

机器学习 · 计算机科学 2024-06-06 Juntao Ren , Gokul Swamy , Zhiwei Steven Wu , J. Andrew Bagnell , Sanjiban Choudhury

Model-based reinforcement learning (RL) often achieves higher sample efficiency in practice than model-free RL by learning a dynamics model to generate samples for policy learning. Previous works learn a dynamics model that fits under the…

机器学习 · 计算机科学 2023-06-27 Xiyao Wang , Wichayaporn Wongkamjan , Furong Huang

Preference-based reinforcement learning (PbRL) can enable robots to learn to perform tasks based on an individual's preferences without requiring a hand-crafted reward function. However, existing approaches either assume access to a…

机器学习 · 计算机科学 2024-02-13 Yi Liu , Gaurav Datta , Ellen Novoseller , Daniel S. Brown

Model-based reinforcement learning (RL) is more sample efficient than model-free RL by using imaginary trajectories generated by the learned dynamics model. When the model is inaccurate or biased, imaginary trajectories may be deleterious…

机器学习 · 计算机科学 2021-04-12 Wenzhen Huang , Qiyue Yin , Junge Zhang , Kaiqi Huang