English
Related papers

Related papers: Mitigating Value Hallucination in Dyna Planning vi…

200 papers

Dynamic Difficulty Adjustment (DDA) is a viable approach to enhance a player's experience in video games. Recently, Reinforcement Learning (RL) methods have been employed for DDA in non-competitive games; nevertheless, they rely solely on…

Human-Computer Interaction · Computer Science 2023-08-25 Masoud Rahimi , Hadi Moradi , Abdol-hossein Vahabie , Hamed Kebriaei

Training a task-completion dialogue agent via reinforcement learning (RL) is costly because it requires many interactions with real users. One common alternative is to use a user simulator. However, a user simulator usually lacks the…

Computation and Language · Computer Science 2018-05-24 Baolin Peng , Xiujun Li , Jianfeng Gao , Jingjing Liu , Kam-Fai Wong , Shang-Yu Su

Solving a reinforcement learning (RL) problem poses two competing challenges: fitting a potentially discontinuous value function, and generalizing well to new observations. In this paper, we analyze the learning dynamics of temporal…

Machine Learning · Computer Science 2022-06-07 Clare Lyle , Mark Rowland , Will Dabney , Marta Kwiatkowska , Yarin Gal

Reinforcement Learning (RL) can effectively learn complex policies. However, learning these policies often demands extensive trial-and-error interactions with the environment. In many real-world scenarios, this approach is not practical due…

Machine Learning · Computer Science 2024-02-19 Linh Le Pham Van , Hung The Tran , Sunil Gupta

Many strategic decision-making problems, such as environment design for warehouse robots, can be naturally formulated as bi-level reinforcement learning (RL), where a leader agent optimizes its objective while a follower solves a Markov…

Machine Learning · Computer Science 2026-04-01 Mikoto Kudo , Takumi Tanabe , Akifumi Wachi , Youhei Akimoto

Learning good feature representations is important for deep reinforcement learning (RL). However, with limited experience, RL often suffers from data inefficiency for training. For un-experienced or less-experienced trajectories (i.e.,…

Machine Learning · Computer Science 2021-10-28 Tao Yu , Cuiling Lan , Wenjun Zeng , Mingxiao Feng , Zhizheng Zhang , Zhibo Chen

Model-based methods in reinforcement learning offer a promising approach to enhance data efficiency by facilitating policy exploration within a dynamics model. However, accurately predicting sequential steps in the dynamics model remains a…

Machine Learning · Computer Science 2024-05-28 Haoxin Lin , Yu-Yan Xu , Yihao Sun , Zhilong Zhang , Yi-Chen Li , Chengxing Jia , Junyin Ye , Jiaji Zhang , Yang Yu

This paper proposes a novel deep reinforcement learning (RL) architecture, called Value Prediction Network (VPN), which integrates model-free and model-based RL methods into a single neural network. In contrast to typical model-based RL…

Artificial Intelligence · Computer Science 2017-11-08 Junhyuk Oh , Satinder Singh , Honglak Lee

We consider the problem of iterative machine teaching, where a teacher sequentially provides examples based on the status of a learner under a discrete input space (i.e., a pool of finite samples), which greatly limits the teacher's…

Machine Learning · Computer Science 2023-04-14 Zeju Qiu , Weiyang Liu , Tim Z. Xiao , Zhen Liu , Umang Bhatt , Yucen Luo , Adrian Weller , Bernhard Schölkopf

Delays frequently occur in real-world environments, yet standard reinforcement learning (RL) algorithms often assume instantaneous perception of the environment. We study random sensor delays in POMDPs, where observations may arrive…

Machine Learning · Computer Science 2026-04-17 Armin Karamzade , Kyungmin Kim , JB Lanier , Davide Corsi , Roy Fox

Multi-step temporal difference (TD) learning is an important approach in reinforcement learning, as it unifies one-step TD learning with Monte Carlo methods in a way where intermediate algorithms can outperform either extreme. They address…

Machine Learning · Computer Science 2018-09-10 Kristopher De Asis , Richard S. Sutton

In model-based reinforcement learning, most algorithms rely on simulating trajectories from one-step models of the dynamics learned on data. A critical challenge of this approach is the compounding of one-step prediction errors as the…

Machine Learning · Computer Science 2024-02-06 Abdelhakim Benechehab , Albert Thomas , Giuseppe Paolo , Maurizio Filippone , Balázs Kégl

The planning problem constitutes a fundamental aspect of the autonomous driving framework. Recent strides in representation learning have empowered vehicles to comprehend their surrounding environments, thereby facilitating the integration…

With the growing popularity of deep reinforcement learning (DRL), human-in-the-loop (HITL) approach has the potential to revolutionize the way we approach decision-making problems and create new opportunities for human-AI collaboration. In…

Reinforcement learning (RL) promises to unlock capabilities beyond imitation learning for Vision-Language-Action (VLA) models, but its requirement for massive real-world interaction prevents direct deployment on physical robots. Recent work…

Automated driving in urban settings is challenging. Human participant behavior is difficult to model, and conventional, rule-based Automated Driving Systems (ADSs) tend to fail when they face unmodeled dynamics. On the other hand, the more…

Artificial Intelligence · Computer Science 2020-05-20 Ekim Yurtsever , Linda Capito , Keith Redmill , Umit Ozguner

Most deep reinforcement learning (RL) algorithms distill experience into parametric behavior policies or value functions via gradient updates. While effective, this approach has several disadvantages: (1) it is computationally expensive,…

This work provides a Deep Reinforcement Learning approach to solving a periodic review inventory control system with stochastic vendor lead times, lost sales, correlated demand, and price matching. While this dynamic program has…

Machine Learning · Computer Science 2022-11-30 Dhruv Madeka , Kari Torkkola , Carson Eisenach , Anna Luo , Dean P. Foster , Sham M. Kakade

As machine learning has moved towards leveraging large models as priors for downstream tasks, the community has debated the right form of prior for solving reinforcement learning (RL) problems. If one were to try to prefetch as much…

Machine Learning · Computer Science 2026-02-13 Chongyi Zheng , Royina Karegoudra Jayanth , Benjamin Eysenbach

The rapid growth of ride-hailing platforms has created a highly competitive market where businesses struggle to make profits, demanding the need for better operational strategies. However, real-world experiments are risky and expensive for…

Machine Learning · Computer Science 2021-04-07 Haritha Jayasinghe , Tarindu Jayatilaka , Ravin Gunawardena , Uthayasanker Thayasivam