English
Related papers

Related papers: Deep Reinforcement Learning With Macro-Actions

200 papers

Mean field games (MFGs) have emerged as a powerful framework for modeling interactions in large-scale multi-agent systems. Despite recent advancements in reinforcement learning (RL) for MFGs, existing methods are typically limited to finite…

Machine Learning · Computer Science 2025-10-28 Lorenzo Magnino , Kai Shao , Zida Wu , Jiacheng Shen , Mathieu Laurière

Deep reinforcement learning (DRL) is applied in safety-critical domains such as robotics and autonomous driving. It achieves superhuman abilities in many tasks, however whether DRL agents can be shown to act safely is an open problem. Atari…

Artificial Intelligence · Computer Science 2021-01-25 Mirco Giacobbe , Mohammadhosein Hasanbeig , Daniel Kroening , Hjalmar Wijk

There has been a recent explosion in the capabilities of game-playing artificial intelligence. Many classes of tasks, from video games to motor control to board games, are now solvable by fairly generic algorithms, based on deep learning…

Artificial Intelligence · Computer Science 2018-10-18 Vlad Firoiu , Tina Ju , Josh Tenenbaum

A key challenge in model-based reinforcement learning (RL) is to synthesize computationally efficient and accurate environment models. We show that carefully designed generative models that learn and operate on compact state…

Explainable reinforcement learning allows artificial agents to explain their behavior in a human-like manner aiming at non-expert end-users. An efficient alternative of creating explanations is to use an introspection-based method that…

Machine Learning · Computer Science 2021-08-23 Angel Ayala , Francisco Cruz , Bruno Fernandes , Richard Dazeley

Deep Q-Network (DQN) marked a major milestone for reinforcement learning, demonstrating for the first time that human-level control policies could be learned directly from raw visual inputs via reward maximization. Even years after its…

Machine Learning · Computer Science 2021-11-03 Brett Daley , Christopher Amato

In real-world multi-robot systems, performing high-quality, collaborative behaviors requires robots to asynchronously reason about high-level action selection at varying time durations. Macro-Action Decentralized Partially Observable Markov…

Machine Learning · Computer Science 2021-10-19 Yuchen Xiao , Joshua Hoffman , Christopher Amato

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

Machine Learning · Computer Science 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Reinforcement learning (RL) research focuses on general solutions that can be applied across different domains. This results in methods that RL practitioners can use in almost any domain. However, recent studies often lack the engineering…

Machine Learning · Computer Science 2021-07-05 Anssi Kanervisto , Christian Scheller , Yanick Schraner , Ville Hautamäki

Despite the empirical success of the deep Q network (DQN) reinforcement learning algorithm and its variants, DQN is still not well understood and it does not guarantee convergence. In this work, we show that DQN can indeed diverge and cease…

Machine Learning · Computer Science 2022-05-04 Zhikang T. Wang , Masahito Ueda

Training intelligent agents through reinforcement learning is a notoriously unstable procedure. Massive parallelization on GPUs and distributed systems has been exploited to generate a large amount of training experiences and consequently…

Machine Learning · Computer Science 2019-02-08 Greg Heinrich , Iuri Frosio

In this study, we investigate the performance of Deep Q-Networks utilizing Convolutional Neural Networks (CNNs) and Transformer architectures across three different Atari games. The advent of DQNs has significantly advanced Reinforcement…

Machine Learning · Computer Science 2024-10-15 William A. Stigall

General game testing relies on the use of human play testers, play test scripting, and prior knowledge of areas of interest to produce relevant test data. Using deep reinforcement learning (DRL), we introduce a self-learning mechanism to…

Machine Learning · Computer Science 2021-03-31 Joakim Bergdahl , Camilo Gordillo , Konrad Tollmar , Linus Gisslén

In 2015, Google's DeepMind announced an advancement in creating an autonomous agent based on deep reinforcement learning (DRL) that could beat a professional player in a series of 49 Atari games. However, the current manifestation of DRL is…

Machine Learning · Computer Science 2019-07-30 Ngoc Duy Nguyen , Saeid Nahavandi , Thanh Nguyen

Despite significant advances in the field of deep Reinforcement Learning (RL), today's algorithms still fail to learn human-level policies consistently over a set of diverse tasks such as Atari 2600 games. We identify three key challenges…

Recent studies have shown that deep reinforcement learning (DRL) policies are vulnerable to adversarial attacks, which raise concerns about applications of DRL to safety-critical systems. In this work, we adopt a principled way and study…

Machine Learning · Computer Science 2022-05-17 Chao Wang

Transformers are neural network models that utilize multiple layers of self-attention heads and have exhibited enormous potential in natural language processing tasks. Meanwhile, there have been efforts to adapt transformers to visual tasks…

Machine Learning · Computer Science 2024-06-25 Li Meng , Morten Goodwin , Anis Yazidi , Paal Engelstad

Reinforcement learning (RL) has gained increasing interest since the demonstration it was able to reach human performance on video game benchmarks using deep Q-learning (DQN). The current consensus for training neural networks on such…

Machine Learning · Computer Science 2021-06-22 Luong Ha , Nguyen , James-A. Goulet

Visual attention serves as a means of feature selection mechanism in the perceptual system. Motivated by Broadbent's leaky filter model of selective attention, we evaluate how such mechanism could be implemented and affect the learning…

Machine Learning · Computer Science 2020-06-19 Liu Yuezhang , Ruohan Zhang , Dana H. Ballard

Auxiliary tasks improve the representations learned by deep reinforcement learning agents. Analytically, their effect is reasonably well understood; in practice, however, their primary use remains in support of a main learning objective,…