English
Related papers

Related papers: Contingency-Aware Exploration in Reinforcement Lea…

200 papers

Autonomous vehicles inevitably encounter a vast array of scenarios in real-world environments. Addressing long-tail scenarios, particularly those involving intensive interactions with numerous traffic participants, remains one of the most…

Robotics · Computer Science 2024-12-16 Guanzhou Li , Jianping Wu , Yujing He

Real-world multi-agent tasks usually involve dynamic team composition with the emergence of roles, which should also be a key to efficient cooperation in multi-agent reinforcement learning (MARL). Drawing inspiration from the correlation…

Multiagent Systems · Computer Science 2024-03-05 Zican Hu , Zongzhang Zhang , Huaxiong Li , Chunlin Chen , Hongyu Ding , Zhi Wang

The infamous exploration-exploitation dilemma is one of the oldest and most important problems in reinforcement learning (RL). Deliberate and effective exploration is necessary for RL agents to succeed in most environments. However, until…

Artificial Intelligence · Computer Science 2017-10-09 Suraj Narayanan Sasikumar

Achieving cooperation among self-interested agents remains a fundamental challenge in multi-agent reinforcement learning. Recent work showed that mutual cooperation can be induced between "learning-aware" agents that account for and shape…

We consider a class of reinforcement-learning systems in which the agent follows a behavior policy to explore a discrete state-action space to find an optimal policy while adhering to some restriction on its behavior. Such restriction may…

Machine Learning · Computer Science 2023-04-07 Peter C. Y. Chen

Recent studies have demonstrated that reinforcement learning (RL) agents are susceptible to adversarial manipulation, similar to vulnerabilities previously demonstrated in the supervised learning setting. While most existing work studies…

Active learning from demonstration allows a robot to query a human for specific types of input to achieve efficient learning. Existing work has explored a variety of active query strategies; however, to our knowledge, none of these…

Machine Learning · Computer Science 2019-06-05 Daniel S. Brown , Yuchen Cui , Scott Niekum

Text-based games are a natural challenge domain for deep reinforcement learning algorithms. Their state and action spaces are combinatorially large, their reward function is sparse, and they are partially observable: the agent is informed…

Artificial Intelligence · Computer Science 2019-12-02 Vishal Jain , William Fedus , Hugo Larochelle , Doina Precup , Marc G. Bellemare

Reinforcement learning algorithms struggle when the reward signal is very sparse. In these cases, naive random exploration methods essentially rely on a random walk to stumble onto a rewarding state. Recent works utilize intrinsic…

Machine Learning · Computer Science 2019-06-14 Hyoungseok Kim , Jaekyeom Kim , Yeonwoo Jeong , Sergey Levine , Hyun Oh Song

Reinforcement Learning (RL) has been widely used in many applications, particularly in gaming, which serves as an excellent training ground for AI models. Google DeepMind has pioneered innovations in this field, employing reinforcement…

Artificial Intelligence · Computer Science 2026-02-12 Abdelrhman Shaheen , Anas Badr , Ali Abohendy , Hatem Alsaadawy , Nadine Alsayad , Ehab H. El-Shazly

Intelligent decision-making within large and redundant action spaces remains challenging in deep reinforcement learning. Considering similar but ineffective actions at each step can lead to repetitive and unproductive trials. Existing…

Machine Learning · Computer Science 2025-01-27 Wenzhang Liu , Lianjun Jin , Lu Ren , Chaoxu Mu , Changyin Sun

Exploration is a difficult challenge in reinforcement learning and even recent state-of-the art curiosity-based methods rely on the simple epsilon-greedy strategy to generate novelty. We argue that pure random walks do not succeed to…

Machine Learning · Computer Science 2018-07-06 Fabio Pardo , Vitaly Levdik , Petar Kormushev

Real-world applications of reinforcement learning often involve environments where agents operate on complex, high-dimensional observations, but the underlying (''latent'') dynamics are comparatively simple. However, outside of restrictive…

Machine Learning · Computer Science 2024-10-24 Philip Amortila , Dylan J. Foster , Nan Jiang , Akshay Krishnamurthy , Zakaria Mhammedi

Unmanned vehicles able to conduct advanced operations without human intervention are being developed at a fast pace for many purposes. Not surprisingly, they are also expected to significantly change how military operations can be…

Cryptography and Security · Computer Science 2024-10-30 Henrik Madsen , Gudmund Grov , Federico Mancini , Magnus Baksaas , Åvald Åslaugson Sommervoll

From out-competing grandmasters in chess to informing high-stakes healthcare decisions, emerging methods from artificial intelligence are increasingly capable of making complex and strategic decisions in diverse, high-dimensional, and…

Computers and Society · Computer Science 2024-03-05 Melissa Chapman , Lily Xu , Marcus Lapeyrolerie , Carl Boettiger

In complex tasks, such as those with large combinatorial action spaces, random exploration may be too inefficient to achieve meaningful learning progress. In this work, we use a curriculum of progressively growing action spaces to…

Machine Learning · Computer Science 2019-07-01 Gregory Farquhar , Laura Gustafson , Zeming Lin , Shimon Whiteson , Nicolas Usunier , Gabriel Synnaeve

Extensive research demonstrates that Deep Reinforcement Learning (DRL) models are susceptible to adversarially constructed inputs (i.e., adversarial examples), which can mislead the agent to take suboptimal or unsafe actions. Recent methods…

Machine Learning · Computer Science 2026-02-24 Shenghong He

Multi-agent reinforcement learning has shown promise in learning cooperative behaviors in team-based environments. However, such methods often demand extensive training time. For instance, the state-of-the-art method TiZero takes 40 days to…

Machine Learning · Computer Science 2025-03-18 Amir Baghi , Jens Sjölund , Joakim Bergdahl , Linus Gisslén , Alessandro Sestini

In reinforcement learning, an agent interacts sequentially with an environment to maximize a reward, receiving only partial, probabilistic feedback. This creates a fundamental exploration-exploitation trade-off: the agent must explore to…

Quantum Physics · Physics 2026-03-27 Josep Lumbreras , Ruo Cheng Huang , Yanglin Hu , Marco Fanizza , Mile Gu

In recent years, deep reinforcement learning has been shown to be adept at solving sequential decision processes with high-dimensional state spaces such as in the Atari games. Many reinforcement learning problems, however, involve…

Machine Learning · Computer Science 2018-06-05 Yiming Zhang , Quan Ho Vuong , Kenny Song , Xiao-Yue Gong , Keith W. Ross