English
Related papers

Related papers: Towards Production-Worthy Simulation for Autonomou…

200 papers

Autonomous Cyber Operations (ACO) rely on Reinforcement Learning (RL) to train agents to make effective decisions in the cybersecurity domain. However, existing ACO applications require agents to learn from scratch, leading to slow…

Machine Learning · Computer Science 2025-08-21 Konur Tholl , Mariam El Mezouar , Ranwa Al Mallah

Autonomous Cyber Operations (ACO) involves the development of blue team (defender) and red team (attacker) decision-making agents in adversarial scenarios. To support the application of machine learning algorithms to solve this problem, and…

Cryptography and Security · Computer Science 2021-08-23 Maxwell Standen , Martin Lucas , David Bowman , Toby J. Richer , Junae Kim , Damian Marriott

Given the success of reinforcement learning (RL) in various domains, it is promising to explore the application of its methods to the development of intelligent and autonomous cyber agents. Enabling this development requires a…

Cryptography and Security · Computer Science 2021-09-09 Li Li , Raed Fayad , Adrian Taylor

CybORG++ is an advanced toolkit for reinforcement learning research focused on network defence. Building on the CAGE 2 CybORG environment, it introduces key improvements, including enhanced debugging capabilities, refined agent…

Cryptography and Security · Computer Science 2024-10-23 Harry Emerson , Liz Bates , Chris Hicks , Vasilios Mavroudis

Autonomous Cyber Operations (ACO) involves the consideration of blue team (defender) and red team (attacker) decision-making models in adversarial scenarios. To support the application of machine learning algorithms to solve this problem,…

Cryptography and Security · Computer Science 2020-02-27 Callum Baillie , Maxwell Standen , Jonathon Schwartz , Michael Docking , David Bowman , Junae Kim

Autonomous cyber agents may be developed by applying reinforcement and deep reinforcement learning (RL/DRL), where agents are trained in a representative environment. The training environment must simulate with high-fidelity the network…

Machine Learning · Computer Science 2023-04-05 Li Li , Jean-Pierre S. El Rami , Adrian Taylor , James Hailing Rao , Thomas Kunz

Recently, reinforcement and deep reinforcement learning (RL/DRL) have been applied to develop autonomous agents for cyber network operations(CyOps), where the agents are trained in a representative environment using RL and particularly DRL…

Cryptography and Security · Computer Science 2023-09-12 Li Li , Jean-Pierre S. El Rami , Ryan Kerr , Adrian Taylor , Grant Vandenberghe

This work aims to enable autonomous agents for network cyber operations (CyOps) by applying reinforcement and deep reinforcement learning (RL/DRL). The required RL training environment is particularly challenging, as it must balance the…

Artificial Intelligence · Computer Science 2023-04-05 Li Li , Jean-Pierre S. El Rami , Adrian Taylor , James Hailing Rao , Thomas Kunz

Advancements in reinforcement learning (RL) have inspired new directions in intelligent automation of network defense. However, many of these advancements have either outpaced their application to network security or have not considered the…

Reinforcement learning (RL) agents need to explore their environments in order to learn optimal policies. In many environments and tasks, safety is of critical importance. The widespread use of simulators offers a number of advantages,…

Robotics · Computer Science 2024-03-01 Luka Kovač , Igor Farkaš

Unmanned vehicles able to conduct advanced operations without human intervention are being developed at a fast pace for many purposes. Not surprisingly, they are also expected to significantly change how military operations can be…

Cryptography and Security · Computer Science 2024-10-30 Henrik Madsen , Gudmund Grov , Federico Mancini , Magnus Baksaas , Åvald Åslaugson Sommervoll

Reinforcement Learning (RL) has shown great potential for autonomous decision-making in the cybersecurity domain, enabling agents to learn through direct environment interaction. However, RL agents in Autonomous Cyber Operations (ACO)…

Cryptography and Security · Computer Science 2026-02-17 Konur Tholl , François Rivest , Mariam El Mezouar , Adrian Taylor , Ranwa Al Mallah

Reinforcement learning (RL) has been demonstrated suitable to develop agents that play complex games with human-level performance. However, it is not understood how to effectively use RL to perform cybersecurity tasks. To develop such…

Cryptography and Security · Computer Science 2021-03-16 Andres Molina-Markham , Cory Miniter , Becky Powell , Ahmad Ridley

Integrating LLM and reinforcement learning (RL) agent effectively to achieve complementary performance is critical in high stake tasks like cybersecurity operations. In this study, we introduce SecurityBot, a LLM agent mentored by…

Cryptography and Security · Computer Science 2024-03-27 Yikuan Yan , Yaolun Zhang , Keman Huang

Reinforcement learning techniques are being explored as solutions to the threat of cyber attacks on enterprise networks. Recent research in the field of AI in cyber security has investigated the ability of homogeneous multi-agent…

Cryptography and Security · Computer Science 2026-03-24 Alex Popa , Adrian Taylor , Ranwa Al Mallah

Reinforcement learning (RL) is attracting increasing interests in autonomous driving due to its potential to solve complex classification and control problems. However, existing RL algorithms are rarely applied to real vehicles for two…

Machine Learning · Computer Science 2020-03-04 Lu Wen , Jingliang Duan , Shengbo Eben Li , Shaobing Xu , Huei Peng

Autonomous Cyber Defence is required to respond to high-tempo cyber-attacks. To facilitate the research in this challenging area, we explore the utility of the autonomous cyber operation environments presented as part of the Cyber Autonomy…

Cryptography and Security · Computer Science 2023-09-15 Mitchell Kiely , David Bowman , Maxwell Standen , Christopher Moir

While reinforcement learning (RL) can empower autonomous agents by enabling self-improvement through interaction, its practical adoption remains challenging due to costly rollouts, limited task diversity, unreliable reward signals, and…

Continual learning (CL) is a branch of machine learning that aims to enable agents to adapt and generalise previously learned abilities so that these can be reapplied to new tasks or environments. This is particularly useful in multi-task…

Machine Learning · Computer Science 2025-11-20 Kim N. Nolle , Ivana Dusparic , Rhodri Cusack , Vinny Cahill

We analyze two open source deep reinforcement learning agents submitted to the CAGE Challenge 2 cyber defense challenge, where each competitor submitted an agent to defend a simulated network against each of several provided rules-based…

Cryptography and Security · Computer Science 2025-06-11 Jared Claypoole , Steven Cheung , Ashish Gehani , Vinod Yegneswaran , Ahmad Ridley
‹ Prev 1 2 3 10 Next ›