English
Related papers

Related papers: CybORG: An Autonomous Cyber Operations Research Gy…

200 papers

Autonomous Cyber Operations (ACO) involves the development of blue team (defender) and red team (attacker) decision-making agents in adversarial scenarios. To support the application of machine learning algorithms to solve this problem, and…

Cryptography and Security · Computer Science 2021-08-23 Maxwell Standen , Martin Lucas , David Bowman , Toby J. Richer , Junae Kim , Damian Marriott

Autonomous Cyber Operations (ACO) rely on Reinforcement Learning (RL) to train agents to make effective decisions in the cybersecurity domain. However, existing ACO applications require agents to learn from scratch, leading to slow…

Machine Learning · Computer Science 2025-08-21 Konur Tholl , Mariam El Mezouar , Ranwa Al Mallah

Simulated environments have proven invaluable in Autonomous Cyber Operations (ACO) where Reinforcement Learning (RL) agents can be trained without the computational overhead of emulation. These environments must accurately represent…

Cryptography and Security · Computer Science 2026-02-17 Konur Tholl , Mariam El Mezouar , Adrian Taylor , Ranwa Al Mallah

CybORG++ is an advanced toolkit for reinforcement learning research focused on network defence. Building on the CAGE 2 CybORG environment, it introduces key improvements, including enhanced debugging capabilities, refined agent…

Cryptography and Security · Computer Science 2024-10-23 Harry Emerson , Liz Bates , Chris Hicks , Vasilios Mavroudis

Within recent times, cybercriminals have curated a variety of organised and resolute cyber attacks within a range of cyber systems, leading to consequential ramifications to private and governmental institutions. Current security-based…

Cryptography and Security · Computer Science 2023-03-10 Sanyam Vyas , John Hannay , Andrew Bolton , Professor Pete Burnap

Recently, reinforcement and deep reinforcement learning (RL/DRL) have been applied to develop autonomous agents for cyber network operations(CyOps), where the agents are trained in a representative environment using RL and particularly DRL…

Cryptography and Security · Computer Science 2023-09-12 Li Li , Jean-Pierre S. El Rami , Ryan Kerr , Adrian Taylor , Grant Vandenberghe

This work aims to enable autonomous agents for network cyber operations (CyOps) by applying reinforcement and deep reinforcement learning (RL/DRL). The required RL training environment is particularly challenging, as it must balance the…

Artificial Intelligence · Computer Science 2023-04-05 Li Li , Jean-Pierre S. El Rami , Adrian Taylor , James Hailing Rao , Thomas Kunz

Autonomous Cyber Defence is required to respond to high-tempo cyber-attacks. To facilitate the research in this challenging area, we explore the utility of the autonomous cyber operation environments presented as part of the Cyber Autonomy…

Cryptography and Security · Computer Science 2023-09-15 Mitchell Kiely , David Bowman , Maxwell Standen , Christopher Moir

Given the success of reinforcement learning (RL) in various domains, it is promising to explore the application of its methods to the development of intelligent and autonomous cyber agents. Enabling this development requires a…

Cryptography and Security · Computer Science 2021-09-09 Li Li , Raed Fayad , Adrian Taylor

This paper addresses a significant gap in Autonomous Cyber Operations (ACO) literature: the absence of effective edge-blocking ACO strategies in dynamic, real-world networks. It specifically targets the cybersecurity vulnerabilities of…

Cryptography and Security · Computer Science 2024-07-01 Diksha Goel , Kristen Moore , Mingyu Guo , Derui Wang , Minjune Kim , Seyit Camtepe

Autonomous cyber agents may be developed by applying reinforcement and deep reinforcement learning (RL/DRL), where agents are trained in a representative environment. The training environment must simulate with high-fidelity the network…

Machine Learning · Computer Science 2023-04-05 Li Li , Jean-Pierre S. El Rami , Adrian Taylor , James Hailing Rao , Thomas Kunz

Advanced Persistent Threats (APTs) bring significant challenges to cybersecurity due to their sophisticated and stealthy nature. Traditional cybersecurity measures fail to defend against APTs. Cognitive vulnerabilities can significantly…

Cryptography and Security · Computer Science 2024-08-14 Shuo Huang , Fred Jones , Nikolos Gurney , David Pynadath , Kunal Srivastava , Stoney Trent , Peggy Wu , Quanyan Zhu

Popular methods in cooperative Multi-Agent Reinforcement Learning with partially observable environments typically allow agents to act independently during execution, which may limit the coordinated effect of the trained policies. However,…

Multiagent Systems · Computer Science 2025-07-22 Faizan Contractor , Li Li , Ranwa Al Mallah

Cyber ranges are virtual training ranges that have emerged as indispensable environments for conducting secure exercises and simulating real or hypothetical scenarios. These complex computational infrastructures enable the simulation of…

Cryptography and Security · Computer Science 2023-12-29 Federica Bianchi , Enrico Bassetti , Angelo Spognardi

In this paper we explore cyber security defence, through the unification of a novel cyber security simulator with models for (causal) decision-making through optimisation. Particular attention is paid to a recently published approach:…

Cryptography and Security · Computer Science 2022-08-08 Alex Andrew , Sam Spillard , Joshua Collyer , Neil Dhir

We introduce a novel cybersecurity encounter simulator between a network defender and an attacker designed to facilitate game-theoretic modeling and analysis while maintaining many significant features of real cyber defense. Our simulator,…

Cryptography and Security · Computer Science 2025-09-15 Michael Lanier , Yevgeniy Vorobeychik

Reinforcement Learning (RL) has shown great potential for autonomous decision-making in the cybersecurity domain, enabling agents to learn through direct environment interaction. However, RL agents in Autonomous Cyber Operations (ACO)…

Cryptography and Security · Computer Science 2026-02-17 Konur Tholl , François Rivest , Mariam El Mezouar , Adrian Taylor , Ranwa Al Mallah

Reinforcement learning techniques are being explored as solutions to the threat of cyber attacks on enterprise networks. Recent research in the field of AI in cyber security has investigated the ability of homogeneous multi-agent…

Cryptography and Security · Computer Science 2026-03-24 Alex Popa , Adrian Taylor , Ranwa Al Mallah

The recent rise in increasingly sophisticated cyber-attacks raises the need for robust and resilient autonomous cyber-defence (ACD) agents. Given the variety of cyber-attack tactics, techniques and procedures (TTPs) employed, learning…

Artificial Intelligence · Computer Science 2025-02-03 Gregory Palmer , Luke Swaby , Daniel J. B. Harrold , Matthew Stewart , Alex Hiles , Chris Willis , Ian Miles , Sara Farmer

Computer network defence is a complicated task that has necessitated a high degree of human involvement. However, with recent advancements in machine learning, fully autonomous network defence is becoming increasingly plausible. This paper…

Cryptography and Security · Computer Science 2023-06-16 Myles Foley , Mia Wang , Zoe M , Chris Hicks , Vasilios Mavroudis
‹ Prev 1 2 3 10 Next ›