English
Related papers

Related papers: CybORG: A Gym for the Development of Autonomous Cy…

200 papers

Autonomous Cyber Operations (ACO) involves the consideration of blue team (defender) and red team (attacker) decision-making models in adversarial scenarios. To support the application of machine learning algorithms to solve this problem,…

Cryptography and Security · Computer Science 2020-02-27 Callum Baillie , Maxwell Standen , Jonathon Schwartz , Michael Docking , David Bowman , Junae Kim

Simulated environments have proven invaluable in Autonomous Cyber Operations (ACO) where Reinforcement Learning (RL) agents can be trained without the computational overhead of emulation. These environments must accurately represent…

Cryptography and Security · Computer Science 2026-02-17 Konur Tholl , Mariam El Mezouar , Adrian Taylor , Ranwa Al Mallah

CybORG++ is an advanced toolkit for reinforcement learning research focused on network defence. Building on the CAGE 2 CybORG environment, it introduces key improvements, including enhanced debugging capabilities, refined agent…

Cryptography and Security · Computer Science 2024-10-23 Harry Emerson , Liz Bates , Chris Hicks , Vasilios Mavroudis

Autonomous Cyber Operations (ACO) rely on Reinforcement Learning (RL) to train agents to make effective decisions in the cybersecurity domain. However, existing ACO applications require agents to learn from scratch, leading to slow…

Machine Learning · Computer Science 2025-08-21 Konur Tholl , Mariam El Mezouar , Ranwa Al Mallah

Recently, reinforcement and deep reinforcement learning (RL/DRL) have been applied to develop autonomous agents for cyber network operations(CyOps), where the agents are trained in a representative environment using RL and particularly DRL…

Cryptography and Security · Computer Science 2023-09-12 Li Li , Jean-Pierre S. El Rami , Ryan Kerr , Adrian Taylor , Grant Vandenberghe

This work aims to enable autonomous agents for network cyber operations (CyOps) by applying reinforcement and deep reinforcement learning (RL/DRL). The required RL training environment is particularly challenging, as it must balance the…

Artificial Intelligence · Computer Science 2023-04-05 Li Li , Jean-Pierre S. El Rami , Adrian Taylor , James Hailing Rao , Thomas Kunz

Within recent times, cybercriminals have curated a variety of organised and resolute cyber attacks within a range of cyber systems, leading to consequential ramifications to private and governmental institutions. Current security-based…

Cryptography and Security · Computer Science 2023-03-10 Sanyam Vyas , John Hannay , Andrew Bolton , Professor Pete Burnap

Given the success of reinforcement learning (RL) in various domains, it is promising to explore the application of its methods to the development of intelligent and autonomous cyber agents. Enabling this development requires a…

Cryptography and Security · Computer Science 2021-09-09 Li Li , Raed Fayad , Adrian Taylor

Autonomous cyber agents may be developed by applying reinforcement and deep reinforcement learning (RL/DRL), where agents are trained in a representative environment. The training environment must simulate with high-fidelity the network…

Machine Learning · Computer Science 2023-04-05 Li Li , Jean-Pierre S. El Rami , Adrian Taylor , James Hailing Rao , Thomas Kunz

Autonomous Cyber Defence is required to respond to high-tempo cyber-attacks. To facilitate the research in this challenging area, we explore the utility of the autonomous cyber operation environments presented as part of the Cyber Autonomy…

Cryptography and Security · Computer Science 2023-09-15 Mitchell Kiely , David Bowman , Maxwell Standen , Christopher Moir

Reinforcement learning techniques are being explored as solutions to the threat of cyber attacks on enterprise networks. Recent research in the field of AI in cyber security has investigated the ability of homogeneous multi-agent…

Cryptography and Security · Computer Science 2026-03-24 Alex Popa , Adrian Taylor , Ranwa Al Mallah

Popular methods in cooperative Multi-Agent Reinforcement Learning with partially observable environments typically allow agents to act independently during execution, which may limit the coordinated effect of the trained policies. However,…

Multiagent Systems · Computer Science 2025-07-22 Faizan Contractor , Li Li , Ranwa Al Mallah

In this paper we explore cyber security defence, through the unification of a novel cyber security simulator with models for (causal) decision-making through optimisation. Particular attention is paid to a recently published approach:…

Cryptography and Security · Computer Science 2022-08-08 Alex Andrew , Sam Spillard , Joshua Collyer , Neil Dhir

Hardening cyber physical assets is both crucial and labor-intensive. Recently, Machine Learning (ML) in general and Reinforcement Learning RL) more specifically has shown great promise to automate tasks that otherwise would require…

Cryptography and Security · Computer Science 2023-04-24 Thomas Kunz , Christian Fisher , James La Novara-Gsell , Christopher Nguyen , Li Li

Cyber ranges are virtual training ranges that have emerged as indispensable environments for conducting secure exercises and simulating real or hypothetical scenarios. These complex computational infrastructures enable the simulation of…

Cryptography and Security · Computer Science 2023-12-29 Federica Bianchi , Enrico Bassetti , Angelo Spognardi

We introduce a novel cybersecurity encounter simulator between a network defender and an attacker designed to facilitate game-theoretic modeling and analysis while maintaining many significant features of real cyber defense. Our simulator,…

Cryptography and Security · Computer Science 2025-09-15 Michael Lanier , Yevgeniy Vorobeychik

Fast and effective incident response is essential to prevent adversarial cyberattacks. Autonomous Cyber Defense (ACD) aims to automate incident response through Artificial Intelligence (AI) agents that plan and execute actions. Most ACD…

Artificial Intelligence · Computer Science 2025-07-22 Sebastián R. Castro , Roberto Campbell , Nancy Lau , Octavio Villalobos , Jiaqi Duan , Alvaro A. Cardenas

Advanced Persistent Threats (APTs) bring significant challenges to cybersecurity due to their sophisticated and stealthy nature. Traditional cybersecurity measures fail to defend against APTs. Cognitive vulnerabilities can significantly…

Cryptography and Security · Computer Science 2024-08-14 Shuo Huang , Fred Jones , Nikolos Gurney , David Pynadath , Kunal Srivastava , Stoney Trent , Peggy Wu , Quanyan Zhu

This paper addresses a significant gap in Autonomous Cyber Operations (ACO) literature: the absence of effective edge-blocking ACO strategies in dynamic, real-world networks. It specifically targets the cybersecurity vulnerabilities of…

Cryptography and Security · Computer Science 2024-07-01 Diksha Goel , Kristen Moore , Mingyu Guo , Derui Wang , Minjune Kim , Seyit Camtepe

An ever increasing number of battlefield devices that are capable of collecting, processing, storing, and communicating information are rapidly becoming interconnected. The staggering number of connected devices on the battlefield greatly…

Cryptography and Security · Computer Science 2019-05-15 Michael J. De Lucia , Allison Newcomb , Alexander Kott
‹ Prev 1 2 3 10 Next ›