English
Related papers

Related papers: On Autonomous Agents in a Cyber Defence Environmen…

200 papers

Popular methods in cooperative Multi-Agent Reinforcement Learning with partially observable environments typically allow agents to act independently during execution, which may limit the coordinated effect of the trained policies. However,…

Multiagent Systems · Computer Science 2025-07-22 Faizan Contractor , Li Li , Ranwa Al Mallah

Fast and effective incident response is essential to prevent adversarial cyberattacks. Autonomous Cyber Defense (ACD) aims to automate incident response through Artificial Intelligence (AI) agents that plan and execute actions. Most ACD…

Artificial Intelligence · Computer Science 2025-07-22 Sebastián R. Castro , Roberto Campbell , Nancy Lau , Octavio Villalobos , Jiaqi Duan , Alvaro A. Cardenas

Penetration testing the organised attack of a computer system in order to test existing defences has been used extensively to evaluate network security. This is a time consuming process and requires in-depth knowledge for the establishment…

Artificial Intelligence · Computer Science 2021-09-15 Khuong Tran , Ashlesha Akella , Maxwell Standen , Junae Kim , David Bowman , Toby Richer , Chin-Teng Lin

Many real-world applications can be formulated as multi-agent cooperation problems, such as network packet routing and coordination of autonomous vehicles. The emergence of deep reinforcement learning (DRL) provides a promising approach for…

Multiagent Systems · Computer Science 2022-06-28 Zhixuan Liang , Jiannong Cao , Shan Jiang , Divya Saxena , Huafeng Xu

From denial-of-service attacks to spreading of ransomware or other malware across an organization's network, it is possible that manually operated defenses are not able to respond in real time at the scale required, and when a breach is…

Cryptography and Security · Computer Science 2022-01-28 Alexandre K. Ligo , Alexander Kott , Igor Linkov

Reinforcement learning (RL) enables agents to learn optimal behaviors through interaction with their environment and has been increasingly deployed in safety-critical applications, including autonomous driving. Despite its promise, RL is…

We analyze two open source deep reinforcement learning agents submitted to the CAGE Challenge 2 cyber defense challenge, where each competitor submitted an agent to defend a simulated network against each of several provided rules-based…

Cryptography and Security · Computer Science 2025-06-11 Jared Claypoole , Steven Cheung , Ashish Gehani , Vinod Yegneswaran , Ahmad Ridley

This paper focuses on the impact of leveraging autonomous offensive approaches in Deep Reinforcement Learning (DRL) to train more robust agents by exploring the impact of applying adversarial learning to DRL for autonomous security in…

Cryptography and Security · Computer Science 2023-08-15 Luke Borchjes , Clement Nyirenda , Louise Leenen

We implemented and evaluated an automated cyber defense agent. The agent takes security alerts as input and uses reinforcement learning to learn a policy for executing predefined defensive measures. The defender policies were trained in an…

Cryptography and Security · Computer Science 2023-04-24 Jakob Nyberg , Pontus Johnson

Deep Reinforcement Learning (DRL) is a subfield of machine learning for training autonomous agents that take sequential actions across complex environments. Despite its significant performance in well-known environments, it remains…

Autonomous Cyber Operations (ACO) involves the development of blue team (defender) and red team (attacker) decision-making agents in adversarial scenarios. To support the application of machine learning algorithms to solve this problem, and…

Cryptography and Security · Computer Science 2021-08-23 Maxwell Standen , Martin Lucas , David Bowman , Toby J. Richer , Junae Kim , Damian Marriott

Recent years have seen an explosion of interest in autonomous cyber defence agents trained to defend computer networks using deep reinforcement learning. These agents are typically trained in cyber gym environments using dense, highly…

Machine Learning · Computer Science 2026-02-13 Elizabeth Bates , Chris Hicks , Vasilios Mavroudis

This paper addresses a significant gap in Autonomous Cyber Operations (ACO) literature: the absence of effective edge-blocking ACO strategies in dynamic, real-world networks. It specifically targets the cybersecurity vulnerabilities of…

Cryptography and Security · Computer Science 2024-07-01 Diksha Goel , Kristen Moore , Mingyu Guo , Derui Wang , Minjune Kim , Seyit Camtepe

Given the success of reinforcement learning (RL) in various domains, it is promising to explore the application of its methods to the development of intelligent and autonomous cyber agents. Enabling this development requires a…

Cryptography and Security · Computer Science 2021-09-09 Li Li , Raed Fayad , Adrian Taylor

Defending computer networks from cyber attack requires timely responses to alerts and threat intelligence. Decisions about how to respond involve coordinating actions across multiple nodes based on imperfect indicators of compromise while…

Cryptography and Security · Computer Science 2021-11-05 John Mern , Kyle Hatch , Ryan Silva , Cameron Hickert , Tamim Sookoor , Mykel J. Kochenderfer

Recent advances in multi-agent reinforcement learning (MARL) have created opportunities to solve complex real-world tasks. Cybersecurity is a notable application area, where defending networks against sophisticated adversaries remains a…

Machine Learning · Computer Science 2025-09-08 Aditya Vikram Singh , Ethan Rathbun , Emma Graham , Lisa Oakley , Simona Boboila , Alina Oprea , Peter Chin

Autonomous Cyber Operations (ACO) involves the consideration of blue team (defender) and red team (attacker) decision-making models in adversarial scenarios. To support the application of machine learning algorithms to solve this problem,…

Cryptography and Security · Computer Science 2020-02-27 Callum Baillie , Maxwell Standen , Jonathon Schwartz , Michael Docking , David Bowman , Junae Kim

Recent studies have shown that deep reinforcement learning (DRL) policies are vulnerable to adversarial attacks, which raise concerns about applications of DRL to safety-critical systems. In this work, we adopt a principled way and study…

Machine Learning · Computer Science 2022-05-17 Chao Wang

Since deep neural networks' resurgence, reinforcement learning has gradually strengthened and surpassed humans in many conventional games. However, it is not easy to copy these accomplishments to autonomous driving because state spaces are…

Robotics · Computer Science 2023-02-14 B. Udugama

Simulated environments have proven invaluable in Autonomous Cyber Operations (ACO) where Reinforcement Learning (RL) agents can be trained without the computational overhead of emulation. These environments must accurately represent…

Cryptography and Security · Computer Science 2026-02-17 Konur Tholl , Mariam El Mezouar , Adrian Taylor , Ranwa Al Mallah