English
Related papers

Related papers: Using Cyber Terrain in Reinforcement Learning for …

200 papers

Robotic insertion tasks are characterized by contact and friction mechanics, making them challenging for conventional feedback control methods due to unmodeled physical effects. Reinforcement learning (RL) is a promising approach for…

Machine Learning · Computer Science 2020-05-26 Gerrit Schoettler , Ashvin Nair , Juan Aparicio Ojea , Sergey Levine , Eugen Solowjow

The last few years have seen an explosion of interest in autonomous cyber defence agents based on deep reinforcement learning. Such agents are typically trained in a cyber gym environment, also known as a cyber simulator, at least 32 of…

Machine Learning · Computer Science 2025-03-11 Elizabeth Bates , Chris Hicks , Vasilios Mavroudis

Development of autonomous cyber system defense strategies and action recommendations in the real-world is challenging, and includes characterizing system state uncertainties and attack-defense dynamics. We propose a data-driven deep…

Machine Learning · Computer Science 2023-02-06 Ashutosh Dutta , Samrat Chatterjee , Arnab Bhattacharya , Mahantesh Halappanavar

Autonomous Cyber Operations (ACO) rely on Reinforcement Learning (RL) to train agents to make effective decisions in the cybersecurity domain. However, existing ACO applications require agents to learn from scratch, leading to slow…

Machine Learning · Computer Science 2025-08-21 Konur Tholl , Mariam El Mezouar , Ranwa Al Mallah

Decision-making tasks often unfold on graphs with spatial-temporal dynamics. Black-box reinforcement learning often overlooks how local changes spread through network structure, limiting sample efficiency and interpretability. We present…

Artificial Intelligence · Computer Science 2026-01-07 Hadi Partovi Aria , Zhe Xu

Due to the proliferation of renewable energy and its intrinsic intermittency and stochasticity, current power systems face severe operational challenges. Data-driven decision-making algorithms from reinforcement learning (RL) offer a…

Systems and Control · Electrical Eng. & Systems 2021-10-20 Alexander Pan , Yongkyun Lee , Huan Zhang , Yize Chen , Yuanyuan Shi

Accurately predicting road networks from satellite images requires a global understanding of the network topology. We propose to capture such high-level information by introducing a graph-based framework that simulates the addition of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Sotiris Anagnostidis , Aurelien Lucchi , Thomas Hofmann

Machine learning (ML)-based network intrusion detection is susceptible to attacks that perturb malicious network flows to evade detection. Existing approaches to evaluating the robustness of these models rely on gradient-based optimization…

Cryptography and Security · Computer Science 2026-05-15 Kyle Domico , Jean-Charles Noirot Ferrand , Patrick McDaniel

Deep reinforcement learning achieves superhuman performance in a range of video game environments, but requires that a designer manually specify a reward function. It is often easier to provide demonstrations of a target behavior than to…

Machine Learning · Computer Science 2018-10-26 Aaron Tucker , Adam Gleave , Stuart Russell

The increasing share of renewable energy and distributed electricity generation requires the development of deep learning approaches to address the lack of flexibility inherent in traditional power grid methods. In this context, Graph…

Machine Learning · Computer Science 2026-01-08 Mohamed Hassouna , Clara Holzhüter , Pawel Lytaev , Josephine Thomas , Bernhard Sick , Christoph Scholz

Graph Neural Networks (GNNs) have become the backbone for a myriad of tasks pertaining to graphs and similar topological data structures. While many works have been established in domains related to node and graph classification/regression…

Machine Learning · Computer Science 2022-09-07 Appan Rakaraddi , Siew Kei Lam , Mahardhika Pratama , Marcus De Carvalho

Machine Learning (ML) algorithms have become increasingly popular for supporting Network Intrusion Detection Systems (NIDS). Nevertheless, extensive research has shown their vulnerability to adversarial attacks, which involve subtle…

Cryptography and Security · Computer Science 2024-04-24 Andrea Venturi , Dario Stabili , Mirco Marchetti

Deep reinforcement learning (RL) policies can demonstrate unsafe behaviors and are challenging to interpret. To address these challenges, we combine RL policy model checking--a technique for determining whether RL policies exhibit unsafe…

Artificial Intelligence · Computer Science 2025-01-07 Dennis Gross , Helge Spieker

Intrusion Detection Systems (IDS) play a crucial role in ensuring the security of computer networks. Machine learning has emerged as a popular approach for intrusion detection due to its ability to analyze and detect patterns in large…

Cryptography and Security · Computer Science 2024-07-09 Amine Tellache , Amdjed Mokhtari , Abdelaziz Amara Korba , Yacine Ghamri-Doudane

In this work we start walking the path to a new perspective for viewing cyberwarfare scenarios, by introducing conceptual tools (a formal model) to evaluate the costs of an attack, to describe the theater of operations, targets, missions,…

Cryptography and Security · Computer Science 2010-06-11 Ariel Futoransky , Luciano Notarfrancesco , Gerardo Richarte , Carlos Sarraute

This paper presents a review of the field of reinforcement learning (RL), with a focus on providing a comprehensive overview of the key concepts, techniques, and algorithms for beginners. RL has a unique setting, jargon, and mathematics…

Machine Learning · Computer Science 2023-04-04 Mohamed-Amine Chadi , Hajar Mousannif

Machine learning techniques are gaining attention in the context of intrusion detection due to the increasing amounts of data generated by monitoring tools, as well as the sophistication displayed by attackers in hiding their activity.…

Cryptography and Security · Computer Science 2023-08-25 Josep Soler Garrido , Dominik Dold , Johannes Frank

This paper presents a holistic approach to attacker preference modeling from system-level audit logs using inverse reinforcement learning (IRL). Adversary modeling is an important capability in cybersecurity that lets defenders characterize…

Cryptography and Security · Computer Science 2025-05-08 Aditya Shinde , Prashant Doshi

Attack graphs are a powerful tool for security risk assessment by analysing network vulnerabilities and the paths attackers can use to compromise network resources. The uncertainty about the attacker's behaviour makes Bayesian networks…

Cryptography and Security · Computer Science 2016-11-07 Luis Muñoz-González , Daniele Sgandurra , Martín Barrère , Emil Lupu

Adoption of machine learning (ML)-enabled cyber-physical systems (CPS) are becoming prevalent in various sectors of modern society such as transportation, industrial, and power grids. Recent studies in deep reinforcement learning (DRL) have…

Machine Learning · Computer Science 2020-07-15 Kai Liang Tan , Yasaman Esfandiari , Xian Yeow Lee , Aakanksha , Soumik Sarkar