English
Related papers

Related papers: Automated Security Response through Online Learnin…

200 papers

Correlated equilibrium generalizes Nash equilibrium by allowing a central coordinator to guide players' actions through shared recommendations, similar to how routing apps guide drivers. We investigate how a coordinator can learn a…

Computer Science and Game Theory · Computer Science 2025-09-16 Zhenlong Fang , Aryan Deshwal , Yue Yu

We develop a queueing-theoretic framework to model the temporal evolution of cyber-attack surfaces, where the number of active vulnerabilities is represented as the backlog of a queue. Vulnerabilities arrive as they are discovered or…

Cryptography and Security · Computer Science 2026-04-17 Jihyeon Yun , Abdullah Yasin Etcibasi , Ming Shi , C. Emre Koksal

Offline reinforcement learning (RL) suffers from the distribution shift between the offline dataset and the online environment. In multi-agent RL (MARL), this distribution shift may arise from the nonstationary opponents in the online…

Machine Learning · Computer Science 2025-02-25 Tao Li , Juan Guevara , Xinhong Xie , Quanyan Zhu

Cyber-attacks can occur at machine speeds that are far too fast for human-in-the-loop (or sometimes on-the-loop) decision making to be a viable option. Although human inputs are still important, a defensive Artificial Intelligence (AI)…

Artificial Intelligence · Computer Science 2020-02-24 Lashon B. Booker , Scott A. Musman

Cybersecurity defense involves interactions between adversarial parties (namely defenders and hackers), making multi-agent reinforcement learning (MARL) an ideal approach for modeling and learning strategies for these scenarios. This paper…

Multiagent Systems · Computer Science 2025-09-03 Qintong Xie , Edward Koh , Xavier Cadet , Peter Chin

We propose an adaptive incentive mechanism that learns the optimal incentives in environments where players continuously update their strategies. Our mechanism updates incentives based on each player's externality, defined as the difference…

Computer Science and Game Theory · Computer Science 2025-03-04 Chinmay Maheshwari , Kshitij Kulkarni , Manxi Wu , Shankar Sastry

We introduce a game of trusted computation in which a sensor equipped with limited computing power leverages a central node to evaluate a specified function over a large dataset, collected over time. We assume that the central computer can…

Computer Science and Game Theory · Computer Science 2016-11-09 Shaunak D. Bopardikar , Alberto Speranzon , Cedric Langbort

Model-based offline reinforcement learning (RL), which builds a supervised transition model with logging dataset to avoid costly interactions with the online environment, has been a promising approach for offline policy optimization. As the…

Machine Learning · Computer Science 2023-09-06 Junming Yang , Xingguo Chen , Shengyuan Wang , Bolei Zhang

We study automated intrusion response and formulate the interaction between an attacker and a defender as an optimal stopping game where attack and defense strategies evolve through reinforcement learning and self-play. The game-theoretic…

Computer Science and Game Theory · Computer Science 2024-04-23 Kim Hammar , Rolf Stadler

The growing sophistication of contemporary cyber threats necessitates a more effective and adaptive approach to cybersecurity training. Intuitive and adaptive approaches to learning, which are often required, are not provided in traditional…

Computers and Society · Computer Science 2026-05-01 Mary Nusrat , Sarfuddin Bhuiyan , Gahangir Hossain

Offline learning of strategies takes data efficiency to its extreme by restricting algorithms to a fixed dataset of state-action trajectories. We consider the problem in a mixed-motive multiagent setting, where the goal is to solve a game…

Artificial Intelligence · Computer Science 2026-03-03 Austin A. Nguyen , Michael P. Wellman

Offline reinforcement learning, by learning from a fixed dataset, makes it possible to learn agent behaviors without interacting with the environment. However, depending on the quality of the offline dataset, such pre-trained agents may…

Machine Learning · Computer Science 2022-10-26 Yi Zhao , Rinu Boney , Alexander Ilin , Juho Kannala , Joni Pajarinen

The incremental diffusion of machine learning algorithms in supporting cybersecurity is creating novel defensive opportunities but also new types of risks. Multiple researches have shown that machine learning methods are vulnerable to…

Cryptography and Security · Computer Science 2021-06-18 Giovanni Apruzzese , Mauro Andreolini , Luca Ferretti , Mirco Marchetti , Michele Colajanni

This paper studies a strategic security problem in networked control systems under stealthy false data injection attacks. The security problem is modeled as a bilateral cognitive security game between a defender and an adversary, each…

Systems and Control · Electrical Eng. & Systems 2025-05-05 Anh Tung Nguyen , Quanyan Zhu , André Teixeira

Deception plays a critical role in many interactions in communication and network security. Game-theoretic models called "cheap talk signaling games" capture the dynamic and information asymmetric nature of deceptive interactions. But…

Cryptography and Security · Computer Science 2017-10-17 Jeffrey Pawlick , Quanyan Zhu

Modern power systems face increasing vulnerability to sophisticated cyber-physical attacks beyond traditional N-1 contingency frameworks. Existing security paradigms face a critical bottleneck: efficiently identifying worst-case scenarios…

Systems and Control · Electrical Eng. & Systems 2025-09-17 Saman Mazaheri Khamaneh , Tong Wu , Wei Sun , Cong Chen

Security challenges accompany the efficiency. The pervasive integration of information and communications technologies (ICTs) makes cyber-physical systems vulnerable to targeted attacks that are deceptive, persistent, adaptive and…

Computer Science and Game Theory · Computer Science 2018-09-11 Linan Huang , Quanyan Zhu

We believe that agents for automated incident response based on machine learning need to handle changes in network structure. Computer networks are dynamic, and can naturally change in structure over time. Retraining agents for small…

Artificial Intelligence · Computer Science 2024-07-09 Jakob Nyberg , Pontus Johnson

The capability of continuously learning new skills via a sequence of pre-collected offline datasets is desired for an agent. However, consecutively learning a sequence of offline tasks likely leads to the catastrophic forgetting issue under…

Machine Learning · Computer Science 2024-04-23 Sibo Gai , Donglin Wang , Li He

Humans and animals can learn complex predictive models that allow them to accurately and reliably reason about real-world phenomena, and they can adapt such models extremely quickly in the face of unexpected changes. Deep neural network…

Machine Learning · Computer Science 2019-01-30 Anusha Nagabandi , Chelsea Finn , Sergey Levine