English
Related papers

Related papers: Automated Adversary Emulation for Cyber-Physical S…

200 papers

Cyber-physical systems (CPSs) are naturally modelled as reactive systems with nondeterministic and probabilistic dynamics. Model-based verification techniques have proved effective in the deployment of safety-critical CPSs. Central for a…

Machine Learning · Computer Science 2021-10-08 Giovanni Bacci , Anna Ingólfsdóttir , Kim Larsen , Raphaël Reynouard

The Robust Markov Decision Process (RMDP) framework focuses on designing control policies that are robust against the parameter uncertainties due to the mismatches between the simulator model and real-world settings. An RMDP problem is…

Machine Learning · Computer Science 2022-05-17 Kishan Panaganti , Dileep Kalathil

RL-based medical questionnaire systems have shown great potential in medical scenarios. However, their safety and robustness remain unresolved. This study performs a comprehensive evaluation on adversarial attack methods to identify and…

Cryptography and Security · Computer Science 2025-08-11 Peizhuo Liu

Markov decision processes (MDPs) are a well studied framework for solving sequential decision making problems under uncertainty. Exact methods for solving MDPs based on dynamic programming such as policy iteration and value iteration are…

Artificial Intelligence · Computer Science 2015-09-09 Yanping Huang

Attacks in cyber-physical systems (CPS) which manipulate sensor readings can cause enormous physical damage if undetected. Detection of attacks on sensors is crucial to mitigate this issue. We study supervised regression as a means to…

Artificial Intelligence · Computer Science 2018-05-01 Amin Ghafouri , Yevgeniy Vorobeychik , Xenofon Koutsoukos

Safe reinforcement learning has been a promising approach for optimizing the policy of an agent that operates in safety-critical applications. In this paper, we propose an algorithm, SNO-MDP, that explores and optimizes Markov decision…

Machine Learning · Computer Science 2020-08-18 Akifumi Wachi , Yanan Sui

This paper studies the performance and resilience of a cyber-physical control system (CPCS) with attack detection and reactive attack mitigation. It addresses the problem of deriving an optimal sequence of false data injection attacks that…

Cryptography and Security · Computer Science 2017-06-07 Subhash Lakshminarayana , Teo Zhan Teng , David K. Y. Yau , Rui Tan

Building on previous work using reinforcement learning (RL) focused on identification of exfiltration paths, this work expands the methodology to include protocol and payload considerations. The former approach to exfiltration path…

Cryptography and Security · Computer Science 2023-10-06 Riddam Rishu , Akshay Kakkar , Cheng Wang , Abdul Rahman , Christopher Redino , Dhruv Nandakumar , Tyler Cody , Ryan Clark , Daniel Radke , Edward Bowen

Adversarial learning is one of the most successful approaches to modelling high-dimensional probability distributions from data. The quantum computing community has recently begun to generalize this idea and to look for potential…

Quantum Physics · Physics 2019-04-17 Marcello Benedetti , Edward Grant , Leonard Wossnig , Simone Severini

In this paper we design hybrid control policies for hybrid systems whose mathematical models are unknown. Our contributions are threefold. First, we propose a framework for modelling the hybrid control design problem as a single Markov…

Systems and Control · Electrical Eng. & Systems 2020-09-03 Meet Gandhi , Atreyee Kundu , Shalabh Bhatnagar

Development of autonomous cyber system defense strategies and action recommendations in the real-world is challenging, and includes characterizing system state uncertainties and attack-defense dynamics. We propose a data-driven deep…

Machine Learning · Computer Science 2023-02-06 Ashutosh Dutta , Samrat Chatterjee , Arnab Bhattacharya , Mahantesh Halappanavar

Although current deep learning techniques have yielded superior performance on various computer vision tasks, yet they are still vulnerable to adversarial examples. Adversarial training and its variants have been shown to be the most…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Junhao Dong , Seyed-Mohsen Moosavi-Dezfooli , Jianhuang Lai , Xiaohua Xie

Markov Decision Processes (MDPs), the mathematical framework underlying most algorithms in Reinforcement Learning (RL), are often used in a way that wrongfully assumes that the state of an agent's environment does not change during action…

Machine Learning · Computer Science 2019-12-13 Simon Ramstedt , Christopher Pal

Machine learning techniques are currently used extensively for automating various cybersecurity tasks. Most of these techniques utilize supervised learning algorithms that rely on training the algorithm to classify incoming data into…

Cryptography and Security · Computer Science 2019-12-06 Prithviraj Dasgupta , Joseph B. Collins

Online safe reinforcement learning (RL) plays a key role in dynamic environments, with applications in autonomous driving, robotics, and cybersecurity. The objective is to learn optimal policies that maximize rewards while satisfying safety…

Machine Learning · Computer Science 2025-06-03 Jiahui Zhu , Kihyun Yu , Dabeen Lee , Xin Liu , Honghao Wei

We pose an active perception problem where an autonomous agent actively interacts with a second agent with potentially adversarial behaviors. Given the uncertainty in the intent of the other agent, the objective is to collect further…

Artificial Intelligence · Computer Science 2019-09-20 Macheng Shen , Jonathan P How

Ensuring the robustness of deep reinforcement learning (DRL) agents against adversarial attacks is critical for their trustworthy deployment. Recent research highlights the challenges of achieving state-adversarial robustness and suggests…

Machine Learning · Computer Science 2025-02-25 Haoran Li , Zicheng Zhang , Wang Luo , Congying Han , Jiayu Lv , Tiande Guo , Yudong Hu

Machine learning is becoming increasingly popular as a go-to approach for many tasks due to its world-class results. As a result, antivirus developers are incorporating machine learning models into their products. While these models improve…

Cryptography and Security · Computer Science 2024-03-19 Matouš Kozák , Martin Jureček , Mark Stamp , Fabio Di Troia

Markov decision processes (MDPs) are used to model a wide variety of applications ranging from game playing over robotics to finance. Their optimal policy typically maximizes the expected sum of rewards given at each step of the decision…

Machine Learning · Computer Science 2025-05-26 Maximilian Nägele , Jan Olle , Thomas Fösel , Remmy Zen , Florian Marquardt

The robust constrained Markov decision process (RCMDP) is a recent task-modelling framework for reinforcement learning that incorporates behavioural constraints and that provides robustness to errors in the transition dynamics model through…

Machine Learning · Computer Science 2024-05-16 David M. Bossens