English
Related papers

Related papers: A Markov Decision Process Model for Intrusion Tole…

200 papers

With the proliferation of LLM-integrated applications such as GPT-s, millions are deployed, offering valuable services through proprietary instruction prompts. These systems, however, are prone to prompt extraction attacks through…

Cryptography and Security · Computer Science 2024-10-29 Junlin Wang , Tianyi Yang , Roy Xie , Bhuwan Dhingra

Large language models have seen widespread adoption, yet they remain vulnerable to multi-turn jailbreak attacks, threatening their safe deployment. This has led to the task of training automated multi-turn attackers to probe model safety…

Artificial Intelligence · Computer Science 2026-04-22 Xiqiao Xiong , Ouxiang Li , Zhuo Liu , Moxin Li , Wentao Shi , Fengbin Zhu , Qifan Wang , Fuli Feng

The deployment of control systems with network-connected components has made feedback control systems vulnerable to attacks over the network. This paper considers the problem of intrusion detection and mitigation in supervisory control…

Formal Languages and Automata Theory · Computer Science 2018-07-16 Lilian Kawakami Carvalho , Yi-Chin Wu , Raymond Kwong , Stéphane Lafortune

The routing protocol for low-power and lossy networks (RPL) has become the de facto routing standard for resource-constrained IoT systems, but its lightweight design exposes critical vulnerabilities to a wide range of routing-layer attacks…

Cryptography and Security · Computer Science 2026-03-24 Sumeyye Bas , Kiymet Kaya , Elif Ak , Sule Gunduz Oguducu

An ideal strategy in zero-sum games should not only grant the player an average reward no less than the value of Nash equilibrium, but also exploit the (adaptive) opponents when they are suboptimal. While most existing works in Markov games…

Machine Learning · Computer Science 2022-06-15 Qinghua Liu , Yuanhao Wang , Chi Jin

Constrained Markov decision processes (CMDPs) model scenarios of sequential decision making with multiple objectives that are increasingly important in many applications. However, the model is often unknown and must be learned online while…

Machine Learning · Computer Science 2023-01-30 Krishna C Kalagarla , Rahul Jain , Pierluigi Nuzzo

This paper addresses a mathematically tractable model of the Prisoner's Dilemma using the framework of active inference. In this work, we design pairs of Bayesian agents that are tracking the joint game state of their and their opponent's…

Physics and Society · Physics 2023-08-31 Daphne Demekas , Conor Heins , Brennan Klein

The design of safe-critical control algorithms for systems under Denial-of-Service (DoS) attacks on the system output is studied in this work. We aim to address scenarios where attack-mitigation approaches are not feasible, and the system…

Systems and Control · Electrical Eng. & Systems 2023-11-14 Santiago Jimenez Leudo , Kunal Garg , Ricardo G. Sanfelice , Alvaro A. Cardenas

We develop a Markov decision process (MDP) framework to autonomously make guidance decisions for satellite collision avoidance maneuver (CAM) and a reinforcement learning policy gradient (RL-PG) algorithm to enable direct optimization of…

Machine Learning · Computer Science 2025-12-12 Francesca Ferrara , Lander W. Schillinger Arana , Florian Dörfler , Sarah H. Q. Li

Penetration testing is an essential means of proactive defense in the face of escalating cybersecurity incidents. Traditional manual penetration testing methods are time-consuming, resource-intensive, and prone to human errors. Current…

Cryptography and Security · Computer Science 2024-09-24 Yunfei Ge , Quanyan Zhu

Intrusion detection is a long standing and crucial problem in security. A system capable of detecting intrusions automatically is on great demand in enterprise security solutions. Existing solutions rely heavily on hand-crafted rules…

Cryptography and Security · Computer Science 2024-04-23 Jiongliang Lin , Yiwen Guo , Hao Chen

Intention deception involves computing a strategy which deceives the opponent into a wrong belief about the agent's intention or objective. This paper studies a class of probabilistic planning problems with intention deception and…

Computer Science and Game Theory · Computer Science 2022-09-02 Jie Fu

Motivated by many application problems, we consider Markov decision processes (MDPs) with a general loss function and unknown parameters. To mitigate the epistemic uncertainty associated with unknown parameters, we take a Bayesian approach…

Machine Learning · Computer Science 2025-10-02 Xiaoshuang Wang , Yifan Lin , Enlu Zhou

We consider the challenge of finding a deterministic policy for a Markov decision process that uniformly (in all states) maximizes one reward subject to a probabilistic constraint over a different reward. Existing solutions do not fully…

Machine Learning · Computer Science 2022-01-21 Jaeyoung Lee , Sean Sedwards , Krzysztof Czarnecki

This paper is devoted to solving a time-inconsistent risk-sensitive control problem with parameter $\e$ and its limit case ($\e\rightarrow0^+$) for countable-stated Markov decision processes (MDPs for short). Since the cost functional is…

Optimization and Control · Mathematics 2020-10-22 Hongwei Mei

Parallel server systems in transportation, manufacturing, and computing heavily rely on dynamic routing using connected cyber components for computation and communication. Yet, these components remain vulnerable to random malfunctions and…

Systems and Control · Electrical Eng. & Systems 2023-08-22 Qian Xie , Jiayi Wang , Li Jin

Planning problems where effects of actions are non-deterministic can be modeled as Markov decision processes. Planning problems are usually goal-directed. This paper proposes several techniques for exploiting the goal-directedness to…

Artificial Intelligence · Computer Science 2013-02-08 Nevin Lianwen Zhang , Weihong Zhang

A comprehensive approach to addressing catastrophic risks from AI models should cover the full model lifecycle. This paper explores contingency plans for cases where pre-deployment risk management falls short: where either very dangerous…

Computers and Society · Computer Science 2023-10-03 Joe O'Brien , Shaun Ee , Zoe Williams

Games of timing aim to determine the optimal defense against a strategic attacker who has the technical capability to breach a system in a stealthy fashion. Key questions arising are when the attack takes place, and when a defensive move…

Cryptography and Security · Computer Science 2017-06-08 Sadegh Farhang , Jens Grossklags

In this paper we consider the problem of how a reinforcement learning agent tasked with solving a set of related Markov decision processes can use knowledge acquired early in its lifetime to improve its ability to more rapidly solve novel,…

Artificial Intelligence · Computer Science 2019-02-26 Francisco M. Garcia , Bruno C. da Silva , Philip S. Thomas