English
Related papers

Related papers: Reinforcement Learning under Threats

200 papers

Markov Decision Processes (MDPs), the mathematical framework underlying most algorithms in Reinforcement Learning (RL), are often used in a way that wrongfully assumes that the state of an agent's environment does not change during action…

Machine Learning · Computer Science 2019-12-13 Simon Ramstedt , Christopher Pal

Reinforcement learning (RL) has gained increasing attraction in the academia and tech industry with launches to a variety of impactful applications and products. Although research is being actively conducted on many fronts (e.g., offline…

Machine Learning · Computer Science 2021-12-13 Ruiyang Xu , Zhengxing Chen

We present the problem of reinforcement learning with exogenous termination. We define the Termination Markov Decision Process (TerMDP), an extension of the MDP framework, in which episodes may be interrupted by an external non-Markovian…

Machine Learning · Computer Science 2023-10-09 Guy Tennenholtz , Nadav Merlis , Lior Shani , Shie Mannor , Uri Shalit , Gal Chechik , Assaf Hallak , Gal Dalal

Practical reinforcement learning problems are often formulated as constrained Markov decision process (CMDP) problems, in which the agent has to maximize the expected return while satisfying a set of prescribed safety constraints. In this…

Machine Learning · Computer Science 2019-09-23 Shin-ichi Maeda , Hayato Watahiki , Shintarou Okada , Masanori Koyama

Reinforcement Learning (RL) agents are increasingly used to simulate sophisticated cyberattacks, but their decision-making processes remain opaque, hindering trust, debugging, and defensive preparedness. In high-stakes cybersecurity…

Cryptography and Security · Computer Science 2026-05-18 Diksha Goel , Kristen Moore , Jeff Wang , Minjune Kim , Thanh Thi Nguyen

Reinforcement Learning (RL) algorithms have led to recent successes in solving complex games, such as Atari or Starcraft, and to a huge impact in real-world applications, such as cybersecurity or autonomous driving. In the side of the…

Machine Learning · Computer Science 2021-02-15 Rubén Majadas , Javier García , Fernando Fernández

We study multi-task reinforcement learning (RL) in tabular episodic Markov decision processes (MDPs). We formulate a heterogeneous multi-player RL problem, in which a group of players concurrently face similar but not necessarily identical…

Machine Learning · Computer Science 2022-01-19 Chicheng Zhang , Zhi Wang

The multi-agent reinforcement learning systems (MARL) based on the Markov decision process (MDP) have emerged in many critical applications. To improve the robustness/defense of MARL systems against adversarial attacks, the study of various…

Multiagent Systems · Computer Science 2024-02-01 Ziqing Lu , Guanlin Liu , Lifeng Lai , Weiyu Xu

Much research has been done to analyze the stock market. After all, if one can determine a pattern in the chaotic frenzy of transactions, then they could make a hefty profit from capitalizing on these insights. As such, the goal of our…

Machine Learning · Computer Science 2025-05-27 Ziyi Zhou , Nicholas Stern , Julien Laasri

Due to limited resources and public safety concerns, deep reinforcement learning (RL) agents for many cyber-physical systems (e.g., autonomous vehicles) are first trained in simulators. However, when deployed in real world environments,…

Machine Learning · Computer Science 2026-05-28 Gengyue Han , Yiheng Feng

Reinforcement learning (RL) has achieved remarkable success in fields like robotics and autonomous driving, but adversarial attacks designed to mislead RL systems remain challenging. Existing approaches often rely on modifying the…

Machine Learning · Computer Science 2025-07-25 Junyong Jiang , Buwei Tian , Chenxing Xu , Songze Li , Lu Dong

Reactive synthesis algorithms allow automatic construction of policies to control an environment modeled as a Markov Decision Process (MDP) that are optimal with respect to high-level temporal logic specifications. However, they assume that…

Formal Languages and Automata Theory · Computer Science 2022-05-31 Rajeev Alur , Suguman Bansal , Osbert Bastani , Kishor Jothimurugan

We study a security threat to reinforcement learning where an attacker poisons the learning environment to force the agent into executing a target policy chosen by the attacker. As a victim, we consider RL agents whose objective is to find…

Machine Learning · Computer Science 2020-11-24 Amin Rakhsha , Goran Radanovic , Rati Devidze , Xiaojin Zhu , Adish Singla

Strategic mining attacks, such as selfish mining, exploit blockchain consensus protocols by deviating from honest behavior to maximize rewards. Markov Decision Process (MDP) analysis faces scalability challenges in modern digital economics,…

Machine Learning · Computer Science 2025-02-26 Jichen Li , Lijia Xie , Hanting Huang , Bo Zhou , Binfeng Song , Wanying Zeng , Xiaotie Deng , Xiao Zhang

Recent years have seen a rise in interest in terms of using machine learning, particularly reinforcement learning (RL), for production scheduling problems of varying degrees of complexity. The general approach is to break down the…

Machine Learning · Computer Science 2023-02-16 Alexandru Rinciog , Anne Meyer

Sequential decision making, commonly formalized as optimization of a Markov Decision Process, is a key challenge in artificial intelligence. Two successful approaches to MDP optimization are reinforcement learning and planning, which both…

Machine Learning · Computer Science 2022-04-01 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

Function approximation has enabled remarkable advances in applying reinforcement learning (RL) techniques in environments with high-dimensional inputs, such as images, in an end-to-end fashion, mapping such inputs directly to low-level…

Machine Learning · Computer Science 2023-01-02 Junlin Wu , Hussein Sibai , Yevgeniy Vorobeychik

Reinforcement Learning (RL) is a learning paradigm concerned with learning to control a system so as to maximize an objective over the long term. This approach to learning has received immense interest in recent times and success manifests…

Artificial Intelligence · Computer Science 2018-07-26 Sanyam Kapoor

Due to the proliferation of renewable energy and its intrinsic intermittency and stochasticity, current power systems face severe operational challenges. Data-driven decision-making algorithms from reinforcement learning (RL) offer a…

Systems and Control · Electrical Eng. & Systems 2021-10-20 Alexander Pan , Yongkyun Lee , Huan Zhang , Yize Chen , Yuanyuan Shi

Average-reward Markov decision processes (MDPs) provide a foundational framework for sequential decision-making under uncertainty. However, average-reward MDPs have remained largely unexplored in reinforcement learning (RL) settings, with…

Machine Learning · Computer Science 2025-08-29 Juan Sebastian Rojas , Chi-Guhn Lee