English
Related papers

Related papers: QFlip: An Adaptive Reinforcement Learning Strategy…

200 papers

Determining what experience to generate to best facilitate learning (i.e. exploration) is one of the distinguishing features and open challenges in reinforcement learning. The advent of distributed agents that interact with parallel…

Machine Learning · Computer Science 2019-12-17 Tom Schaul , Diana Borsa , David Ding , David Szepesvari , Georg Ostrovski , Will Dabney , Simon Osindero

Unseen shifts in environment dynamics, driven by hidden parameters such as friction or gravity, create a challenge for maintaining safety. We address this challenge by proposing Adaptive Shielding, a framework for safe reinforcement…

Machine Learning · Computer Science 2026-02-03 Minjae Kwon , Tyler Ingebrand , Ufuk Topcu , Lu Feng

Cyber-physical microgrids are vulnerable to rootkit attacks that manipulate system dynamics to create instabilities in the network. Rootkits tend to hide their access level within microgrid system components to launch sudden attacks that…

Cryptography and Security · Computer Science 2023-06-28 Suman Rath , Tapadhir Das , Shamik Sengupta

The growing sophistication of contemporary cyber threats necessitates a more effective and adaptive approach to cybersecurity training. Intuitive and adaptive approaches to learning, which are often required, are not provided in traditional…

Computers and Society · Computer Science 2026-05-01 Mary Nusrat , Sarfuddin Bhuiyan , Gahangir Hossain

Advanced persistent threat (APT) is a kind of stealthy, sophisticated, and long-term cyberattack that has brought severe financial losses and critical infrastructure damages. Existing works mainly focus on APT defense under stable network…

Computer Science and Game Theory · Computer Science 2023-09-04 Zixuan Wang , Jiliang Li , Yuntao Wang , Zhou Su , Shui Yu , Weizhi Meng

Advanced Persistent Threats (APTs) infiltrate cyber systems and compromise specifically targeted data and/or resources through a sequence of stealthy attacks consisting of multiple stages. Dynamic information flow tracking has been proposed…

Computer Science and Game Theory · Computer Science 2018-11-15 Shana Moothedath , Dinuka Sahabandu , Joey Allen , Andrew Clark , Linda Bushnell , Wenke Lee , Radha Poovendran

Federated Learning (FL) is a distributed learning paradigm that enables different parties to train a model together for high quality and strong privacy protection. In this scenario, individual participants may get compromised and perform…

Cryptography and Security · Computer Science 2023-03-01 Kaiyuan Zhang , Guanhong Tao , Qiuling Xu , Siyuan Cheng , Shengwei An , Yingqi Liu , Shiwei Feng , Guangyu Shen , Pin-Yu Chen , Shiqing Ma , Xiangyu Zhang

The growing complexity of cyber attacks has necessitated the evolution of firewall technologies from static models to adaptive, machine learning-driven systems. This research introduces "Dynamically Retrainable Firewalls", which respond to…

Cryptography and Security · Computer Science 2025-01-17 Sina Ahmadi

Advanced Persistent Threats (APTs) represent sophisticated cyberattacks characterized by their ability to remain undetected within the victim system for extended periods, aiming to exfiltrate sensitive data or disrupt operations. Existing…

Cryptography and Security · Computer Science 2025-07-18 Wei Qiao , Yebo Feng , Teng Li , Zhuo Ma , Yulong Shen , JianFeng Ma , Yang Liu

Deep Reinforcement Learning (DRL) has achieved remarkable success in complex sequential decision-making tasks, such as playing Atari 2600 games and mastering board games. A critical yet underexplored aspect of DRL is the temporal scale of…

Machine Learning · Computer Science 2025-07-02 Abhishek Verma , Nallarasan V , Balaraman Ravindran

Advanced Persistent Threat (APT) attackers apply multiple sophisticated methods to continuously and stealthily steal information from the targeted cloud storage systems and can even induce the storage system to apply a specific defense…

Cryptography and Security · Computer Science 2018-01-22 Minghui Min , Liang Xiao , Caixia Xie , Mohammad Hajimirsadeghi , Narayan B. Mandayam

The distributional perspective on reinforcement learning (RL) has given rise to a series of successful Q-learning algorithms, resulting in state-of-the-art performance in arcade game environments. However, it has not yet been analyzed how…

Robotics · Computer Science 2020-07-03 Cristian Bodnar , Adrian Li , Karol Hausman , Peter Pastor , Mrinal Kalakrishnan

This work presents the first finite-time analysis for the last-iterate convergence of average-reward $Q$-learning with an asynchronous implementation. A key feature of the algorithm we study is the use of adaptive stepsizes, which serve as…

Machine Learning · Computer Science 2026-04-07 Zaiwei Chen , Phalguni Nanda

Bandit-style algorithms have been studied extensively in stochastic and adversarial settings. Such algorithms have been shown to be useful in multiplayer settings, e.g. to solve the wireless network selection problem, which can be…

Networking and Internet Architecture · Computer Science 2019-04-30 Shunhao Oh , Anuja Meetoo Appavoo , Seth Gilbert

We present a method to automatically find security strategies for the use case of intrusion prevention. Following this method, we model the interaction between an attacker and a defender as a Markov game and let attack and defense…

Machine Learning · Computer Science 2024-04-23 Kim Hammar , Rolf Stadler

Online learning algorithms that minimize regret provide strong guarantees in situations that involve repeatedly making decisions in an uncertain environment, e.g. a driver deciding what route to drive to work every day. While regret…

Computer Science and Game Theory · Computer Science 2013-09-06 Jeremiah Blocki , Nicolas Christin , Anupam Datta , Arunesh Sinha

The recent advancement in real-world critical infrastructure networks has led to an exponential growth in the use of automated devices which in turn has created new security challenges. In this paper, we study the robust and adaptive…

Computer Science and Game Theory · Computer Science 2020-11-10 Supriyo Ghosh , Patrick Jaillet

Federated learning (FL) is susceptible to a range of security threats. Although various defense mechanisms have been proposed, they are typically non-adaptive and tailored to specific types of attacks, leaving them insufficient in the face…

Machine Learning · Computer Science 2024-10-24 Tao Li , Henger Li , Yunian Pan , Tianyi Xu , Zizhan Zheng , Quanyan Zhu

The increasing adoption of Reinforcement Learning in safety-critical systems domains such as autonomous vehicles, health, and aviation raises the need for ensuring their safety. Existing safety mechanisms such as adversarial training,…

Machine Learning · Computer Science 2021-11-11 Paulina Stevia Nouwou Mindom , Amin Nikanjam , Foutse Khomh , John Mullins

We study learning in a dynamically evolving environment modeled as a Markov game between a learner and a strategic opponent that can adapt to the learner's strategies. While most existing works in Markov games focus on external regret as…

Machine Learning · Computer Science 2024-12-11 Thanh Nguyen-Tang , Raman Arora