English
Related papers

Related papers: SAC-AP: Soft Actor Critic based Deep Reinforcement…

200 papers

The Dynamic Task Assignment Problem (DTAP) concerns matching resources to tasks in real time while minimizing some objectives, like resource costs or task cycle time. In this work, we consider a DTAP variant where every task is a case…

Artificial Intelligence · Computer Science 2025-04-29 Riccardo Lo Bianco , Willem van Jaarsveld , Jeroen Middelhuis , Luca Begnardi , Remco Dijkman

Multi-agent control problems constitute an interesting area of application for deep reinforcement learning models with continuous action spaces. Such real-world applications, however, typically come with critical safety constraints that…

Machine Learning · Computer Science 2021-08-12 Ziyad Sheebaelhamd , Konstantinos Zisis , Athina Nisioti , Dimitris Gkouletsos , Dario Pavllo , Jonas Kohler

Deep reinforcement learning (DRL) is vulnerable to adversarial perturbations. Adversaries can mislead the policies of DRL agents by perturbing the state of the environment observed by the agents. Existing attacks are feasible in principle,…

Machine Learning · Computer Science 2022-09-26 Buse G. A. Tekgul , Shelly Wang , Samuel Marchal , N. Asokan

Actor learning and critic learning are two components of the outstanding and mostly used Deep Deterministic Policy Gradient (DDPG) reinforcement learning method. Since actor and critic learning plays a significant role in the overall…

Robotics · Computer Science 2022-10-25 Adarsh Sehgal , Muskan Sehgal , Hung Manh La

The Space-Air-Ground Integrated Network (SAGIN) plays a pivotal role as a comprehensive foundational network communication infrastructure, presenting opportunities for highly efficient global data transmission. Nonetheless, given SAGIN's…

Networking and Internet Architecture · Computer Science 2024-07-19 Yeguang Qin , Yilin Yang , Fengxiao Tang , Xin Yao , Ming Zhao , Nei Kato

Soft Actor-Critic algorithm is widely recognized for its robust performance across a range of deep reinforcement learning tasks, where it leverages the tanh transformation to constrain actions within bounded limits. However, this…

Machine Learning · Computer Science 2025-04-23 Yanjun Chen , Xinming Zhang , Xianghui Wang , Zhiqiang Xu , Xiaoyu Shen , Wei Zhang

This paper investigates the threat of backdoors in Deep Reinforcement Learning (DRL) agent policies and proposes a novel method for their detection at runtime. Our study focuses on elusive in-distribution backdoor triggers. Such triggers…

Machine Learning · Computer Science 2024-07-23 Sanyam Vyas , Chris Hicks , Vasilios Mavroudis

Action-constrained reinforcement learning (ACRL) is a popular approach for solving safety-critical and resource-allocation related decision making problems. A major challenge in ACRL is to ensure agent taking a valid action satisfying…

Machine Learning · Computer Science 2024-02-09 Janaka Chathuranga Brahmanage , Jiajing Ling , Akshat Kumar

In this paper, we propose a max-min entropy framework for reinforcement learning (RL) to overcome the limitation of the soft actor-critic (SAC) algorithm implementing the maximum entropy RL in model-free sample-based learning. Whereas the…

Machine Learning · Computer Science 2021-12-21 Seungyul Han , Youngchul Sung

Deep Reinforcement Learning (DRL) has been extensively used to address portfolio optimization problems. The DRL agents acquire knowledge and make decisions through unsupervised interactions with their environment without requiring explicit…

Machine Learning · Computer Science 2025-01-14 Ruoyu Sun , Yue Xi , Angelos Stefanidis , Zhengyong Jiang , Jionglong Su

The exploration mechanism used by a Deep Reinforcement Learning (RL) agent plays a key role in determining its sample efficiency. Thus, improving over random exploration is crucial to solve long-horizon tasks with sparse rewards. We propose…

Machine Learning · Computer Science 2019-12-17 Andrey Kurenkov , Ajay Mandlekar , Roberto Martin-Martin , Silvio Savarese , Animesh Garg

The recent rise in increasingly sophisticated cyber-attacks raises the need for robust and resilient autonomous cyber-defence (ACD) agents. Given the variety of cyber-attack tactics, techniques and procedures (TTPs) employed, learning…

Artificial Intelligence · Computer Science 2025-02-03 Gregory Palmer , Luke Swaby , Daniel J. B. Harrold , Matthew Stewart , Alex Hiles , Chris Willis , Ian Miles , Sara Farmer

The Soft Actor-Critic (SAC) algorithm, a state-of-the-art method in maximum entropy reinforcement learning, traditionally relies on minimizing reverse Kullback-Leibler (KL) divergence for policy updates. However, this approach leads to an…

Machine Learning · Computer Science 2025-06-03 Yixian Zhang , Huaze Tang , Changxu Wei , Wenbo Ding

Offline reinforcement learning (RL) learns policies from fixed datasets without online interactions, but suffers from distribution shift, causing inaccurate evaluation and overestimation of out-of-distribution (OOD) actions. Existing…

Machine Learning · Computer Science 2025-10-07 Xuyang Chen , Keyu Yan , Wenhan Cao , Lin Zhao

We discuss the problem of decentralized multi-agent reinforcement learning (MARL) in this work. In our setting, the global state, action, and reward are assumed to be fully observable, while the local policy is protected as privacy by each…

Multiagent Systems · Computer Science 2021-11-02 Kuo Li , Qing-Shan Jia

This paper implements deep reinforcement learning (DRL) with a safety filter for spacecraft reorientation control with a single pointing keep-out zone. A new state space representation is designed which includes a compact representation of…

Systems and Control · Electrical Eng. & Systems 2026-05-20 Juntang Yang , Mohamed Khalil Ben-Larbi

Inverse reinforcement learning (IRL) and dynamic discrete choice (DDC) models explain sequential decision-making by recovering reward functions that rationalize observed behavior. Flexible IRL methods typically rely on machine learning but…

Machine Learning · Computer Science 2026-01-01 Lars van der Laan , Aurelien Bibaut , Nathan Kallus

The oscillating performance of off-policy learning and persisting errors in the actor-critic (AC) setting call for algorithms that can conservatively learn to suit the stability-critical applications better. In this paper, we propose a…

Machine Learning · Computer Science 2021-10-06 Lingwei Zhu , Toshinori Kitamura , Takamitsu Matsubara

Recent advances in deep Reinforcement Learning (RL) have created unprecedented opportunities for intelligent automation, where a machine can autonomously learn an optimal policy for performing a given task. However, current deep RL…

Machine Learning · Computer Science 2021-05-27 Zohreh Raziei , Mohsen Moghaddam

Deep reinforcement learning (DRL) has become a powerful tool for complex decision-making in machine learning and AI. However, traditional methods often assume perfect action execution, overlooking the uncertainties and deviations between an…

Robotics · Computer Science 2025-07-02 Oren Fivel , Matan Rudman , Kobi Cohen