English
Related papers

Related papers: Decorrelated Soft Actor-Critic for Efficient Deep …

200 papers

To perform well, Deep Reinforcement Learning (DRL) methods require significant memory resources and computational time. Also, sometimes these systems need additional environment information to achieve a good reward. However, it is more…

Artificial Intelligence · Computer Science 2023-01-31 Md. Rafat Rahman Tushar , Shahnewaz Siddique

Low-precision training has become a popular approach to reduce compute requirements, memory footprint, and energy consumption in supervised learning. In contrast, this promising approach has not yet enjoyed similarly widespread adoption…

Machine Learning · Computer Science 2021-06-07 Johan Bjorck , Xiangyu Chen , Christopher De Sa , Carla P. Gomes , Kilian Q. Weinberger

The Soft Actor-Critic (SAC) algorithm, a state-of-the-art method in maximum entropy reinforcement learning, traditionally relies on minimizing reverse Kullback-Leibler (KL) divergence for policy updates. However, this approach leads to an…

Machine Learning · Computer Science 2025-06-03 Yixian Zhang , Huaze Tang , Changxu Wei , Wenbo Ding

Modern offline Reinforcement Learning (RL) methods find performant actor-critics, however, fine-tuning these actor-critics online with value-based RL algorithms typically causes immediate drops in performance. We provide evidence consistent…

Machine Learning · Computer Science 2026-03-02 Nathan Samuel de Lara , Florian Shkurti

Deep reinforcement learning methods have shown great performance on many challenging cooperative multi-agent tasks. Two main promising research directions are multi-agent value function decomposition and multi-agent policy gradients. In…

Artificial Intelligence · Computer Science 2021-05-11 Yuan Pu , Shaochen Wang , Rui Yang , Xin Yao , Bin Li

Model-free deep reinforcement learning (RL) algorithms have been demonstrated on a range of challenging decision making and control tasks. However, these methods typically suffer from two major challenges: very high sample complexity and…

Machine Learning · Computer Science 2018-08-10 Tuomas Haarnoja , Aurick Zhou , Pieter Abbeel , Sergey Levine

Intrusion detection systems (IDS) generate a large number of false alerts which makes it difficult to inspect true positives. Hence, alert prioritization plays a crucial role in deciding which alerts to investigate from an enormous number…

Cryptography and Security · Computer Science 2022-08-04 Lalitha Chavali , Tanay Gupta , Paresh Saxena

Deep reinforcement learning (deep RL) has achieved superior performance in complex sequential tasks by using deep neural networks as function approximators to learn directly from raw input images. However, learning directly from raw images…

Machine Learning · Computer Science 2019-07-31 Gabriel V. de la Cruz , Yunshu Du , Matthew E. Taylor

This paper implements deep reinforcement learning (DRL) for spacecraft reorientation control with a single pointing keep-out zone. The Soft Actor-Critic (SAC) algorithm is adopted to handle continuous state and action space. A new state…

Systems and Control · Electrical Eng. & Systems 2025-11-19 Juntang Yang , Mohamed Khalil Ben-Larbi

In the domain of continuous control, deep reinforcement learning (DRL) demonstrates promising results. However, the dependence of DRL on deep neural networks (DNNs) results in the demand for extensive data and increased computational cost.…

Machine Learning · Computer Science 2025-04-15 Shiron Thalagala , Pak Kin Wong , Xiaozheng Wang , Tianang Sun

Deep reinforcement learning (DRL) algorithms have successfully been demonstrated on a range of challenging decision making and control tasks. One dominant component of recent deep reinforcement learning algorithms is the target network…

Machine Learning · Computer Science 2020-11-12 Lin Shao , Yifan You , Mengyuan Yan , Qingyun Sun , Jeannette Bohg

Credit assignment is a fundamental problem in reinforcement learning, the problem of measuring an action's influence on future rewards. Explicit credit assignment methods have the potential to boost the performance of RL algorithms on many…

Machine Learning · Computer Science 2022-02-15 Vyacheslav Alipov , Riley Simmons-Edler , Nikita Putintsev , Pavel Kalinin , Dmitry Vetrov

Recent advances in deep reinforcement learning have achieved impressive results in a wide range of complex tasks, but poor sample efficiency remains a major obstacle to real-world deployment. Soft actor-critic (SAC) mitigates this problem…

Machine Learning · Computer Science 2024-09-10 Luca Della Libera

This paper presents an actor-critic deep reinforcement learning agent with experience replay that is stable, sample efficient, and performs remarkably well on challenging environments, including the discrete 57-game Atari domain and several…

Machine Learning · Computer Science 2017-07-11 Ziyu Wang , Victor Bapst , Nicolas Heess , Volodymyr Mnih , Remi Munos , Koray Kavukcuoglu , Nando de Freitas

Robust Reinforcement Learning aims to derive optimal behavior that accounts for model uncertainty in dynamical systems. However, previous studies have shown that by considering the worst case scenario, robust policies can be overly…

Machine Learning · Computer Science 2018-10-25 Esther Derman , Daniel J. Mankowitz , Timothy A. Mann , Shie Mannor

Text-based games are a popular testbed for language-based reinforcement learning (RL). In previous work, deep Q-learning is commonly used as the learning agent. Q-learning algorithms are challenging to apply to complex real-world domains…

Machine Learning · Computer Science 2023-06-28 Weichen Li , Rati Devidze , Sophie Fellenz

Autonomous driving with reinforcement learning (RL) has significant potential. However, applying RL in real-world settings remains challenging due to the need for safe, efficient, and robust learning. Incorporating human expertise into the…

Machine Learning · Computer Science 2025-10-08 Li Zeqiao , Wang Yijing , Wang Haoyu , Li Zheng , Li Peng , Liu Wenfei , Zuo Zhiqiang

Merging into the highway from the on-ramp is an essential scenario for automated driving. The decision-making under the scenario needs to balance the safety and efficiency performance to optimize a long-term objective, which is challenging…

Robotics · Computer Science 2021-03-09 Yiting Kong , Yang Guan , Jingliang Duan , Shengbo Eben Li , Qi Sun , Bingbing Nie

Most prior approaches to offline reinforcement learning (RL) utilize \textit{behavior regularization}, typically augmenting existing off-policy actor critic algorithms with a penalty measuring divergence between the policy and the offline…

Machine Learning · Computer Science 2021-10-15 Haoran Xu , Xianyuan Zhan , Jianxiong Li , Honglei Yin

Deep Reinforcement Learning (RL) has emerged as a powerful method for addressing complex control problems, particularly those involving underactuated robotic systems. However, in some cases, policies may require refinement to achieve…

Robotics · Computer Science 2025-07-15 Marco Calì , Alberto Sinigaglia , Niccolò Turcato , Ruggero Carli , Gian Antonio Susto