English
Related papers

Related papers: Actor-Critic-Based Learning for Zero-touch Joint R…

200 papers

Model-free deep reinforcement learning (RL) algorithms have achieved tremendous success on a range of challenging tasks. However, safety concerns remain when these methods are deployed on real-world applications, necessitating risk-aware…

Machine Learning · Computer Science 2026-02-10 Alonso Granados , Jason Pacheco

Distributed decision-making in multi-agent systems presents difficult challenges for interactive behavior learning in both cooperative and competitive systems. To mitigate this complexity, MAIDRL presents a semi-centralized Dense…

Artificial Intelligence · Computer Science 2024-02-13 Ayesha Siddika Nipu , Siming Liu , Anthony Harris

Soft Actor-Critic (SAC) is an off-policy actor-critic reinforcement learning algorithm, essentially based on entropy regularization. SAC trains a policy by maximizing the trade-off between expected return and entropy (randomness in the…

Machine Learning · Computer Science 2021-09-27 Chayan Banerjee , Zhiyong Chen , Nasimul Noman

Stochastic gradient descent (SGD), which updates the model parameters by adding a local gradient times a learning rate at each step, is widely used in model training of machine learning algorithms such as neural networks. It is observed…

Machine Learning · Computer Science 2017-06-01 Chang Xu , Tao Qin , Gang Wang , Tie-Yan Liu

Conventional Reinforcement Learning (RL) algorithms, typically focused on estimating or maximizing expected returns, face challenges when refining offline pretrained models with online experiences. This paper introduces Generative Actor…

Machine Learning · Computer Science 2025-12-29 Aoyang Qin , Deqian Kong , Wei Wang , Ying Nian Wu , Song-Chun Zhu , Sirui Xie

The effectiveness of credit assignment in reinforcement learning (RL) when dealing with high-dimensional data is influenced by the success of representation learning via deep neural networks, and has implications for the sample efficiency…

Machine Learning · Computer Science 2025-02-03 Burcu Küçükoğlu , Sander Dalm , Marcel van Gerven

Model-based reinforcement learning (MBRL) and model-free reinforcement learning (MFRL) evolve along distinct paths but converge in the design of Dyna-Q [1]. However, modern RL methods still struggle with effective transferability across…

Machine Learning · Computer Science 2025-12-18 Quanxi Zhou , Wencan Mao , Manabu Tsukada , John C. S. Lui , Yusheng Ji

Reinforcement learning (RL) is a promising data-driven approach for adaptive traffic signal control (ATSC) in complex urban traffic networks, and deep neural networks further enhance its learning power. However, centralized RL is infeasible…

Machine Learning · Computer Science 2019-03-13 Tianshu Chu , Jie Wang , Lara Codecà , Zhaojian Li

In future cell-free (or cell-less) wireless networks, a large number of devices in a geographical area will be served simultaneously in non-orthogonal multiple access scenarios by a large number of distributed access points (APs), which…

Signal Processing · Electrical Eng. & Systems 2020-02-25 Yasser Al-Eryani , Mohamed Akrout , Ekram Hossain

The combination of cloud computing capabilities at the network edge and artificial intelligence promise to turn future mobile networks into service- and radio-aware entities, able to address the requirements of upcoming latency-sensitive…

Networking and Internet Architecture · Computer Science 2021-03-19 Sergio Martiradonna , Andrea Abrardo , Marco Moretti , Giuseppe Piro , Gennaro Boggia

This paper proposes the Cooperative Soft Actor Critic (CSAC) method of enabling consecutive reinforcement learning agents to cooperatively solve a long time horizon multi-stage task. This method is achieved by modifying the policy of each…

Machine Learning · Computer Science 2020-07-02 Jordan Erskine , Chris Lehnert

Electric vehicles (EVs) are increasingly deployed, yet range limitations remain a key barrier. Improving energy efficiency via advanced control is therefore essential, and emerging vehicle automation offers a promising avenue. However, many…

Systems and Control · Electrical Eng. & Systems 2026-02-11 Hamed Faghihian , Arman Sargolzaei

The exploitation of extra state information has been an active research area in multi-agent reinforcement learning (MARL). QMIX represents the joint action-value using a non-negative function approximator and achieves the best performance,…

Artificial Intelligence · Computer Science 2020-12-21 Jianyu Su , Stephen Adams , Peter A. Beling

We propose a fully distributed actor-critic algorithm approximated by deep neural networks, named \textit{Diff-DAC}, with application to single-task and to average multitask reinforcement learning (MRL). Each agent has access to data from…

Reinforcement learning, mathematically described by Markov Decision Problems, may be approached either through dynamic programming or policy search. Actor-critic algorithms combine the merits of both approaches by alternating between steps…

Machine Learning · Computer Science 2023-01-31 Harshat Kumar , Alec Koppel , Alejandro Ribeiro

Optimally scheduling multi-energy flow is an effective method to utilize renewable energy sources (RES) and improve the stability and economy of integrated energy systems (IES). However, the stable demand-supply of IES faces challenges from…

Systems and Control · Electrical Eng. & Systems 2024-11-25 Yang Li , Wenjie Ma , Yuanzheng Li , Sen Li , Zhe Chen , Mohammad Shahidehpor

The constant surge in the traffic demand on cellular networks has led to continuous expansion in network capacity in order to accommodate existing and new service demands. This has given rise to ultra-dense base station deployment in 5G and…

Systems and Control · Electrical Eng. & Systems 2025-02-19 Attai Ibrahim Abubakar , Michael S. Mollel , Metin Ozturk , Naeem Ramzan

Actor-critic (AC) algorithms have been widely adopted in decentralized multi-agent systems to learn the optimal joint control policy. However, existing decentralized AC algorithms either do not preserve the privacy of agents or are not…

Machine Learning · Computer Science 2022-02-04 Ziyi Chen , Yi Zhou , Rongrong Chen , Shaofeng Zou

We present Distributional Soft Actor-Critic (DSAC), a distributional reinforcement learning (RL) algorithm that combines the strengths of distributional information of accumulated rewards and entropy-driven exploration from Soft…

Machine Learning · Computer Science 2025-07-01 Xiaoteng Ma , Junyao Chen , Li Xia , Jun Yang , Qianchuan Zhao , Zhengyuan Zhou

The paper presents a reinforcement learning solution to dynamic resource allocation for 5G radio access network slicing. Available communication resources (frequency-time blocks and transmit powers) and computational resources (processor…

Networking and Internet Architecture · Computer Science 2020-09-15 Yi Shi , Yalin E. Sagduyu , Tugba Erpek