English
Related papers

Related papers: Actor-Critic-Based Learning for Zero-touch Joint R…

200 papers

The Soft Actor-Critic (SAC) algorithm, a state-of-the-art method in maximum entropy reinforcement learning, traditionally relies on minimizing reverse Kullback-Leibler (KL) divergence for policy updates. However, this approach leads to an…

Machine Learning · Computer Science 2025-06-03 Yixian Zhang , Huaze Tang , Changxu Wei , Wenbo Ding

In the forthcoming era of 6G networks, characterized by unprecedented data rates, ultra-low latency, and ubiquitous connectivity, effective management of Virtualized Network Functions (VNFs) is essential. VNFs are software-based…

Networking and Internet Architecture · Computer Science 2026-05-01 Cyril Shih-Huan Hsu , Anestis Dalgkitsis , Chrysa Papagianni , Paola Grosso

Actor-critic methods, like Twin Delayed Deep Deterministic Policy Gradient (TD3), depend on basic noise-based exploration, which can result in less than optimal policy convergence. In this study, we introduce Monte Carlo Beam Search (MCBS),…

Artificial Intelligence · Computer Science 2025-05-15 Hazim Alzorgan , Abolfazl Razi

In reinforcement learning (RL), temporal difference (TD) errors are widely adopted for optimizing value and policy functions. However, since the TD error is defined by a bootstrap method, its computation tends to be noisy and destabilize…

Machine Learning · Computer Science 2026-04-03 Taisuke Kobayashi

This study departs from the prevailing assumption of independent Transmission and Reflection Coefficients (TRC) in Airborne Simultaneous Transmit and Reflect Reconfigurable Intelligent Surface (STAR-RIS) research. Instead, we explore a…

Signal Processing · Electrical Eng. & Systems 2025-09-18 Danish Rizvi , David Boyle

As an important branch of embodied artificial intelligence, mobile manipulators are increasingly applied in intelligent services, but their redundant degrees of freedom also limit efficient motion planning in cluttered environments. To…

Robotics · Computer Science 2025-04-01 Chenyu Zhang , Shiying Sun , Kuan Liu , Chuanbao Zhou , Xiaoguang Zhao , Min Tan , Yanlong Huang

Deriving fast and effectively coordinated control actions remains a grand challenge affecting the secure and economic operation of today's large-scale power grid. This paper presents a novel artificial intelligence (AI) based methodology to…

Optimization and Control · Mathematics 2020-12-14 Ruisheng Diao , Di Shi , Bei Zhang , Siqi Wang , Haifeng Li , Chunlei Xu , Tu Lan , Desong Bian , Jiajun Duan

6G In-body Subnetworks (IBSs) represent a key enabler for supporting standalone eXtended Reality (XR) applications. IBSs are expected to operate as an underlay to existing cellular networks, giving rise to coexistence challenges when…

Systems and Control · Electrical Eng. & Systems 2026-03-31 Samira Abdelrahman , Hossam Farag

With the increasing demand for efficient and flexible robotic exploration solutions, Reinforcement Learning (RL) is becoming a promising approach in the field of autonomous robotic exploration. However, current RL-based exploration…

Robotics · Computer Science 2025-03-19 Chunyu Yang , Shengben Bi , Yihui Xu , Xin Zhang

Background: Deep Deterministic Policy Gradient-based reinforcement learning algorithms utilize Actor-Critic architectures, where both networks are typically trained using identical batches of replayed transitions. However, the learning…

Machine Learning · Computer Science 2025-12-08 Mehmet Efe Lorasdagi , Dogan Can Cicek , Furkan Burak Mutlu , Suleyman Serdar Kozat

Actor-critic methods for decentralized multi-agent reinforcement learning (MARL) facilitate collaborative optimal decision making without centralized coordination, thus enabling a wide range of applications in practice. To date, however,…

Machine Learning · Computer Science 2025-08-14 Zhiyao Zhang , Myeung Suk Oh , FNU Hairi , Ziyue Luo , Alvaro Velasquez , Jia Liu

In this paper, we present a multi-agent deep reinforcement learning (deep RL) framework for network slicing in a dynamic environment with multiple base stations and multiple users. In particular, we propose a novel deep RL framework with…

Machine Learning · Computer Science 2023-11-21 Feng Wang , M. Cenk Gursoy , Senem Velipasalar

Actor-critic methods integrating target networks have exhibited a stupendous empirical success in deep reinforcement learning. However, a theoretical understanding of the use of target networks in actor-critic methods is largely missing in…

Machine Learning · Computer Science 2022-02-24 Anas Barakat , Pascal Bianchi , Julien Lehmann

High demand of data rate in the next generation of wireless communication could be ensured by Non-Orthogonal Multiple Access (NOMA) approach in the millimetre-wave (mmW) frequency band. Decreasing the interference on the other users while…

Information Theory · Computer Science 2022-05-17 Abbas Akbarpour-Kasgari , Mehrdad Ardebilipour

We propose a conceptually simple and lightweight framework for deep reinforcement learning that uses asynchronous gradient descent for optimization of deep neural network controllers. We present asynchronous variants of four standard…

Model-free deep reinforcement learning (RL) algorithms have been demonstrated on a range of challenging decision making and control tasks. However, these methods typically suffer from two major challenges: very high sample complexity and…

Machine Learning · Computer Science 2018-08-10 Tuomas Haarnoja , Aurick Zhou , Pieter Abbeel , Sergey Levine

This paper explores the application of the Soft Actor-Critic (SAC) algorithm within a Distributional Reinforcement Learning setting and introduces an implementation of such algorithm named Cram\'er-based Distributional Soft Actor-Critic…

Machine Learning · Computer Science 2026-05-12 Vanya Aziz , Ivo Nowak , E. M. T Hendrix

The next generation of tactical networks (TNs) is poised to further leverage the key enablers of 5G and beyond 5G (B5G) technology, such as radio access network (RAN) slicing and the open RAN (O-RAN) paradigm, to unlock multiple…

Networking and Internet Architecture · Computer Science 2025-06-11 Abderrahime Filali , Diala Naboulsi , Georges Kaddoum

Wave Energy Converters, particularly point absorbers, have emerged as one of the most promising technologies for harvesting ocean wave energy. Nevertheless, achieving high conversion efficiency remains challenging due to the inherently…

Systems and Control · Electrical Eng. & Systems 2026-01-13 Yi Zhan , Iván Martínez-Estévez , Min Luo , Alejandro J. C. Crespo , Abbas Khayyer

To make efficient use of limited spectral resources, we in this work propose a deep actor-critic reinforcement learning based framework for dynamic multichannel access. We consider both a single-user case and a scenario in which multiple…

Machine Learning · Computer Science 2019-08-23 Chen Zhong , Ziyang Lu , M. Cenk Gursoy , Senem Velipasalar
‹ Prev 1 3 4 5 6 7 10 Next ›