English
Related papers

Related papers: Differentiated Federated Reinforcement Learning Ba…

200 papers

In this paper, we propose a federated deep reinforcement learning framework to solve a multi-objective optimization problem, where we consider minimizing the expected long-term task completion delay and energy consumption of IoT devices.…

Networking and Internet Architecture · Computer Science 2021-04-26 Sheyda Zarandi , Hina Tabassum

The IEEE 802.11 MAC layer utilizes the Carrier Sense Multiple Access with Collision Avoidance (CSMA/CA) mechanism for channel contention, but dense Wi-Fi deployments often cause high collision rates. To address this, this paper proposes an…

Networking and Internet Architecture · Computer Science 2024-12-31 Xinyang Du , Xuming Fang , Rong He , Li Yan , Liuming Lu , Chaoming Luo

Mobile edge computing (MEC) is a promising technique to improve the computational capacity of smart devices (SDs) in Internet of Things (IoT). However, the performance of MEC is restricted due to its fixed location and limited service…

Networking and Internet Architecture · Computer Science 2025-08-04 Saichao Liu , Geng Sun , Chuang Zhang , Xuejie Liu , Jiacheng Wang , Changyuan Zhao , Dusit Niyato

In this paper, we propose a new reinforcement learning (RL) algorithm, called encoding distributional soft actor-critic (E-DSAC), for decision-making in autonomous driving. Unlike existing RL-based decision-making methods, E-DSAC is…

Robotics · Computer Science 2021-09-14 Jingliang Duan , Yangang Ren , Fawang Zhang , Yang Guan , Dongjie Yu , Shengbo Eben Li , Bo Cheng , Lin Zhao

In this paper, a novel generative adversarial imitation learning (GAIL)-powered policy learning approach is proposed for optimizing beamforming, spectrum allocation, and remote user equipment (RUE) association in NTNs. Traditional…

Networking and Internet Architecture · Computer Science 2024-09-30 Sheikh Salman Hassan , Yu Min Park , Yan Kyaw Tun , Walid Saad , Zhu Han , Choong Seon Hong

Multi-Agent Reinforcement Learning (MARL) is a challenging subarea of Reinforcement Learning due to the non-stationarity of the environments and the large dimensionality of the combined action space. Deep MARL algorithms have been applied…

Machine Learning · Computer Science 2021-07-27 Yuanchao Xu , Amal Feriani , Ekram Hossain

This research is concerned with the novel application and investigation of `Soft Actor Critic' (SAC) based Deep Reinforcement Learning (DRL) to control the cooling setpoint (and hence cooling loads) of a large commercial building to harness…

Machine Learning · Computer Science 2021-07-08 Anjukan Kathirgamanathan , Eleni Mangina , Donal P. Finn

Deep Reinforcement Learning (DRL) uses diverse, unstructured data and makes RL capable of learning complex policies in high dimensional environments. Intelligent Transportation System (ITS) based on Autonomous Vehicles (AVs) offers an…

Machine Learning · Computer Science 2022-06-30 Anum Mushtaq , Irfan ul Haq , Muhammad Azeem Sarwar , Asifullah Khan , Omair Shafiq

Emerging data-driven approaches, such as deep reinforcement learning (DRL), aim at on-the-field learning of powertrain control policies that optimize fuel economy and other performance metrics. Indeed, they have shown great potential in…

Systems and Control · Electrical Eng. & Systems 2024-04-30 Lindsey Kerbel , Beshah Ayalew , Andrej Ivanco

Deploying foundation models (FMs) on uncrewed aerial vehicles (UAVs) promises broad ``low-altitude economy'' applications. Split federated learning (SFL)-based fine-tuning leverages distributed data while keeping raw data local and reduces…

Information Theory · Computer Science 2025-11-20 Zizhen Zhou , Ying-Chang Liang , Yanyu Cheng , Wei Yang Bryan Lim

Federated Learning (FL) is a machine learning paradigm that safeguards privacy by retaining client data on edge devices. However, optimizing FL in practice can be challenging due to the diverse and heterogeneous nature of the learning…

Machine Learning · Computer Science 2024-06-11 Yongxin Guo , Xiaoying Tang , Tao Lin

Low Earth Orbit (LEO) satellites play a crucial role in the development of 6G mobile networks and space-air-ground integrated systems. Recent advancements in space technology have empowered LEO satellites with the capability to run AI…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-09 Minghao Yang , Jingjing Zhang , Shengyun Liu

Intrusion detection systems (IDS) generate a large number of false alerts which makes it difficult to inspect true positives. Hence, alert prioritization plays a crucial role in deciding which alerts to investigate from an enormous number…

Cryptography and Security · Computer Science 2022-08-04 Lalitha Chavali , Tanay Gupta , Paresh Saxena

The uneven distribution of local data across different edge devices (clients) results in slow model training and accuracy reduction in federated learning. Naive federated learning (FL) strategy and most alternative solutions attempted to…

Carrier sensing multiple access/collision avoidance (CSMA/CA) is the backbone MAC protocol for IEEE 802.11 networks. However, tuning the binary exponential back-off (BEB) mechanism of CSMA/CA in user-dense scenarios so as to maximize…

Networking and Internet Architecture · Computer Science 2021-02-16 Lyutianyang Zhang , Hao Yin , Zhanke Zhou , Sumit Roy , Yaping Sun

With the rapid growth of IoT devices and latency-sensitive applications, the demand for both real-time and energy-efficient computing has surged, placing significant pressure on traditional cloud computing architectures. Mobile edge…

Machine Learning · Computer Science 2026-01-13 Wei Ai , Yun Peng , Yuntao Shou , Tao Meng , Keqin Li

To address the communication burden and privacy concerns associated with the centralized server in Federated Learning (FL), Decentralized Federated Learning (DFL) has emerged, which discards the server with a peer-to-peer (P2P)…

Machine Learning · Computer Science 2023-10-10 Qinglun Li , Miao Zhang , Nan Yin , Quanjun Yin , Li Shen

This paper explores the application of the Soft Actor-Critic (SAC) algorithm within a Distributional Reinforcement Learning setting and introduces an implementation of such algorithm named Cram\'er-based Distributional Soft Actor-Critic…

Machine Learning · Computer Science 2026-05-12 Vanya Aziz , Ivo Nowak , E. M. T Hendrix

In this paper we envision a federated learning (FL) scenario in service of amending the performance of autonomous road vehicles, through a drone traffic monitor (DTM), that also acts as an orchestrator. Expecting non-IID data distribution,…

Machine Learning · Computer Science 2021-08-06 Igor Donevski , Jimmy Jessen Nielsen , Petar Popovski

We propose a novel algorithm for offline reinforcement learning using optimal transport. Typically, in offline reinforcement learning, the data is provided by various experts and some of them can be sub-optimal. To extract an efficient…

Machine Learning · Computer Science 2024-10-21 Arip Asadulaev , Rostislav Korst , Alexander Korotin , Vage Egiazarian , Andrey Filchenkov , Evgeny Burnaev