English
Related papers

Related papers: A Deep Recurrent Q Network towards Self-adapting D…

200 papers

Highly dynamic mobile ad-hoc networks (MANETs) remain as one of the most challenging environments to develop and deploy robust, efficient, and scalable routing protocols. In this paper, we present DeepCQ+ routing protocol which, in a novel…

Networking and Internet Architecture · Computer Science 2021-12-01 Saeed Kaviani , Bo Ryu , Ejaz Ahmed , Kevin Larson , Anh Le , Alex Yahja , Jae H. Kim

In this paper, the implementation of two Reinforcement learnings namely, Q Learning and Deep Q Network(DQN) on a Self Balancing Robot Gazebo model has been discussed. The goal of the experiments is to make the robot model learn the best…

Robotics · Computer Science 2018-07-24 MD Muhaimin Rahman , SM Hasanur Rashid , M. M Hossain

Unmanned Aerial Vehicles (UAVs) have gained popularity in data harvesting (DH) and coverage path planning (CPP) to survey a given area efficiently and collect data from aerial perspectives, while data harvesting aims to gather information…

Machine Learning · Computer Science 2024-05-21 Praveen Kumar , Priyadarshni , Rajiv Misra

With the integration of massive distributed energy resources and the widespread participation of novel market entities, the operation of active distribution networks (ADNs) is progressively evolving into a complex multi-scenario,…

Systems and Control · Electrical Eng. & Systems 2025-11-18 Xu Yang , Chenhui Lin , Haotian Liu , Qi Wang , Yue Yang , Wenchuan Wu

The reliability of neural networks is essential for their use in safety-critical applications. Existing approaches generally aim at improving the robustness of neural networks to either real-world distribution shifts (e.g., common…

Machine Learning · Computer Science 2022-05-20 Leo Schwinn , Leon Bungert , An Nguyen , René Raab , Falk Pulsmeyer , Doina Precup , Björn Eskofier , Dario Zanca

The Metaverse is a new paradigm that aims to create a virtual environment consisting of numerous worlds, each of which will offer a different set of services. To deal with such a dynamic and complex scenario, considering the stringent…

Networking and Internet Architecture · Computer Science 2023-09-20 Hamidreza Mazandarani , Masoud Shokrnezhad , Tarik Taleb , Richard Li

Dynamic dispatching is one of the core problems for operation optimization in traditional industries such as mining, as it is about how to smartly allocate the right resources to the right place at the right time. Conventionally, the…

Machine Learning · Computer Science 2020-08-26 Chi Zhang , Philip Odonkor , Shuai Zheng , Hamed Khorasgani , Susumu Serita , Chetan Gupta

A microgrid is an innovative system that integrates distributed energy resources to supply electricity demand within electrical boundaries. This study proposes an approach for deriving a desirable microgrid operation policy that enables…

Systems and Control · Electrical Eng. & Systems 2020-10-21 Hyungjun Park , Daiki Min , Jong-hyun Ryu , Dong Gu Choi

The rise of microgrid-based architectures is heavily modifying the energy control landscape in distribution systems making distributed control mechanisms necessary to ensure reliable power system operations. In this paper, we propose the…

Systems and Control · Electrical Eng. & Systems 2020-10-14 Sergio Rozada , Dimitra Apostolopoulou , Eduardo Alonso

Much of the success of single agent deep reinforcement learning (DRL) in recent years can be attributed to the use of experience replay memories (ERM), which allow Deep Q-Networks (DQNs) to be trained efficiently through sampling stored…

Multiagent Systems · Computer Science 2018-02-28 Gregory Palmer , Karl Tuyls , Daan Bloembergen , Rahul Savani

Microservices have transformed monolithic applications into lightweight, self-contained, and isolated application components, establishing themselves as a dominant paradigm for application development and deployment in public clouds such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-16 Haoyu Bai , Minxian Xu , Kejiang Ye , Rajkumar Buyya , Chengzhong Xu

Recently, 6G in-X subnetworks have been proposed as low-power short-range radio cells to support localized extreme wireless connectivity inside entities such as industrial robots, vehicles, and the human body. Deployment of in-X subnetworks…

Signal Processing · Electrical Eng. & Systems 2024-06-12 Bjarke Madsen , Ramoni Adeogun

We study the problem of adaptive contention window (CW) design for random-access wireless networks. More precisely, our goal is to design an intelligent node that can dynamically adapt its minimum CW (MCW) parameter to maximize a…

Signal Processing · Electrical Eng. & Systems 2020-11-19 Abhishek Kumar , Gunjan Verma , Chirag Rao , Ananthram Swami , Santiago Segarra

In distributed Software-Defined Networking (SDN), distributed SDN controllers require synchronization to maintain a global network state. Despite the availability of synchronization policies for distributed SDN architectures, most policies…

Networking and Internet Architecture · Computer Science 2025-08-18 Ioannis Panitsas , Akrit Mudvari , Leandros Tassiulas

Greater capabilities of mobile communications technology enable interconnection of on-site medical care at a scale previously unavailable. However, embedding such critical, demanding tasks into the already complex infrastructure of mobile…

Machine Learning · Computer Science 2022-01-26 Steffen Gracla , Edgar Beck , Carsten Bockelmann , Armin Dekorsy

Tailoring treatment for individual patients is crucial yet challenging in order to achieve optimal healthcare outcomes. Recent advances in reinforcement learning offer promising personalized treatment recommendations; however, they rely…

Machine Learning · Computer Science 2023-07-06 Simin Ma , Junghwan Lee , Nicoleta Serban , Shihao Yang

The Queue-Reactive model introduced by Huang et al. (2015) has become a standard tool for limit order book modeling, widely adopted by both researchers and practitioners for its simplicity and effectiveness. We present the Multidimensional…

Trading and Market Microstructure · Quantitative Finance 2025-01-16 Hamza Bodor , Laurent Carlier

This letter presents a deep reinforcement learning (DRL) approach for transmission design to optimize the energy efficiency in vehicle-to-vehicle (V2V) communication links. Considering the dynamic environment of vehicular communications,…

Signal Processing · Electrical Eng. & Systems 2024-04-22 Zhengpeng Wang , Yanqun Tang , Yingzhe Mao , Tao Wang , Xiunan Huang

Energy storage devices represent environmentally friendly candidates to cope with volatile renewable energy generation. Motivated by the increase in privately owned storage systems, this paper studies the problem of real-time control of a…

Optimization and Control · Mathematics 2019-03-28 Ahmed S. Zamzam , Bo Yang , Nicholas D. Sidiropoulos

Most existing deep reinforcement learning (DRL) frameworks consider either discrete action space or continuous action space solely. Motivated by applications in computer games, we consider the scenario with discrete-continuous hybrid action…

Machine Learning · Computer Science 2018-10-16 Jiechao Xiong , Qing Wang , Zhuoran Yang , Peng Sun , Lei Han , Yang Zheng , Haobo Fu , Tong Zhang , Ji Liu , Han Liu