English
Related papers

Related papers: A Q-Learning Approach for Dynamic Resource Managem…

200 papers

In multi-tiered fog computing systems, to accelerate the processing of computation-intensive tasks for real-time IoT applications, resource-limited IoT devices can offload part of their workloads to nearby fog nodes, whereafter such…

Networking and Internet Architecture · Computer Science 2020-12-16 Xin Gao , Xi Huang , Simeng Bian , Ziyu Shao , Yang Yang

This paper proposes a reinforcement learning approach for traffic control with the adaptive horizon. To build the controller for the traffic network, a Q-learning-based strategy that controls the green light passing time at the network…

Systems and Control · Computer Science 2019-04-01 Wentao Chen , Tehuan Chen , Guang Lin

Efficient load balancing is crucial in cloud computing environments to ensure optimal resource utilization, minimize response times, and prevent server overload. Traditional load balancing algorithms, such as round-robin or least…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-10 Kavish Chawla

A central challenge in quantum information science and technology is achieving real-time estimation and feedforward control of quantum systems. This challenge is compounded by the inherent inhomogeneity of quantum resources, such as qubit…

Machine Learning · Computer Science 2024-05-28 Linsen Li , Pratyush Anand , Kaiming He , Dirk Englund

This paper addresses the challenges of rapid resource variation and highly uncertain task loads in cloud computing environments. It proposes an optimization method for elastic cloud resource scaling based on a multi-agent system. The method…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-02 Bruce Fang , Danyi Gao

In light of the quick proliferation of Internet of things (IoT) devices and applications, fog radio access network (Fog-RAN) has been recently proposed for fifth generation (5G) wireless communications to assure the requirements of…

Networking and Internet Architecture · Computer Science 2019-01-17 Almuthanna T. Nassar , Yasin Yilmaz

Autonomous agents often require multiple strategies to solve complex tasks, but determining when to switch between strategies remains challenging. This research introduces a reinforcement learning technique to learn switching thresholds…

Machine Learning · Computer Science 2025-12-09 Chris Tava

Safe and efficient autonomous driving maneuvers in an interactive and complex environment can be considerably challenging due to the unpredictable actions of other surrounding agents that may be cooperative or adversarial in their…

Robotics · Computer Science 2019-01-28 Pin Wang , Ching-Yao Chan , Hanhan Li

Cloud computing is a model for enabling on-demand network access to a shared pool of computing resources, that can be dynamically allocated and released with minimal effort. However, this task can be complex in highly dynamic environments…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-18 Merzoug Soltane , Yudith Cardinale , Rafael Angarita , Philippe Rosse , Marta Rukoz , Derdour Makhlouf , Kazar Okba

In this paper we design and evaluate a Deep-Reinforcement Learning agent that optimizes routing. Our agent adapts automatically to current traffic conditions and proposes tailored configurations that attempt to minimize the network delay.…

Networking and Internet Architecture · Computer Science 2017-09-22 Giorgio Stampa , Marta Arias , David Sanchez-Charles , Victor Muntes-Mulero , Albert Cabellos

This paper introduces an approach to Reinforcement Learning Algorithm by comparing their immediate rewards using a variation of Q-Learning algorithm. Unlike the conventional Q-Learning, the proposed algorithm compares current reward with…

Machine Learning · Computer Science 2010-09-15 Punit Pandey , Deepshikha Pandey , Shishir Kumar

Reinforcement Learning algorithms have recently been proposed to learn time-sequential control policies in the field of autonomous driving. Direct applications of Reinforcement Learning algorithms with discrete action space will yield…

Machine Learning · Computer Science 2019-12-03 Pin Wang , Hanhan Li , Ching-Yao Chan

With the rapid advance of information technology, network systems have become increasingly complex and hence the underlying system dynamics are often unknown or difficult to characterize. Finding a good network control policy is of…

Performance · Computer Science 2022-04-08 Bai Liu , Qiaomin Xie , Eytan Modiano

The fog radio access network (F-RAN) is a promising technology in which the user mobile devices (MDs) can offload computation tasks to the nearby fog access points (F-APs). Due to the limited resource of F-APs, it is important to design an…

Machine Learning · Computer Science 2022-06-14 Lingling Zhang , Yanxiang Jiang , Fu-Chun Zheng , Mehdi Bennis , Xiaohu You

In industrial environments, an increasing amount of wireless devices are used, which utilize license-free bands. As a consequence of these mutual interferences of wireless systems might decrease the state of coexistence. Therefore, a…

Signal Processing · Electrical Eng. & Systems 2018-06-14 Philip Soeffker , Dimitri Block , Nico Wiebusch , Uwe Meier

In the past few years, Deep Reinforcement Learning (DRL) has become a valuable solution to automatically learn efficient resource management strategies in complex networks. In many scenarios, the learning task is performed in the Cloud,…

Networking and Internet Architecture · Computer Science 2022-12-01 Seyyidahmed Lahmer , Federico Chiariotti , Andrea Zanella

The paper presents a reinforcement learning solution to dynamic resource allocation for 5G radio access network slicing. Available communication resources (frequency-time blocks and transmit powers) and computational resources (processor…

Networking and Internet Architecture · Computer Science 2020-09-15 Yi Shi , Yalin E. Sagduyu , Tugba Erpek

In this paper, the distributed edge caching problem in fog radio access networks (F-RANs) is investigated. By considering the unknown spatio-temporal content popularity and user preference, a user request model based on hidden Markov…

Machine Learning · Computer Science 2019-02-28 Liuyang Lu , Yanxiang Jiang , Mehdi Bennis , Zhiguo Ding , Fu-Chun Zheng , Xiaohu You

Using Unmanned Aerial Vehicles (UAVs) in Search and rescue operations (SAR) to navigate challenging terrain while maintaining reliable communication with the cellular network is a promising approach. This paper suggests a novel technique…

We explore an active learning approach for dynamic fair resource allocation problems. Unlike previous work that assumes full feedback from all agents on their allocations, we consider feedback from a select subset of agents at each epoch of…

Machine Learning · Computer Science 2024-06-24 Riddhiman Bhattacharya , Thanh Nguyen , Will Wei Sun , Mohit Tawarmalani