English
Related papers

Related papers: A Q-Learning Approach for Dynamic Resource Managem…

200 papers

Efficient energy management is essential in Wireless Sensor Networks (WSNs) to extend network lifetime and ensure reliable data transmission. This paper presents a novel method using reinforcement learning-based cluster-head selection and a…

Networking and Internet Architecture · Computer Science 2025-08-21 Parham Soltani , Mehrshad Eskandarpour , Amir Ahmadizad , Hossein Soleimani

While privacy concerns entice connected and automated vehicles to incorporate on-board federated learning (FL) solutions, an integrated vehicle-to-everything communication with heterogeneous computation power aware learning platform is…

Autonomous navigation is challenging for mobile robots, especially in an unknown environment. Commonly, the robot requires multiple sensors to map the environment, locate itself, and make a plan to reach the target. However, reinforcement…

Robotics · Computer Science 2023-03-08 Miguel Quinones-Ramirez , Jorge Rios-Martinez , Victor Uc-Cetina

This paper is about optimally controlling skill-based queueing systems such as data centers, cloud computing networks, and service systems. By means of a case study using a real-world data set, we investigate the practical implementation of…

Machine Learning · Computer Science 2025-06-26 Sanne van Kempen , Jaron Sanders , Fiona Sloothaak , Maarten G. Wolf

The mode selection and resource allocation in fog radio access networks (F-RANs) have been advocated as key techniques to improve spectral and energy efficiency. In this paper, we investigate the joint optimization of mode selection and…

Networking and Internet Architecture · Computer Science 2020-02-21 Hongyu Xiang , Mugen Peng , Yaohua Sun , Shi Yan

Discretionary lane-change is one of the critical challenges for autonomous vehicle (AV) design due to its significant impact on traffic efficiency. Existing intelligent lane-change solutions have primarily focused on optimizing the…

Computers and Society · Computer Science 2023-03-17 Lokesh Chandra Das , Myounggyu Won

Computation offloading at lower time and lower energy consumption is crucial for resource limited mobile devices. This paper proposes an offloading decision-making model using federated learning. Based on the task type and the user input,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-16 Anwesha Mukherjee , Rajkumar Buyya

Efficient maintenance has always been essential for the successful application of engineering systems. However, the challenges to be overcome in the implementation of Industry 4.0 necessitate new paradigms of maintenance optimization.…

Machine Learning · Computer Science 2025-05-28 Alberto Pliego Marugán , Jesús M. Pinar-Pérez , Fausto Pedro García Márquez

Multi-agent systems powered by large language models have emerged as a promising paradigm for solving complex reasoning tasks through collaborative intelligence. However, efficiently deploying these systems on serverless GPU platforms…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-05 Guilin Zhang , Wulan Guo , Ziqi Tan

The increasing use of Internet of Things (IoT) devices generates a greater demand for data transfers and puts increased pressure on networks. Additionally, connectivity to cloud services can be costly and inefficient. Fog computing provides…

Networking and Internet Architecture · Computer Science 2020-12-24 Faten Alenizi , Omer Rana

It has been a long-held belief that judicious resource allocation is critical to mitigating interference, improving network efficiency, and ultimately optimizing wireless communication performance. The traditional wisdom is to explicitly…

Information Theory · Computer Science 2019-10-02 Le Liang , Hao Ye , Guanding Yu , Geoffrey Ye Li

An intelligent radar resource management is an essential building block of any modern radar system. The quality of service based resource allocation model (Q-RAM) provides a framework for profound and quantifiable decision-making but lacks…

Signal Processing · Electrical Eng. & Systems 2023-03-06 Tobias Müller , Sebastian Durst , Pascal Marquardt , Stefan Brüggenwirth

We first define appropriate state representation and action space, and then design an adjustment mechanism based on the actions selected by the intelligent agent. The adjustment mechanism outputs the next state and reward value of the…

Robotics · Computer Science 2023-07-27 Longcheng Guo

In many real-world scenarios involving high-stakes and safety implications, a human decision-maker (HDM) may receive recommendations from an artificial intelligence while holding the ultimate responsibility of making decisions. In this…

Machine Learning · Computer Science 2024-07-18 Ioannis Faros , Aditya Dave , Andreas A. Malikopoulos

Portfolio traders strive to identify dynamic portfolio allocation schemes so that their total budgets are efficiently allocated through the investment horizon. This study proposes a novel portfolio trading strategy in which an intelligent…

Portfolio Management · Quantitative Finance 2019-12-02 Hyungjun Park , Min Kyu Sim , Dong Gu Choi

In this paper we propose a Deep Reinforcement Learning approach to solve a multimodal transportation planning problem, in which containers must be assigned to a truck or to trains that will transport them to their destination. While…

Machine Learning · Computer Science 2021-05-19 Amirreza Farahani , Laura Genga , Remco Dijkman

A goal of cloud service management is to design self-adaptable auto-scaler to react to workload fluctuations and changing the resources assigned. The key problem is how and when to add/remove resources in order to meet agreed service-level…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-22 Hamid Arabnejad , Claus Pahl , Pooyan Jamshidi , Giovani Estrada

Task offloading in three-layer fog computing environments presents a critical challenge due to user equipment (UE) mobility, which frequently triggers costly service migrations and degrades overall system performance. This paper addresses…

Hardware Architecture · Computer Science 2025-07-17 Soheil Mahdizadeh , Elyas Oustad , Mohsen Ansari

Flying ad hoc networks (FANETs) play a crucial role in numerous military and civil applications since it shortens mission duration and enhances coverage significantly compared with a single unmanned aerial vehicle (UAV). Whereas, designing…

Networking and Internet Architecture · Computer Science 2023-07-03 Yanpeng Cui , Qixun Zhang , Zhiyong Feng , Zhiqing Wei , Ce Shi , Heng Yang

Real-world autonomous decision-making systems, from robots to recommendation engines, must operate in environments that change over time. While deep reinforcement learning (RL) has shown an impressive ability to learn optimal policies in…

Machine Learning · Computer Science 2025-05-16 Jonathan Clifford Balloch