English
Related papers

Related papers: Scheduling the NASA Deep Space Network with Deep R…

200 papers

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

Machine Learning · Computer Science 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Deep learning has been effectively applied to many discrete optimization problems. However, learning-based scheduling on unrelated parallel machines remains particularly difficult to design. Not only do the numbers of jobs and machines…

Machine Learning · Computer Science 2025-12-23 Diego Hitzges , Guillaume Sagnol

In the rapidly evolving field of serverless computing, efficient function scheduling and resource scaling are critical for optimizing performance and cost. This paper presents a comprehensive review of the application of Deep Reinforcement…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-23 Amjad Yousef Majid , Eduard Marin

In this paper, we propose a Deep Reinforcement Learning (RL) framework for task arrangement, which is a critical problem for the success of crowdsourcing platforms. Previous works conduct the personalized recommendation of tasks to workers…

Machine Learning · Computer Science 2019-11-05 Caihua Shan , Nikos Mamoulis , Reynold Cheng , Guoliang Li , Xiang Li , Yuqiu Qian

This study addresses the challenge of resource scheduling optimization in edge-cloud collaborative computing using deep reinforcement learning (DRL). The proposed DRL-based approach improves task processing efficiency, reduces overall…

Machine Learning · Computer Science 2025-04-30 Yuqing Wang , Xiao Yang

The optimal dispatch of energy storage systems (ESSs) presents formidable challenges due to the uncertainty introduced by fluctuations in dynamic prices, demand consumption, and renewable-based energy generation. By exploiting the…

Systems and Control · Electrical Eng. & Systems 2023-07-27 Shengren Hou , Edgar Mauricio Salazar Duque , Peter Palensky , Pedro P. Vergara

The choice of learning rate (LR) functions and policies has evolved from a simple fixed LR to the decaying LR and the cyclic LR, aiming to improve the accuracy and reduce the training time of Deep Neural Networks (DNNs). This paper presents…

Machine Learning · Computer Science 2022-10-25 Yanzhao Wu , Ling Liu

Non-terrestrial networks (NTNs) with low-earth orbit (LEO) satellites have been regarded as promising remedies to support global ubiquitous wireless services. Due to the rapid mobility of LEO satellite, inter-beam/satellite handovers happen…

Signal Processing · Electrical Eng. & Systems 2024-10-16 Yang Cao , Shao-Yu Lien , Ying-Chang Liang , Dusit Niyato , Xuemin , Shen

Packet routing is one of the fundamental problems in computer networks in which a router determines the next-hop of each packet in the queue to get it as quickly as possible to its destination. Reinforcement learning (RL) has been…

Networking and Internet Architecture · Computer Science 2019-11-15 Xinyu You , Xuanjie Li , Yuedong Xu , Hui Feng , Jin Zhao , Huaicheng Yan

In an RF-powered backscatter cognitive radio network, multiple secondary users communicate with a secondary gateway by backscattering or harvesting energy and actively transmitting their data depending on the primary channel state. To…

Machine Learning · Computer Science 2018-10-11 Tran The Anh , Nguyen Cong Luong , Dusit Niyato , Ying-Chang Liang , Dong In Kim

Timely delivery of delay-sensitive information over dynamic, heterogeneous networks is increasingly essential for a range of interactive applications, such as industrial automation, self-driving vehicles, and augmented reality. However,…

Networking and Internet Architecture · Computer Science 2025-10-14 Vincenzo Norman Vitale , Antonia Maria Tulino , Andreas F. Molisch , Jaime Llorca

The convergence of communication and computation, along with the integration of machine learning and artificial intelligence, stand as key empowering pillars for the sixth-generation of communication systems (6G). This paper considers a…

Information Theory · Computer Science 2024-06-07 Robert-Jeron Reifert , Hayssam Dahrouj , Alaa Alameer Ahmad , Haris Gacanin , Aydin Sezgin

Multi-access point coordination (MAPC) is a key feature of IEEE 802.11bn, with a potential impact on future Wi-Fi networks. MAPC enables joint scheduling decisions across multiple access points (APs) to improve throughput, latency, and…

Networking and Internet Architecture · Computer Science 2025-07-28 David Nunez , Francesc Wilhelmi , Maksymilian Wojnar , Katarzyna Kosek-Szott , Szymon Szott , Boris Bellalta

The integration of low earth orbit (LEO) satellites with terrestrial communication networks holds the promise of seamless global connectivity. The efficiency of this connection, however, depends on the availability of reliable channel state…

Signal Processing · Electrical Eng. & Systems 2025-05-13 Yasaman Omid , Marios Aristodemou , Sangarapillai Lambotharan , Mahsa Derakhshani , Lajos Hanzo

Multiplication is arguably the most cost-dominant operation in modern deep neural networks (DNNs), limiting their achievable efficiency and thus more extensive deployment in resource-constrained applications. To tackle this limitation,…

Hardware Architecture · Computer Science 2022-12-20 Huihong Shi , Haoran You , Yang Zhao , Zhongfeng Wang , Yingyan Lin

This article addresses the problem of Ultra Reliable Low Latency Communications (URLLC) in wireless networks, a framework with particularly stringent constraints imposed by many Internet of Things (IoT) applications from diverse sectors. We…

Networking and Internet Architecture · Computer Science 2023-08-29 Benoît-Marie Robaglia , Marceau Coupechoux , Dimitrios Tsilimantos

The manipulator workspace mapping is an important problem in robotics and has attracted significant attention in the community. However, most of the pre-existing algorithms have expensive time complexity due to the reliance on sophisticated…

Robotics · Computer Science 2019-09-30 Peiyuan Liao

Minimizing job scheduling time is a fundamental issue in data center networks that has been extensively studied in recent years. The incoming jobs require different CPU and memory units, and span different number of time slots. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-21 Weijia Chen , Yuedong Xu , Xiaofeng Wu

In this work, we propose a deep reinforcement learning (DRL) based reactive planner to solve large-scale Lidar-based autonomous robot exploration problems in 2D action space. Our DRL-based planner allows the agent to reactively plan its…

Robotics · Computer Science 2024-03-19 Yuhong Cao , Rui Zhao , Yizhuo Wang , Bairan Xiang , Guillaume Sartoretti

Constructing earth-fixed cells with low-earth orbit (LEO) satellites in non-terrestrial networks (NTNs) has been the most promising paradigm to enable global coverage. The limited computing capabilities on LEO satellites however render…

Signal Processing · Electrical Eng. & Systems 2024-10-16 Yang Cao , Shao-Yu Lien , Ying-Chang Liang , Dusit Niyato , Xuemin , Shen