English
Related papers

Related papers: Efficient Hierarchical Storage Management Framewor…

200 papers

This paper proposes a reinforcement learning-based method for microservice resource scheduling and optimization, aiming to address issues such as uneven resource allocation, high latency, and insufficient throughput in traditional…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-18 Yujun Zou , Nia Qi , Yingnan Deng , Zhihao Xue , Ming Gong , Wuyang Zhang

Cloud computing has emerged as a crucial solution for managing data- and compute-intensive workflows, offering scalability to address dynamic demands. However, security concerns persist, especially for workflows involving sensitive data and…

Cryptography and Security · Computer Science 2025-01-14 Nafiseh Soveizi , Dimka Karastoyanova

Hierarchical Reinforcement Learning (HRL) exploits temporal abstraction to solve large Markov Decision Processes (MDP) and provide transferable subtask policies. In this paper, we introduce an off-policy HRL algorithm: Hierarchical Q-value…

Artificial Intelligence · Computer Science 2016-03-30 Tiancheng Zhao , Mohammad Gowayyed

The power grid is a complex and vital system that necessitates careful reliability management. Managing the grid is a difficult problem with multiple time scales of decision making and stochastic behavior due to renewable energy…

Artificial Intelligence · Computer Science 2016-03-08 Gal Dalal , Elad Gilboa , Shie Mannor

High-frequency trading (HFT) that executes algorithmic trading in short time scales, has recently occupied the majority of cryptocurrency market. Besides traditional quantitative trading methods, reinforcement learning (RL) has become…

Machine Learning · Computer Science 2024-06-21 Chuqiao Zong , Chaojie Wang , Molei Qin , Lei Feng , Xinrun Wang , Bo An

Cloud computing allows scalable resource provisioning, but dynamic workload changes often lead to higher costs due to over-provisioning. Machine learning (ML) approaches, such as Long Short-Term Memory (LSTM) networks, are effective for…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-03 Heet Nagoriya , Komal Rohit

Due to the high efficiency and less weather dependency, autonomous greenhouses provide an ideal solution to meet the increasing demand for fresh food. However, managers are faced with some challenges in finding appropriate control…

Artificial Intelligence · Computer Science 2021-10-20 Wanpeng Zhang , Xiaoyan Cao , Yao Yao , Zhicheng An , Xi Xiao , Dijun Luo

Decision Transformer (DT) is an innovative algorithm leveraging recent advances of the transformer architecture in reinforcement learning (RL). However, a notable limitation of DT is its reliance on recalling trajectories from datasets,…

Machine Learning · Computer Science 2023-11-02 Yi Ma , Chenjun Xiao , Hebin Liang , Jianye Hao

The Industrial Internet of Things (IIoT) demands adaptable Networked Embedded Systems (NES) for optimal performance. Combined with recent advances in Artificial Intelligence (AI), tailored solutions can be developed to meet specific…

Networking and Internet Architecture · Computer Science 2024-05-14 F. Fernando Jurado-Lasso , Charalampos Orfanidis , J. F. Jurado , Xenofon Fafoutis

Driving in dense traffic with human and autonomous drivers is a challenging task that requires high-level planning and reasoning. Human drivers can achieve this task comfortably, and there has been many efforts to model human driver…

Machine Learning · Computer Science 2024-10-28 Yigit Gurses , Kaan Buyukdemirci , Yildiray Yildiz

Training LLMs as interactive agents for multi-turn decision-making remains challenging, particularly in long-horizon tasks with sparse and delayed rewards, where agents must execute extended sequences of actions before receiving meaningful…

Machine Learning · Computer Science 2026-05-12 Jiangweizhi Peng , Yuanxin Liu , Ruida Zhou , Charles Fleming , Zhaoran Wang , Alfredo Garcia , Mingyi Hong

This paper presents a novel heuristic deep reinforcement learning (HDRL) framework designed to optimize reconfigurable intelligent surface (RIS) phase shifts in secure satellite communication systems utilizing rate splitting multiple access…

Signal Processing · Electrical Eng. & Systems 2025-01-22 Tingnan Bao , Melike Erol-Kantarci

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

Optimization and Control · Mathematics 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

Reservoir computing (RC) offers efficient temporal data processing with a low training cost by separating recurrent neural networks into a fixed network with recurrent connections and a trainable linear network. The quality of the fixed…

Emerging Technologies · Computer Science 2021-05-17 John Moon , Wei D. Lu

Cooperative communication is an effective approach to improve spectrum utilization. In order to reduce outage probability of communication system, most studies propose various schemes for relay selection and power allocation, which are…

Systems and Control · Electrical Eng. & Systems 2021-01-29 Yuanzhe Geng , Erwu Liu , Rui Wang , Yiming Liu

Today high-performance computing (HPC) platforms are still dominated by batch jobs. Accordingly, effective batch job scheduling is crucial to obtain high system efficiency. Existing HPC batch job schedulers typically leverage heuristic…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-03 Di Zhang , Dong Dai , Youbiao He , Forrest Sheng Bao , Bing Xie

Online matching problems arise in many complex systems, from cloud services and online marketplaces to organ exchange networks, where timely, principled decisions are critical for maintaining high system performance. Traditional heuristics…

Machine Learning · Statistics 2025-10-09 Chiara Mignacco , Matthieu Jonckheere , Gilles Stoltz

We approach the task of network congestion control in datacenters using Reinforcement Learning (RL). Successful congestion control algorithms can dramatically improve latency and overall network throughput. Until today, no such…

In recent years, robots and autonomous systems have become increasingly integral to our daily lives, offering solutions to complex problems across various domains. Their application in search and rescue (SAR) operations, however, presents…

Robotics · Computer Science 2024-09-23 Dimitrios Panagopoulos , Adolfo Perrusquia , Weisi Guo

Planning safe trajectories under uncertain and dynamic conditions makes the autonomous driving problem significantly complex. Current sampling-based methods such as Rapidly Exploring Random Trees (RRTs) are not ideal for this problem…

Robotics · Computer Science 2020-11-11 Kaleb Ben Naveed , Zhiqian Qiao , John M. Dolan