English
Related papers

Related papers: Autonomous Resource Management in Microservice Sys…

200 papers

We study the problem of online model selection in reinforcement learning, where the selector has access to a class of reinforcement learning agents and learns to adaptively select the agent with the right configuration. Our goal is to…

Machine Learning · Computer Science 2025-12-03 Aida Afshar , Aldo Pacchiano

Task allocation is a key combinatorial optimization problem, crucial for modern applications such as multi-robot cooperation and resource scheduling. Decision makers must allocate entities to tasks reasonably across different scenarios.…

Machine Learning · Computer Science 2024-07-02 Aicheng Gong , Kai Yang , Jiafei Lyu , Xiu Li

In terms of the operation of microgrids, optimal scheduling is a vital issue that must be taken into account. In this regard, this paper proposes an effective framework for optimal scheduling of renewable microgrids considering energy…

Systems and Control · Electrical Eng. & Systems 2022-08-10 Hossein Mohammadi , Shiva Jokar , Mojtaba Mohammadi , Abdollah Kavousifard , Morteza Dabbaghjamanesh

With the rapid growth of IoT devices and their diverse workloads, container-based microservices deployed at edge nodes have become a lightweight and scalable solution. However, existing microservice scheduling algorithms often assume static…

Networking and Internet Architecture · Computer Science 2025-12-11 Jingxi Lu , Wenhao Li , Jianxiong Guo , Xingjian Ding , Zhiqing Tang , Tian Wang , Weijia Jia

The exponential growth of data-intensive applications has placed unprecedented demands on modern storage systems, necessitating dynamic and efficient optimization strategies. Traditional heuristics employed for storage performance…

Operating Systems · Computer Science 2025-08-25 Chiyu Cheng , Chang Zhou , Yang Zhao

From out-competing grandmasters in chess to informing high-stakes healthcare decisions, emerging methods from artificial intelligence are increasingly capable of making complex and strategic decisions in diverse, high-dimensional, and…

Computers and Society · Computer Science 2024-03-05 Melissa Chapman , Lily Xu , Marcus Lapeyrolerie , Carl Boettiger

The area of building energy management has received a significant amount of interest in recent years. This area is concerned with combining advancements in sensor technologies, communications and advanced control algorithms to optimize…

Machine Learning · Computer Science 2019-03-18 Karl Mason , Santiago Grijalva

The uncertainty of distributed renewable energy brings significant challenges to economic operation of microgrids. Conventional online optimization approaches require a forecast model. However, accurately forecasting the renewable power…

Systems and Control · Electrical Eng. & Systems 2021-05-31 Hang Shuai , Haibo He

Reinforcement learning and classical planning are typically seen as two distinct problems, with differing formulations necessitating different solutions. Yet, when humans are given a task, regardless of the way it is specified, they can…

Machine Learning · Computer Science 2026-02-10 Gabriel Stella

We consider networked control systems consisting of multiple independent controlled subsystems, operating over a shared communication network. Such systems are ubiquitous in cyber-physical systems, Internet of Things, and large-scale…

Systems and Control · Computer Science 2018-06-14 Burak Demirel , Arunselvan Ramaswamy , Daniel E. Quevedo , Holger Karl

Fine tuning distributed systems is considered to be a craftsmanship, relying on intuition and experience. This becomes even more challenging when the systems need to react in near real time, as streaming engines have to do to maintain…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-17 Luis M. Vaquero , Felix Cuadrado

This work considers the problem of control and resource scheduling in networked systems. We present DIRA, a Deep reinforcement learning based Iterative Resource Allocation algorithm, which is scalable and control-aware. Our algorithm is…

Systems and Control · Computer Science 2019-09-24 Adrian Redder , Arunselvan Ramaswamy , Daniel E. Quevedo

The idea of reusing or transferring information from previously learned tasks (source tasks) for the learning of new tasks (target tasks) has the potential to significantly improve the sample efficiency of a reinforcement learning agent. In…

Artificial Intelligence · Computer Science 2022-09-28 Thommen George Karimpanal , Roland Bouffanais

The manpower scheduling problem is a critical research field in the resource management area. Based on the existing studies on scheduling problem solutions, this paper transforms the manpower scheduling problem into a combinational…

Artificial Intelligence · Computer Science 2021-05-12 Lingyu Zhang , Tianyu Liu , Yunhai Wang

The development of renewable energy generation empowers microgrids to generate electricity to supply itself and to trade the surplus on energy markets. To minimize the overall cost, a microgrid must determine how to schedule its energy…

Systems and Control · Electrical Eng. & Systems 2020-07-10 Guanyu Gao , Yonggang Wen , Xiaohu Wu , Ran Wang

A central challenge in quantum information science and technology is achieving real-time estimation and feedforward control of quantum systems. This challenge is compounded by the inherent inhomogeneity of quantum resources, such as qubit…

Machine Learning · Computer Science 2024-05-28 Linsen Li , Pratyush Anand , Kaiming He , Dirk Englund

The paper investigates stochastic resource allocation problems with scarce, reusable resources and non-preemtive, time-dependent, interconnected tasks. This approach is a natural generalization of several standard resource management…

Machine Learning · Computer Science 2014-01-16 Balázs Csanád Csáji , László Monostori

The paper presents a reinforcement learning solution to dynamic resource allocation for 5G radio access network slicing. Available communication resources (frequency-time blocks and transmit powers) and computational resources (processor…

Networking and Internet Architecture · Computer Science 2020-09-15 Yi Shi , Yalin E. Sagduyu , Tugba Erpek

Resource scheduling and allocation is a critical component of many high impact systems ranging from congestion control to cloud computing. Finding more optimal solutions to these problems often has significant impact on resource and time…

Recent techniques in dynamical scheduling and resource management have found applications in warehouse environments due to their ability to organize and prioritize tasks in a higher temporal resolution. The rise of deep reinforcement…

Machine Learning · Computer Science 2022-03-08 Stelios Stavroulakis , Biswa Sengupta