English
Related papers

Related papers: Optimisation of job scheduling for supercomputers …

200 papers

Modern online large language model (LLM) services, such as Retrieval-Augmented Generation (RAG) and agent systems, increasingly expose two prominent characteristics: prompt segmentation (e.g., system instructions, retrieved passages, tool…

Machine Learning · Computer Science 2026-05-12 Xingyu Qu , Tianhao Lin , Yiqi Li , Zhiyu Chen , Sheng Wang

We consider a distributed server system consisting of a large number of servers, each with limited capacity on multiple resources (CPU, memory, disk, etc.). Jobs with different rewards arrive over time and require certain amounts of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-29 Konstantinos Psychas , Javad Ghaderi

This work studies the behavior of state-of-the-art memory controller designs when executing scale-out workloads. It considers memory scheduling techniques, memory page management policies, the number of memory channels, and the address…

Hardware Architecture · Computer Science 2016-12-01 Mostafa Mahmoud , Andreas Moshovos

Cache partitioning techniques have been successfully adopted to mitigate interference among concurrently executing real-time tasks on multi-core processors. Considering that the execution time of a cache-sensitive task strongly depends on…

Hardware Architecture · Computer Science 2023-10-05 Binqi Sun , Debayan Roy , Tomasz Kloda , Andrea Bastoni , Rodolfo Pellizzoni , Marco Caccamo

In high performance computing, researchers try to optimize the CPU Scheduling algorithms, for faster and efficient working of computers. But a process needs both CPU bound and I/O bound for completion of its execution. With modernization of…

Operating Systems · Computer Science 2019-08-06 Amar Ranjan Dash , Sandipta Kumar Sahu , B Kewal

Resource allocation in High Performance Computing (HPC) settings is still not easy for end-users due to the wide variety of application and environment configuration options. Users have difficulties to estimate the number of processors and…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-10 Eduardo R. Rodrigues , Renato L. F. Cunha , Marco A. S. Netto , Michael Spriggs

Multi-server jobs that request multiple computing resources and hold onto them during their execution dominate modern computing clusters. When allocating the multi-type resources to several co-located multi-server jobs simultaneously in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-08 Hailiang Zhao , Shuiguang Deng , Zhengzhe Xiang , Xueqiang Yan , Jianwei Yin , Schahram Dustdar , Albert Y. Zomaya

The evolution of high-performance computing is associated with the growth of energy consumption. Performance of cluster computes (is increased via rising in performance and the number of used processors, GPUs, and coprocessors. An increment…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-23 E. A. Kiselev , P. N. Telegin , B. M. Shabanov

A large proportion of jobs submitted to modern computing clusters and data centers are parallelizable and capable of running on a flexible number of computing cores or servers. Although allocating more servers to such a job results in a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-17 Samira Ghanbarian , Arpan Mukhopadhyay , Ravi R. Mazumdar , Fabrice M. Guillemin

Today's high-speed switches employ an on-chip shared packet buffer. The buffer is becoming increasingly insufficient as it cannot scale with the growing switching capacity. Nonetheless, the buffer needs to face highly intense bursts and…

Networking and Internet Architecture · Computer Science 2025-01-24 Danfeng Shan , Yunguang Li , Jinchao Ma , Zhenxing Zhang , Zeyu Liang , Xinyu Wen , Hao Li , Wanchun Jiang , Nan Li , Fengyuan Ren

Job schedulers are a key component of scalable computing infrastructures. They orchestrate all of the work executed on the computing infrastructure and directly impact the effectiveness of the system. Recently, job workloads have…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-06 Albert Reuther , Chansup Byun , William Arcand , David Bestor , Bill Bergeron , Matthew Hubbell , Michael Jones , Peter Michaleas , Andrew Prout , Antonio Rosa , Jeremy Kepner

Large language models (LLMs) have become increasingly popular in various areas, traditional business gradually shifting from rule-based systems to LLM-based solutions. However, the inference of LLMs is resource-intensive or…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-06 Wanyi Zheng , Minxian Xu , Shengye Song , Kejiang Ye

The increasing prevalence of cloud-native technologies, particularly containers, has led to the widespread adoption of containerized deployments in data centers. The advancement of deep neural network models has increased the demand for…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-22 Jinlong Hu , Zhizhe Rao , Xingchen Liu , Lihao Deng , Shoubin Dong

Traditionally, HPC workloads have been deployed in bare-metal clusters; but the advances in virtualization have led the pathway for these workloads to be deployed in virtualized clusters. However, HPC cluster administrators/providers still…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-24 Jashwant Raj Gunasekaran , Michael Cui , Prashanth Thinakaran , Josh Simons , Mahmut Taylan Kandemir , Chita R. Das

Serverless computing has seen rapid growth due to the ease-of-use and cost-efficiency it provides. However, function scheduling, a critical component of serverless systems, has been overlooked. In this paper, we take a first-principles…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-16 Kostis Kaffes , Neeraja J. Yadwadkar , Christos Kozyrakis

Quantum computing has gained considerable attention, especially after the arrival of the Noisy Intermediate-Scale Quantum (NISQ) era. Quantum processors and cloud services have been made world-wide increasingly available. Unfortunately,…

Hardware Architecture · Computer Science 2025-05-05 Wenjie Wu , Yiquan Wang , Ge Yan , Yuming Zhao , Bo Zhang , Junchi Yan

With the progression into the quantum utility era, computing is shifting toward quantum-centric architectures, where multiple quantum processors collaborate with classical computing resources. Platforms such as IBM Quantum and Amazon Braket…

Quantum Physics · Physics 2025-03-13 Jinyang Li , Yuhong Song , Yipei Liu , Jianli Pan , Lei Yang , Travis Humble , Weiwen Jiang

Modern computing workloads are often composed of parallelizable jobs. A parallelizable job can be completed more quickly when run on additional servers. However, each job can only use a limited number of servers, known as its…

Performance · Computer Science 2025-12-30 Benjamin Berg , Benjamin Moseley , Weina Wang , Mor Harchol-Balter

Hybrid memory systems comprised of dynamic random access memory (DRAM) and non-volatile memory (NVM) have been proposed to exploit both the capacity advantage of NVM and the latency and dynamic energy advantages of DRAM. An important…

Hardware Architecture · Computer Science 2019-12-18 Yang Li , Jongmoo Choi , Jin Sun , Saugata Ghose , Hui Wang , Justin Meza , Jinglei Ren , Onur Mutlu

Organizations around the world schedule jobs (programs) regularly to perform various tasks dictated by their end users. With the major movement towards using a cloud computing infrastructure, our organization follows a hybrid approach with…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-23 Sunandita Patra , Mehtab Pathan , Mahmoud Mahfouz , Parisa Zehtabi , Wided Ouaja , Daniele Magazzeni , Manuela Veloso