English
Related papers

Related papers: Duration-Informed Workload Scheduler

200 papers

Energy consumption is one of the most critical concerns in designing computing devices, ranging from portable embedded systems to computer cluster systems. Furthermore, in the past decade, cluster systems have increasingly risen as popular…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-12 Amirhossein Esmaili , Massoud Pedram

Industrial timetabling is a critical task for decision-makers across various sectors to ensure efficient system operation. In real-world settings, it remains challenging because unexpected events often disrupt execution. When such events…

Human-Computer Interaction · Computer Science 2026-01-13 Kévin Ducharlet , Liwen Zhang , Sara Maqrot , Houssem Saidi

The ability to accurately estimate job runtime properties allows a scheduler to effectively schedule jobs. State-of-the-art online cluster job schedulers use history-based learning, which uses past job execution information to estimate the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-17 Akshay Jajoo , Y. Charlie Hu , Xiaojun Lin , Nan Deng

Workflows provide an expressive programming model for fine-grained control of large-scale applications in distributed computing environments. Accurate estimates of complex workflow execution metrics on large-scale machines have several key…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-18 Alok Singh , Mai Nguyen , Shweta Purawat , Daniel Crawl , Ilkay Altintas

To extract value from evergrowing volumes of data, coming from a number of different sources, and to drive decision making, organizations frequently resort to the composition of data processing workflows, since they are expressive,…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-13 Sérgio Esteves , Helena Galhardas , Luís Veiga

In many traditional job scheduling settings, it is assumed that one knows the time it will take for a job to complete service. In such cases, strategies such as shortest job first can be used to improve performance in terms of measures such…

Data Structures and Algorithms · Computer Science 2019-05-24 Michael Mitzenmacher

Accurate delivery delay prediction is critical for maintaining operational efficiency and customer satisfaction across modern supply chains. Yet the increasing complexity of logistics networks, spanning multimodal transportation,…

Prior research in resource scheduling for machine learning training workloads has largely focused on minimizing job completion times. Commonly, these model training workloads collectively search over a large number of parameter values that…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-09 Richard Liaw , Romil Bhardwaj , Lisa Dunlap , Yitian Zou , Joseph Gonzalez , Ion Stoica , Alexey Tumanov

We consider a natural scheduling problem which arises in many distributed computing frameworks. Jobs with diverse resource requirements (e.g. memory requirements) arrive over time and must be served by a cluster of servers, each with a…

Networking and Internet Architecture · Computer Science 2019-01-21 Konstantinos Psychas , Javad Ghaderi

In Large Language Model (LLM) inference, the output length of an LLM request is typically regarded as not known a priori. Consequently, most LLM serving systems employ a simple First-come-first-serve (FCFS) scheduling strategy, leading to…

Machine Learning · Computer Science 2024-08-29 Yichao Fu , Siqi Zhu , Runlong Su , Aurick Qiao , Ion Stoica , Hao Zhang

Complex scientific workflows can process large amounts of data using thousands of tasks. The turnaround times of these workflows are often affected by various latencies such as the resource discovery, scheduling and data access latencies…

Scheduling of service requests in Cloud computing has traditionally focused on the reduction of pre-service wait, generally termed as waiting time. Under certain conditions such as peak load, however, it is not always possible to give…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-08-21 Carlos Cardonha , Marcos D. Assunção , Marco A. S. Netto , Renato L. F. Cunha , Carlos Queiroz

The ever-growing processing power of supercomputers in recent decades enables us to explore increasing complex scientific problems. Effective scheduling these jobs is crucial for individual job performance and system efficiency. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-21 Yuping Fan

The precise estimation of resource usage is a complex and challenging issue due to the high variability and dimensionality of heterogeneous service types and dynamic workloads. Over the last few years, the prediction of resource usage and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-07 Deepika Saxena , Jitendra Kumar , Ashutosh Kumar Singh , Stefan Schmid

Real-time systems are intrinsic components of many pivotal applications, such as self-driving vehicles, aerospace and defense systems. The trend in these applications is to incorporate multiple tasks onto fewer, more powerful hardware…

Operating Systems · Computer Science 2024-10-03 V. Gabriel Moyano , Zain A. H. Hammadeh , Selma Saidi , Daniel Lüdtke

Efficient resource utilization and perfect user experience usually conflict with each other in cloud computing platforms. Great efforts have been invested in increasing resource utilization but trying not to affect users' experience for…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-04 Hang Dong , Liwen Zhu , Zhao Shan , Bo Qiao , Fangkai Yang , Si Qin , Chuan Luo , Qingwei Lin , Yuwen Yang , Gurpreet Virdi , Saravan Rajmohan , Dongmei Zhang , Thomas Moscibroda

Deep learning (DL) shows its prosperity in a wide variety of fields. The development of a DL model is a time-consuming and resource-intensive procedure. Hence, dedicated GPU accelerators have been collectively constructed into a GPU…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-02 Wei Gao , Qinghao Hu , Zhisheng Ye , Peng Sun , Xiaolin Wang , Yingwei Luo , Tianwei Zhang , Yonggang Wen

Minimizing job scheduling time is a fundamental issue in data center networks that has been extensively studied in recent years. The incoming jobs require different CPU and memory units, and span different number of time slots. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-21 Weijia Chen , Yuedong Xu , Xiaofeng Wu

We consider the problem of scheduling transmissions over low-latency wireless communication links to control various control systems. Low-latency requirements are critical in developing wireless technology for industrial control and Tactile…

Signal Processing · Electrical Eng. & Systems 2019-10-31 Mark Eisen , Mohammad M. Rashid , Dave Cavalcanti , Alejandro Ribeiro

To leverage prediction models to make optimal scheduling decisions in service systems, we must understand how predictive errors impact congestion due to externalities on the delay of other jobs. Motivated by applications where prediction…

Optimization and Control · Mathematics 2026-01-06 Jiung Lee , Hongseok Namkoong , Yibo Zeng