English
Related papers

Related papers: Pre-Execution Query Slot-Time Prediction in Cloud …

200 papers

The expansion of large language models is increasingly limited by the constrained memory capacity of modern GPUs. To mitigate this, Mixture-of-Experts (MoE) architectures activate only a small portion of parameters during inference,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-31 Zixu Shen , Kexin Chu , Yifan Zhang , Dawei Xiang , Runxin Wu , Wei Zhang

In an overloaded FaaS cluster, individual worker nodes strain under lengthening queues of requests. Although the cluster might be eventually horizontally-scaled, adding a new node takes dozens of seconds. As serving applications are tuned…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-01 Paweł Żuk , Bartłomiej Przybylski , Krzysztof Rzadca

In this work, we develop machine learning (ML) based strategies to predict resources (costs) required for massively parallel chemistry computations, such as coupled-cluster methods, to guide application users before they commit to running…

Machine Learning · Computer Science 2025-09-26 Tanzila Tabassum , Omer Subasi , Ajay Panyala , Epiya Ebiapia , Gerald Baumgartner , Erdal Mutlu , P. , Sadayappan , Karol Kowalski

In light of recent work on scheduling with predicted job sizes, we consider the effect of the cost of predictions in queueing systems, removing the assumption in prior research that predictions are external to the system's resources and/or…

Machine Learning · Computer Science 2024-02-07 Rana Shahout , Michael Mitzenmacher

This article intends to systematically identify and comparatively analyze state-of-the-art supply chain (SC) forecasting strategies and technologies. A novel framework has been proposed incorporating Big Data Analytics in SC Management…

Machine Learning · Computer Science 2025-09-04 Md Abrar Jahin , Md Sakib Hossain Shovon , Jungpil Shin , Istiyaque Ahmed Ridoy , M. F. Mridha

With the maturity of web services, containers, and cloud computing technologies, large services in traditional systems (e.g. the computation services of machine learning and artificial intelligence) are gradually being broken down into many…

Software Engineering · Computer Science 2024-02-05 Abel C. H. Chen

Hosting diverse large language model workloads in a unified resource pool through co-location is cost-effective. For example, long-running chat services generally follow diurnal traffic patterns, which inspire co-location of batch jobs to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-19 Ping Zhang , Lei Su , Jinjie Yang , Xin Chen

Low-latency communication has recently attracted considerable attention owing to its potential of enabling delay-sensitive services in next-generation industrial cyber-physical systems. To achieve target average or maximum delay given…

Information Theory · Computer Science 2025-06-17 Lintao Li , Wei Chen

This study develops a cloud-based deep learning system for early prediction of diabetes, leveraging the distributed computing capabilities of the AWS cloud platform and deep learning technologies to achieve efficient and accurate risk…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-07 Yang Zhang , Fa Wang , Xin Huang , Xintao Li , Sibei Liu , Hansong Zhang

Smart databases are adopting artificial intelligence (AI) technologies to achieve {\em instance optimality}, and in the future, databases will come with prepackaged AI models within their core components. The reason is that every database…

Databases · Computer Science 2021-05-27 Debjyoti Paul , Jie Cao , Feifei Li , Vivek Srikumar

Recent advancements in LLM pretraining have featured ever-expanding context windows to process longer sequences. However, our pilot study reveals that models pretrained with shorter context windows consistently outperform their long-context…

Computation and Language · Computer Science 2025-12-03 Tongyao Zhu , Qian Liu , Haonan Wang , Shiqi Chen , Xiangming Gu , Tianyu Pang , Min-Yen Kan

We present a framework for scheduling multifunction serverless applications over a hybrid public-private cloud. A set of serverless jobs is input as a batch, and the objective is to schedule function executions over the hybrid platform to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-09 Anirban Das , Andrew Leaf , Carlos A. Varela , Stacy Patterson

High load latency that results from deep cache hierarchies and relatively slow main memory is an important limiter of single-thread performance. Data prefetch helps reduce this latency by fetching data up the hierarchy before it is…

Hardware Architecture · Computer Science 2021-03-30 Majid Jalili , Mattan Erez

Serverless computing eliminates infrastructure management overhead but introduces significant challenges regarding cold start latency and resource utilization. Traditional static resource allocation often leads to inefficiencies under…

Artificial Intelligence · Computer Science 2026-04-08 Zeyu Wang , Cuiqianhe Du , Renyue Zhang , Kejian Tong , Qi He , Qiyuan Tian

Federated learning (FL) across multiple HPC facilities faces stochastic admission delays from batch schedulers that dominate wall-clock time. Synchronous FL suffers from severe stragglers, while asynchronous FL accumulates stale updates…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Yijiang Li , Emon Dey , Zilinghan Li , Krishnan Raghavan , Ravi Madduri , Kibaek Kim

Streaming algorithms are fundamental in the analysis of large and online datasets. A key component of many such analytic tasks is $q$-MAX, which finds the largest $q$ values in a number stream. Modern approaches attain a constant runtime by…

Data Structures and Algorithms · Computer Science 2024-07-11 Ran Ben-Basat , Gil Einziger , Wenchen Han , Bilal Tayh

Task scheduling is a well-studied problem in the context of optimizing the Quality of Service (QoS) of cloud computing environments. In order to sustain the rapid growth of computational demands, one of the most important QoS metrics for…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-24 Shreshth Tuli , Giuliano Casale , Nicholas R. Jennings

This paper addresses aircraft delays, emphasizing their impact on safety and financial losses. To mitigate these issues, an innovative machine learning (ML)-enhanced landing scheduling methodology is proposed, aiming to improve automation…

Artificial Intelligence · Computer Science 2023-11-28 Yutian Pang , Peng Zhao , Jueming Hu , Yongming Liu

The cost of delays was estimated as 33 billion US dollars only in 2019 for the US National Airspace System, a peak value following a growth trend in past years. Aiming to address this huge inefficiency, we designed and developed a novel…

Machine Learning · Computer Science 2023-10-16 Ítalo Romani de Oliveira , Samet Ayhan , Michael Biglin , Pablo Costas , Euclides C. Pinto Neto

Job scheduling is a critical component of workload management systems that can significantly influence system performance, e.g., in HPC clusters. The scheduling objectives are often mixed, such as maximizing resource utilization and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-07 Lingfei Wang , Aaron Harwood , Maria A. Rodriguez