English
Related papers

Related papers: Real-time Workload Pattern Analysis for Large-scal…

200 papers

Today, cloud workloads are essentially opaque to the cloud platform. Typically, the only information the platform receives is the virtual machine (VM) type and possibly a decoration to the type (e.g., the VM is evictable). Similarly,…

We present a system to support generalized SQL workload analysis and management for multi-tenant and multi-database platforms. Workload analysis applications are becoming more sophisticated to support database administration, model user…

Databases · Computer Science 2018-08-28 Shrainik Jain , Jiaqi Yan , Thierry Cruane , Bill Howe

Database systems often rely on historical query traces to perform workload-based performance tuning. However, real production workloads are time-evolving, making historical queries ineffective for optimizing future workloads. To address…

In a modern DBMS, working memory is frequently the limiting factor when processing in-memory analytic query operations such as joins, sorting, and aggregation. Existing resource estimation approaches for a DBMS estimate the resource…

Modern deep learning models have been exploited in various domains, including computer vision (CV), natural language processing (NLP), search and recommendation. In practical AI clusters, workloads training these models are run using…

Performance · Computer Science 2019-10-15 Mengdi Wang , Chen Meng , Guoping Long , Chuan Wu , Jun Yang , Wei Lin , Yangqing Jia

Cloud computing is ubiquitous: more and more companies are moving the workloads into the Cloud. However, this rise in popularity challenges Cloud service providers, as they need to monitor the quality of their ever-growing offerings…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-04 Mohammad Saiful Islam , William Pourmajidi , Lei Zhang , John Steinbacher , Tony Erwin , Andriy Miranskyy

As Large-Scale Cloud Systems (LCS) become increasingly complex, effective anomaly detection is critical for ensuring system reliability and performance. However, there is a shortage of large-scale, real-world datasets available for…

The precise estimation of resource usage is a complex and challenging issue due to the high variability and dimensionality of heterogeneous service types and dynamic workloads. Over the last few years, the prediction of resource usage and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-07 Deepika Saxena , Jitendra Kumar , Ashutosh Kumar Singh , Stefan Schmid

Large Language Model (LLM) workloads have distinct prefill and decode phases with different compute and memory requirements which should ideally be accounted for when scheduling input queries across different LLM instances in a cluster.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-08 Kunal Jain , Anjaly Parayil , Ankur Mallick , Esha Choukse , Xiaoting Qin , Jue Zhang , Íñigo Goiri , Rujia Wang , Chetan Bansal , Victor Rühle , Anoop Kulkarni , Steve Kofsky , Saravan Rajmohan

Hyperscalars run services across a large fleet of servers, serving billions of users worldwide. These services, however, behave differently than commonly available benchmark suites, resulting in server architectures that are not optimized…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-03 Suyash Mahar , Hao Wang , Wei Shu , Abhishek Dhanotia

Ever since the era of internet had ushered in cloud computing, there had been increase in the demand for the unlimited data available through cloud computing for data analysis, pattern recognition and technology advancement. With this also…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-16 Tosin Ige , Sikiru Adewale

This study proposes an anomaly detection method based on the Transformer architecture with integrated multiscale feature perception, aiming to address the limitations of temporal modeling and scale-aware feature representation in cloud…

Machine Learning · Computer Science 2025-08-26 Lian Lian , Yilin Li , Song Han , Renzi Meng , Sibo Wang , Ming Wang

Cloud providers introduce features (e.g., Spot VMs, Harvest VMs, and Burstable VMs) and optimizations (e.g., oversubscription, auto-scaling, power harvesting, and overclocking) to improve efficiency and reliability. To effectively utilize…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-14 Anjaly Parayil , Jue Zhang , Xiaoting Qin , Íñigo Goiri , Lexiang Huang , Timothy Zhu , Chetan Bansal

The workload prediction and resource allocation significantly play an inevitable role in production of an efficient cloud environment. The proactive estimation of future workload followed by decision of resource allocation have become a…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-30 Deepika Saxena , Ashutosh Kumar Singh

In the recent past, characterizing workloads has been attempted to gain a foothold in the emerging serverless cloud market, especially in the large production cloud clusters of Google, AWS, and so forth. While analyzing and characterizing…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-25 Thomas van Loo , Anshul Jindal , Shajulin Benedict , Mohak Chadha , Michael Gerndt

Modern machine learning (ML) has grown into a tightly coupled, full-stack ecosystem that combines hardware, software, network, and applications. Many users rely on cloud providers for elastic, isolated, and cost-efficient resources.…

Performance · Computer Science 2025-11-03 Ziji Chen , Steven W. D. Chien , Peng Qian , Noa Zilberman

Predicting future resource demand in Cloud Computing is essential for optimizing the trade-off between serving customers' requests efficiently and minimizing the provisioning cost. Modelling prediction uncertainty is also desirable to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-14 Andrea Rossi , Andrea Visentin , Diego Carraro , Steven Prestwich , Kenneth N. Brown

Despite the potential of language model-based agents to solve real-world tasks such as web navigation, current methods still struggle with long-horizon tasks with complex action trajectories. In contrast, humans can flexibly solve complex…

Computation and Language · Computer Science 2024-09-12 Zora Zhiruo Wang , Jiayuan Mao , Daniel Fried , Graham Neubig

With the rapid development of multi-cloud environments, it is increasingly important to ensure the security and reliability of intelligent monitoring systems. In this paper, we propose an anomaly detection and early warning mechanism for…

Machine Learning · Computer Science 2025-06-10 Yihong Jin , Ze Yang , Juntian Liu , Xinhe Xu

Recent advancements in large language models (LLMs) have driven a revolutionary paradigm shift in process automation from Robotic Process Automation to Agentic Process Automation by automating the workflow orchestration procedure based on…

Software Engineering · Computer Science 2024-11-11 Shengda Fan , Xin Cong , Yuepeng Fu , Zhong Zhang , Shuyan Zhang , Yuanwei Liu , Yesai Wu , Yankai Lin , Zhiyuan Liu , Maosong Sun