中文
相关论文

相关论文: Anomaly Analysis for Co-located Datacenter Workloa…

200 篇论文

Over the past ten years, many different approaches have been proposed for different aspects of the problem of resources management for long running, dynamic and diverse workloads such as processing query streams or distributed deep…

性能 · 计算机科学 2023-08-24 Nader Alfares , George Kesidis , Ata Fatahi Baarzi , Aman Jain

Large-scale international collaborations such as ATLAS rely on globally distributed workflows and data management to process, move, and store vast volumes of data. ATLAS's Production and Distributed Analysis (PanDA) workflow system and the…

In a cloud data center, a single physical machine simultaneously executes dozens of highly heterogeneous tasks. Such colocation results in more efficient utilization of machines, but, when tasks' requirements exceed available resources,…

分布式、并行与集群计算 · 计算机科学 2017-09-06 Pawel Janus , Krzysztof Rzadca

This research investigates how Machine Learning (ML) algorithms can assist in workload allocation strategies by detecting tasks with node affinity operators (referred to as constraint operators), which constrain their execution to a limited…

机器学习 · 计算机科学 2025-09-25 Leszek Sliwko

While detailed resource usage monitoring is possible on the low-level using proper tools, associating such usage with higher-level abstractions in the application layer that actually cause the resource usage in the first place presents a…

分布式、并行与集群计算 · 计算机科学 2024-08-02 Joel Witzke , Ansgar Lößer , Vasilis Bountris , Florian Schintke , Björn Scheuermann

Cloud providers introduce features (e.g., Spot VMs, Harvest VMs, and Burstable VMs) and optimizations (e.g., oversubscription, auto-scaling, power harvesting, and overclocking) to improve efficiency and reliability. To effectively utilize…

分布式、并行与集群计算 · 计算机科学 2024-05-14 Anjaly Parayil , Jue Zhang , Xiaoting Qin , Íñigo Goiri , Lexiang Huang , Timothy Zhu , Chetan Bansal

Cloud service providers are distributing data centers geographically to minimize energy costs through intelligent workload distribution. With increasing data volumes in emerging cloud workloads, it is critical to factor in the network costs…

分布式、并行与集群计算 · 计算机科学 2021-06-02 Ninad Hogade , Sudeep Pasricha , Howard Jay Siegel

This paper addresses the joint scheduling problem of stochastic workloads and a hydrogen-enabled distributed energy system in a low-carbon Internet data centers (IDC). Although such workloads can be shifted over temporal and spatial…

系统与控制 · 电气工程与系统科学 2025-12-05 Maoyuan Ma , Wangyi Guo , Lei Yang , Zhanbo Xu , Xiaohong Guan

At present there are a number of barriers to creating an energy efficient workload scheduler for a Private Cloud based data center. Firstly, the relationship between different workloads and power consumption must be investigated. Secondly,…

分布式、并行与集群计算 · 计算机科学 2011-05-16 James W. Smith , Ian Sommerville

Failed workloads that consumed significant computational resources in time and space affect the efficiency of data centers significantly and thus limit the amount of scientific work that can be achieved. While the computational power has…

分布式、并行与集群计算 · 计算机科学 2023-01-13 Jie Li , Rui Wang , Ghazanfar Ali , Tommy Dang , Alan Sill , Yong Chen

Scientific workflows process extensive data sets over clusters of independent nodes, which requires a complex stack of infrastructure components, especially a resource manager (RM) for task-to-node assignment, a distributed file system…

Data centers play a key role in today's Internet. Cloud applications are mainly hosted on multi-tenant warehouse-scale data centers. Anomalies pose a serious threat to data centers' operations. If not controlled properly, a simple anomaly…

网络与互联网体系结构 · 计算机科学 2019-06-18 Ashkan Aghdai , Kang Xi , H. Jonathan Chao

Improving datacenter operations is vital for the digital society. We posit that doing so requires our community to shift, from operational aspects taken in isolation to holistic analysis of datacenter resources, energy, and workloads. In…

分布式、并行与集群计算 · 计算机科学 2021-07-27 Laurens Versluis , Mehmet Cetin , Caspar Greeven , Kristian Laursen , Damian Podareanu , Valeriu Codreanu , Alexandru Uta , Alexandru Iosup

Datacenter networks routinely support the data transfers of distributed computing frameworks in the form of coflows, i.e., sets of concurrent flows related to a common task. The vast majority of the literature has focused on the problem of…

分布式、并行与集群计算 · 计算机科学 2022-05-04 Quang-Trung Luu , Olivier Brun , Rachid El-Azouzi , Francesco De Pellegrini , Balakrishna J. Prabhu , Cédric Richier

Scientific workflow management systems support large-scale data analysis on cluster infrastructures. For this, they interact with resource managers which schedule workflow tasks onto cluster nodes. In addition to workflow task descriptions,…

分布式、并行与集群计算 · 计算机科学 2025-04-30 Jonathan Bader , Kathleen West , Soeren Becker , Svetlana Kulagina , Fabian Lehmann , Lauritz Thamsen , Henning Meyerhenke , Odej Kao

The increasingly wide application of Cloud Computing enables the consolidation of tens of thousands of applications in shared infrastructures. Thus, meeting the quality of service requirements of so many diverse applications in such shared…

分布式、并行与集群计算 · 计算机科学 2015-01-06 Lan Wang , Erol Gelenbe

Increasing need for large-scale data analytics in a number of application domains has led to a dramatic rise in the number of distributed data management systems, both parallel relational databases, and systems that support alternative…

数据库 · 计算机科学 2013-02-19 K. Ashwin Kumar , Amol Deshpande , Samir Khuller

Regional data center clusters have flourished in recent years to serve customers in a major city with low latency. The optimal coordination of data centers in a regional cluster has become a pressing issue because of its rising energy…

最优化与控制 · 数学 2023-06-13 Shihan Huang , Dongxiang Yan , Yue Chen

The increasing energy demands and carbon footprint of large-scale AI require intelligent workload management in globally distributed data centers. Yet progress is limited by the absence of benchmarks that realistically capture the interplay…

Co-scheduling of jobs in data-centers is a challenging scenario, where jobs can compete for resources yielding to severe slowdowns or failed executions. Efficient job placement on environments where resources are shared requires awareness…

机器学习 · 计算机科学 2020-07-07 David Buchaca Prats , Joan Marcual , Josep Lluís Berral , David Carrera