English
Related papers

Related papers: GlideinBenchmark: collecting resource information …

200 papers

We present a scheduler that improves cluster utilization and job completion times by packing tasks having multi-resource requirements and inter-dependencies. While the problem is algorithmically very hard, we achieve near-optimality on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-26 Robert Grandl , Srikanth Kandula , Sriram Rao , Aditya Akella , Janardhan Kulkarni

Benchmarking of CPU resources in WLCG has been based on the HEP-SPEC06 (HS06) suite for over a decade. It has recently become clear that HS06, which is based on real applications from non-HEP domains, no longer describes typical HEP…

Conventionally, the resource allocation is formulated as an optimization problem and solved online with instantaneous scenario information. Since most resource allocation problems are not convex, the optimal solutions are very difficult to…

Machine Learning · Computer Science 2017-12-20 Jun-Bo Wang , Junyuan Wang , Yongpeng Wu , Jin-Yuan Wang , Huiling Zhu , Min Lin , Jiangzhou Wang

Distributed stream processing frameworks help building scalable and reliable applications that perform transformations and aggregations on continuous data streams. This paper introduces ShuffleBench, a novel benchmark to evaluate the…

Software Engineering · Computer Science 2024-03-08 Sören Henning , Adriano Vogel , Michael Leichtfried , Otmar Ertl , Rick Rabiser

GPUs offer massive compute parallelism and high-bandwidth memory accesses. GPU database systems seek to exploit those capabilities to accelerate data analytics. Although modern GPUs have more resources (e.g., higher DRAM bandwidth) than…

Databases · Computer Science 2023-02-03 Jiashen Cao , Rathijit Sen , Matteo Interlandi , Joy Arulraj , Hyesoon Kim

Algorithms, policies, and methodologies are necessary to achieve high user satisfaction and practical utilization in cloud computing by ensuring the efficient and fair allocation of every computing resource. Whenever a new job arrives in…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-03-12 Mohammed Radi

We investigate a hierarchically organized cloud infrastructure and compare distributed hierarchical control based on resource monitoring with market mechanisms for resource management. The latter do not require a model of the system, incur…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-04-15 Dan C. Marinescu , Ashkan Paya , John P. Morrison , Philip Healy

While edge computing is envisioned to superbly serve latency sensitive applications, the implementation-based studies benchmarking its performance are few and far between. To address this gap, we engineer a modular edge cloud computing…

Networking and Internet Architecture · Computer Science 2020-09-02 Francisco Carpio , Marta Delgado , Admela Jukan

We consider the setting where a service is hosted on a third-party edge server deployed close to the users and a cloud server at a greater distance from the users. Due to the proximity of the edge servers to the users, requests can be…

Networking and Internet Architecture · Computer Science 2024-03-07 Aadesh Madnaik , Sharayu Moharir , Nikhil Karamchandani

Cloud Computing is a paradigm of both parallel processing and distributed computing. It offers computing facilities as a utility service in pay as par use manner. Virtualization, self service provisioning, elasticity and pay per use are the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-20 Syed Arshad Ali , Mansaf Alam

Meta Computing is a new computing paradigm, which aims to solve the problem of computing islands in current edge computing paradigms and integrate all the resources on a network by incorporating cloud, edge, and particularly terminal-end…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-27 Yandi Li , Jianxiong Guo , Yupeng Li , Tian Wang , Weijia Jia

We propose a simple yet effective policy for the predictive auto-scaling of horizontally scalable applications running in cloud environments, where compute resources can only be added with a delay, and where the deployment throughput is…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-05 Valentin Flunkert , Quentin Rebjock , Joel Castellon , Laurent Callot , Tim Januschowski

In recent years, cloud computing has been widely used. Cloud computing refers to the centralized computing resources, users through the access to the centralized resources to complete the calculation, the cloud computing center will return…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-28 Yifan Zhang , Bo Liu , Yulu Gong , Jiaxin Huang , Jingyu Xu , Weixiang Wan

The rapid development of the mobile Internet and the Internet of Things is leading to a diversification of user devices and the emergence of new mobile applications on a regular basis. Such applications include those that are…

Computational Engineering, Finance, and Science · Computer Science 2024-08-13 Xirui Tang , Zeyu Wang , Xiaowei Cai , Honghua Su , Changsong Wei

Computational Grids, emerging as an infrastructure for next generation computing, enable the sharing, selection, and aggregation of geographically distributed resources for solving large-scale problems in science, engineering, and commerce.…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Rajkumar Buyya

Cloud resource allocation has emerged as a major challenge in modern computing environments, with organizations struggling to manage complex, dynamic workloads while optimizing performance and cost efficiency. Traditional heuristic…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Deep Bodra , Sushil Khairnar

Cloud data centers face increasing pressure to reduce operational energy consumption as big data workloads continue to grow in scale and complexity. This paper presents a workload aware and energy efficient scheduling framework that…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-21 Milan Parikh , Aniket Abhishek Soni , Sneja Mitinbhai Shah , Ayush Raj Jha

Workflow technology is widely used to facilitate the business process in enterprise information systems (EIS), and it has the potential to reduce design time, enhance product quality and decrease product cost. However, significant…

Software Engineering · Computer Science 2012-09-19 Tingyu Liu , Yalong Cheng , Zhonghua Ni

Containers are standalone, self-contained units that package software and its dependencies together. They offer lightweight performance isolation, fast and flexible deployment, and fine-grained resource sharing. They have gained popularity…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-04 Maria A. Rodriguez , Rajkumar Buyya

Multi-tenant machine learning services have become emerging data-intensive workloads in data centers with heavy usage of GPU resources. Due to the large scale, many tuning parameters and heavy resource usage, it is usually impractical to…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-11 Ruofan Liang , Bingsheng He , Shengen Yan , Peng Sun