English
Related papers

Related papers: Canary: A Scheduling Architecture for High Perform…

200 papers

To deliver high performance in power limited systems, architects have turned to using heterogeneous systems, either CPU+GPU or mixed CPU-hardware systems. However, in systems with different processor types and task affinities, scheduling…

Performance · Computer Science 2017-12-12 Zhuo Chen , Diana Marculescu

The emerging large-scale and data-hungry algorithms require the computations to be delegated from a central server to several worker nodes. One major challenge in the distributed computations is to tackle delays and failures caused by the…

Information Theory · Computer Science 2021-03-03 Alejandro Cohen , Guillaume Thiran , Homa Esfahanizadeh , Muriel Médard

This paper proposes an architectural framework for the efficient orchestration of containers in cloud environments. It centres around resource scheduling and rescheduling policies as well as autoscaling algorithms that enable the creation…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-26 Rajkumar Buyya , Maria A. Rodriguez , Adel Nadjaran Toosi , Jaeman Park

When orchestrating highly distributed and data-intensive Web service workflows the geographical placement of the orchestration engine can greatly affect the overall performance of a workflow. Orchestration engines are typically run from…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-02-04 Michael Luckeneder , Adam Barker

The under exploitation of the available resources risks to be one of the main problems for a computing center. The growing demand of computational power necessarily entails more complex approaches in the management of the computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-05-01 Federico Calzolari , Silvia Volpe

For a deep learning model, efficient execution of its computation graph is key to achieving high performance. Previous work has focused on improving the performance for individual nodes of the computation graph, while ignoring the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-26 Linpeng Tang , Yida Wang , Theodore L. Willke , Kai Li

Consider a set of jobs connected to a directed acyclic task graph with a fixed source and sink. The edges of this graph model precedence constraints and the jobs have to be scheduled with respect to those. We introduce the Server Cloud…

Data Structures and Algorithms · Computer Science 2023-02-20 Marten Maack , Friedhelm Meyer auf der Heide , Simon Pukrop

Due to the ubiquity of batch data processing in cloud computing, the related problem of scheduling malleable batch tasks and its extensions have received significant attention recently. In this paper, we consider a fundamental model where a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-06 Xiaohu Wu , Patrick Loiseau

With the rapid growth of live streaming services, Crowdsourced Cloud-edge service Platforms (CCPs) are playing an increasingly important role in meeting the increasing demand. Although stream scheduling plays a critical role in optimizing…

Machine Learning · Computer Science 2025-05-30 Yuting Li , Shaoyuan Huang , Tengwen Zhang , Cheng Zhang , Xiaofei Wang , Victor C. M. Leung

Today's clusters often have to divide resources among a diverse set of jobs. These jobs are heterogeneous both in execution time and in their rate of arrival. Execution time heterogeneity has lead to the development of hybrid schedulers…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-21 Samuel S. Ogden , Tian Guo

This paper introduces Dodoor, an efficient randomized decentralized scheduler designed for task scheduling in modern data centers. Dodoor leverages advanced research on the weighted balls-into-bins model with b-batched setting. Unlike other…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-16 Wei Da , Evangelia Kalyvianaki

The ever-growing processing power of supercomputers in recent decades enables us to explore increasing complex scientific problems. Effective scheduling these jobs is crucial for individual job performance and system efficiency. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-21 Yuping Fan

Models of parallel processing systems typically assume that one has $l$ workers and jobs are split into an equal number of $k=l$ tasks. Splitting jobs into $k > l$ smaller tasks, i.e. using ``tiny tasks'', can yield performance and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-24 Stefan Bora , Brenton Walker , Markus Fidler

Maximizing resource utilization by performing an efficient resource provisioning is a key factor for any cloud provider: commercial actors can maximize their revenues, whereas scientific and non-commercial providers can maximize their…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-29 Álvaro López García , Enol Fernández-del-Castillo , Isabel Campos Plasencia

With the ever-growing need of data in HPC applications, the congestion at the I/O level becomes critical in super-computers. Architectural enhancement such as burst-buffers and pre-fetching are added to machines, but are not sufficient to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-23 Guillaume Aupy , Ana Gainaru , Valentin Le Fèvre

As the demand of real time computing increases day by day, there is a major paradigm shift in processing platform of real time system from single core to multi-core platform which provides advantages like higher throughput, linear power…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-30 Girish Talmale , Urmila Shrawankar

Datacenters act as cloud-infrastructure to stakeholders across industry, government, and academia. To meet growing demand yet operate efficiently, datacenter operators employ increasingly more sophisticated scheduling systems, mechanisms,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-14 Georgios Andreadis , Laurens Versluis , Fabian Mastenbroek , Alexandru Iosup

We consider ML query processing in distributed systems where GPU-enabled workers coordinate to execute complex queries: a computing style often seen in applications that interact with users in support of image processing and natural…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-29 Yuting Yang , Andrea Merlina , Weijia Song , Tiancheng Yuan , Ken Birman , Roman Vitenberg

Elasticity is offered by cloud service providers to exploit under-utilized computing resources. The low-cost elastic nodes can leave and join any time during the computation cycle. The possibility of elastic events occurring together with…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-24 Shahrzad Kiani , Tharindu Adikari , Stark C. Draper

In this paper, we introduce Choreographer, a simulation framework that enables a holistic system-level evaluation of fine-grained accelerators designed for latency-sensitive tasks. Unlike existing frameworks, Choreographer captures all…

Hardware Architecture · Computer Science 2025-11-03 Hoa Nguyen , Pongstorn Maidee , Jason Lowe-Power , Alireza Kaviani