English
Related papers

Related papers: Rubick: Exploiting Job Reconfigurability for Deep …

200 papers

We present a scheduler that improves cluster utilization and job completion times by packing tasks having multi-resource requirements and inter-dependencies. While the problem is algorithmically very hard, we achieve near-optimality on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-26 Robert Grandl , Srikanth Kandula , Sriram Rao , Aditya Akella , Janardhan Kulkarni

As quantum computing (QC) technologies mature, their integration into established high-performance computing (HPC) infrastructures is becoming a central objective for next-generation computing systems. However, unlocking the potential of…

Motivation: Traditional computational cluster schedulers are based on user inputs and run time needs request for memory and CPU, not IO. Heavily IO bound task run times, like ones seen in many big data and bioinformatics problems, are…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-27 Christopher Harrison , Christine R. Kirkpatrick , Inês Dutra

We are interested in the optimal scheduling of a collection of multi-component application jobs in an edge computing system that consists of geo-distributed edge computing nodes connected through a wide area network. The scheduling and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-24 Zhi Cao , Honggang Zhang , Yu Cao , Benyuan Liu

While traditional robotic systems come with a monolithic system design, reconfigurable multi-robot systems can share and shift physical resources in an on-demand fashion. Multi-robot operations can benefit from this flexibility by actively…

Robotics · Computer Science 2021-06-24 Thomas M. Roehr

Large deep learning models have shown great potential for delivering exceptional results in various applications. However, the training process can be incredibly challenging due to the models' vast parameter sizes, often consisting of…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-14 Zhengqing Yuan , Huiwen Xue , Chao Zhang , Yongming Liu

Imagine a patient in critical condition. What and when should be measured to forecast detrimental events, especially under the budget constraints? We answer this question by deep reinforcement learning (RL) that jointly minimizes the…

Machine Learning · Computer Science 2019-06-11 Chun-Hao Chang , Mingjie Mai , Anna Goldenberg

Compound AI Systems, integrating multiple interacting components like models, retrievers, and external tools, have emerged as essential for addressing complex AI tasks. However, current implementations suffer from inefficient resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-19 Gohar Irfan Chaudhry , Esha Choukse , Íñigo Goiri , Rodrigo Fonseca , Adam Belay , Ricardo Bianchini

Large-batch training has been essential in leveraging large-scale datasets and models in deep learning. While it is computationally beneficial to use large batch sizes, it often requires a specially designed learning rate (LR) schedule to…

Machine Learning · Computer Science 2021-07-14 Chiheon Kim , Saehoon Kim , Jongmin Kim , Donghoon Lee , Sungwoong Kim

We describe in this paper a new method for building an efficient algorithm for scheduling jobs in a cluster. Jobs are considered as parallel tasks (PT) which can be scheduled on any number of processors. The main feature is to consider two…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-16 Pierre-Francois Dutot , Lionel Eyraud , Grégory Mounié , Denis Trystram

Modern GPU datacenters are critical for delivering Deep Learning (DL) models and services in both the research community and industry. When operating a datacenter, optimization of resource scheduling and management can bring significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-07 Qinghao Hu , Peng Sun , Shengen Yan , Yonggang Wen , Tianwei Zhang

Queuing systems with redundant requests have drawn great attention because of their promise to reduce the job completion time and variability. Despite a large body of work on the topic, we are still far from fully understanding the benefits…

Performance · Computer Science 2019-10-08 Amir Behrouzi-Far , Emina Soljanin

A great number of robotics applications demand the rearrangement of many mobile objects, e.g., organizing products on shelves, shuffling containers at shipping ports, reconfiguring fleets of mobile robots, and so on. To boost the throughput…

Robotics · Computer Science 2023-01-18 Mario Szegedy , Jingjin Yu

The task of clustering unlabeled time series and sequences entails a particular set of challenges, namely to adequately model temporal relations and variable sequence lengths. If these challenges are not properly handled, the resulting…

Machine Learning · Statistics 2019-02-19 Daniel J. Trosten , Andreas S. Strauman , Michael Kampffmeyer , Robert Jenssen

Scheduling is the central concept used frequently in Operating System. It helps in choosing the processes for execution. Round Robin (RR) is one of the most widely used CPU scheduling algorithm. But, its performance degrades with respect to…

Operating Systems · Computer Science 2011-03-22 H. S. Behera , Rakesh Mohanty , Debashree Nayak

The rigid gang task model is based on the idea of executing multiple threads simultaneously on a fixed number of processors to increase efficiency and performance. Although there is extensive literature on global rigid gang scheduling,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-04 Binqi Sun , Tomasz Kloda , Marco Caccamo

One significant challenge in the job scheduling of computing clusters for the development of deep learning algorithms is the efficient scheduling of trial-and-error (TE) job, the type of job in which the users seek to conduct small-scale…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-06 Hidehito Yabuuchi , Daisuke Taniwaki , Shingo Omura

Real-time systems are intrinsic components of many pivotal applications, such as self-driving vehicles, aerospace and defense systems. The trend in these applications is to incorporate multiple tasks onto fewer, more powerful hardware…

Operating Systems · Computer Science 2024-10-03 V. Gabriel Moyano , Zain A. H. Hammadeh , Selma Saidi , Daniel Lüdtke

Decarbonisation is driving dramatic growth in renewable power generation. This increases uncertainty in the load to be served by power plants and makes their efficient scheduling, known as the unit commitment (UC) problem, more difficult.…

Systems and Control · Electrical Eng. & Systems 2022-12-12 Cormac O'Malley , Patrick de Mars , Luis Badesa , Goran Strbac

Deep learning has been postulated as a solution for numerous problems in different branches of science. Given the resource-intensive nature of these models, they often need to be executed on specialized hardware such graphical processing…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-15 Jose González-Abad , Álvaro López García , Valentin Y. Kozlov