English
Related papers

Related papers: Aryl: An Elastic Cluster Scheduler for Deep Learni…

200 papers

Results from the research and development of a Data Intensive and Network Aware (DIANA) scheduling engine, to be used primarily for data intensive sciences such as physics analysis, are described. In Grid analyses, tasks can involve…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-11-11 Ashiq Anjum , Richard McClatchey , Arshad Ali , Ian Willers

Deep Learning (DL) workloads have rapidly increased in popularity in enterprise clusters and several new cluster schedulers have been proposed in recent years to support these workloads. With rapidly evolving DL workloads, it is challenging…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-21 Saurabh Agarwal , Amar Phanishayee , Shivaram Venkataraman

Maximizing resource utilization by performing an efficient resource provisioning is a key factor for any cloud provider: commercial actors can maximize their revenues, whereas scientific and non-commercial providers can maximize their…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-29 Álvaro López García , Enol Fernández-del-Castillo , Isabel Campos Plasencia

Deploying deep learning models in cloud clusters provides efficient and prompt inference services to accommodate the widespread application of deep learning. These clusters are usually equipped with host CPUs and accelerators with distinct…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-24 Zinuo Cai , Hao Wang , Tao Song , Yang Hua , Ruhui Ma , Haibing Guan

Incremental learning is useful if an AI agent needs to integrate data from a stream. The problem is non trivial if the agent runs on a limited computational budget and has a bounded memory of past data. In a deep learning approach, the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-17 Eden Belouadah , Adrian Popescu

Machine learning over graphs have been emerging as powerful learning tools for graph data. However, it is challenging for industrial communities to leverage the techniques, such as graph neural networks (GNNs), and solve real-world problems…

Social and Information Networks · Computer Science 2020-03-17 Dalong Zhang , Xin Huang , Ziqi Liu , Zhiyang Hu , Xianzheng Song , Zhibang Ge , Zhiqiang Zhang , Lin Wang , Jun Zhou , Yang Shuang , Yuan Qi

Motivated by deep neural network applications, we study the problem of scheduling splittable jobs (e.g., neural network inference tasks) on configurable machines (e.g., multi-instance GPUs). We are given $n$ jobs and a set $C$ of…

Data Structures and Algorithms · Computer Science 2023-12-12 Matthew Casey , Rajmohan Rajaraman , David Stalfa

Intelligent Virtual Machine (VM) provisioning is central to cost and resource efficient computation in cloud computing environments. As bootstrapping VMs is time-consuming, a key challenge for latency-critical tasks is to predict future…

Systems and Control · Electrical Eng. & Systems 2023-04-18 Shreshth Tuli , Giuliano Casale , Nicholas R. Jennings

Deep learning (DL) accelerators are increasingly deployed on edge devices to support fast local inferences. However, they suffer from a new security problem, i.e., being vulnerable to physical access based attacks. An adversary can easily…

Hardware Architecture · Computer Science 2020-08-11 Pengfei Zuo , Yu Hua , Ling Liang , Xinfeng Xie , Xing Hu , Yuan Xie

A heterogeneous architecture composed by a host and an accelerator must frequently deal with situations where several independent tasks are available to be offloaded onto the accelerator. These tasks can be generated by concurrent…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-03 A. J. Lázaro-Muñoz , J. M. González-Linares , J. Gómez-Luna , N. Guil

We study the problem of executing an application represented by a precedence task graph on a parallel machine composed of standard computing cores and accelerators. Contrary to most existing approaches, we distinguish the allocation and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-20 Marcos Amaris , Giorgio Lucarelli , Clément Mommessin , Denis Trystram

In scheduling problems common in the industry and various real-world scenarios, responding in real-time to disruptive events is essential. Recent methods propose the use of deep reinforcement learning (DRL) to learn policies capable of…

Artificial Intelligence · Computer Science 2024-01-31 Imanol Echeverria , Maialen Murua , Roberto Santana

Long-context supervised fine-tuning (Long-SFT) plays a vital role in enhancing the performance of large language models (LLMs) on long-context tasks. To smoothly adapt LLMs to long-context scenarios, this process typically entails training…

Machine Learning · Computer Science 2025-12-16 Hongtao Xu , Wenting Shen , Yuanxin Wei , Ang Wang , Guo Runfan , Tianxing Wang , Yong Li , Mingzhen Li , Weile Jia

This work proposes a competitive scheduling approach, designed to scale to large heterogeneous multicore systems. This scheduler overcomes the challenges of (1) the high computation overhead of near-optimal schedulers, and (2) the error…

Hardware Architecture · Computer Science 2021-09-03 Andreas Prodromou , Ashish Venkat , Dean M. Tullsen

We propose ELIS, a serving system for Large Language Models (LLMs) featuring an Iterative Shortest Remaining Time First (ISRTF) scheduler designed to efficiently manage inference tasks with the shortest remaining tokens. Current LLM serving…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-15 Seungbeom Choi , Jeonghoe Goo , Eunjoo Jeon , Mingyu Yang , Minsung Jang

Distributed deep learning workloads include throughput-intensive training tasks on the GPU clusters, where the Distributed Stochastic Gradient Descent (SGD) incurs significant communication delays after backward propagation, forces workers…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-16 Cheng Luo , Lei Qu , Youshan Miao , Peng Cheng , Yongqiang Xiong

Video analytics applications use edge compute servers for the analytics of the videos (for bandwidth and privacy). Compressed models that are deployed on the edge servers for inference suffer from data drift, where the live video data…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-22 Romil Bhardwaj , Zhengxu Xia , Ganesh Ananthanarayanan , Junchen Jiang , Nikolaos Karianakis , Yuanchao Shu , Kevin Hsieh , Victor Bahl , Ion Stoica

REST APIs have become key components of web services. However, they often contain logic flaws resulting in server side errors or security vulnerabilities. HTTP requests are used as test cases to find and mitigate such issues. Existing…

Software Engineering · Computer Science 2024-12-23 Myles Foley , Sergio Maffeis

The paper presents an efficient real-time scheduling algorithm for intelligent real-time edge services, defined as those that perform machine intelligence tasks, such as voice recognition, LIDAR processing, or machine vision, on behalf of…

Machine Learning · Computer Science 2020-11-03 Shuochao Yao , Yifan Hao , Yiran Zhao , Huajie Shao , Dongxin Liu , Shengzhong Liu , Tianshi Wang , Jinyang Li , Tarek Abdelzaher

Machine scheduling aims to optimize job assignments to machines while adhering to manufacturing rules and job specifications. This optimization leads to reduced operational costs, improved customer demand fulfillment, and enhanced…