English
Related papers

Related papers: Lightweight Task Analysis for Cache-Aware Scheduli…

200 papers

Streaming applications frequently encounter skewed workloads and execute on heterogeneous clusters. Optimal resource utilization in such adverse conditions becomes a challenge, as it requires inferring the resource capacities and input…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-03 Muhammad Anis Uddin Nasir , Hiroshi Horii , Marco Serafini , Nicolas Kourtellis , Rudy Raymond , Sarunas Girdzijauskas , Takayuki Osogami

Specialized accelerators such as GPUs, TPUs, FPGAs, and custom ASICs have been increasingly deployed to train deep learning models. These accelerators exhibit heterogeneous performance behavior across model architectures. Existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-24 Deepak Narayanan , Keshav Santhanam , Fiodar Kazhamiaka , Amar Phanishayee , Matei Zaharia

Major chip manufacturers have all introduced multicore microprocessors. Multi-socket systems built from these processors are used for running various server applications. However to the best of our knowledge current commercial operating…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-24 Suryanarayana Murthy Durbhakula

Static cache analysis characterizes a program's cache behavior by determining in a sound but approximate manner which memory accesses result in cache hits and which result in cache misses. Such information is valuable in optimizing…

Programming Languages · Computer Science 2021-08-23 Valentin Touzeau , Claire Maïza , David Monniaux , Jan Reineke

We consider load balancing in a network of caching servers delivering contents to end users. Randomized load balancing via the so-called power of two choices is a well-known approach in parallel and distributed systems. In this framework,…

Information Theory · Computer Science 2017-07-03 Mahdi Jafari Siavoshani , Ali Pourmiri , Seyed Pooya Shariatpanahi

In this work, we design and analyze novel distributed scheduling algorithms for multi-user MIMO systems. In particular, we consider algorithms which do not require sending channel state information to a central processing unit, nor do they…

Information Theory · Computer Science 2015-03-20 Joseph Kampeas , Asaf Cohen , Omer Gurewitz

This paper studies the computation-communication tradeoff in a heterogeneous MapReduce computing system where each distributed node is equipped with different computation capability. We first obtain an achievable communication load for any…

Information Theory · Computer Science 2019-08-20 Fan Xu , Meixia Tao

Clustering is widely used for unsupervised structure discovery, yet it offers limited insight into how reliable each individual assignment is. Diagnostics, such as convergence behavior or objective values, may reflect global quality, but…

Machine Learning · Computer Science 2026-05-15 Aggelos Semoglou , John Pavlopoulos

While the advanced machine learning algorithms are effective in load forecasting, they often suffer from low data utilization, and hence their superior performance relies on massive datasets. This motivates us to design machine learning…

Machine Learning · Computer Science 2022-02-17 Qiyuan Wang , Zhihui Chen , Chenye Wu

Autonomous driving systems, critical for safety, require real-time guarantees and can be modeled as DAGs. Their acceleration features, such as caches and pipelining, often result in execution times below the worst-case. Thus, a…

Systems and Control · Electrical Eng. & Systems 2025-12-23 Fuma Omori , Atsushi Yano , Takuya Azumi

Heterogeneity is becoming increasingly ubiquitous in modern large-scale computer systems. Developing good load balancing policies for systems whose resources have varying speeds is crucial in achieving low response times. Indeed, how best…

Performance · Computer Science 2020-06-26 Kristen Gardner , Jazeem Abdul Jaleel , Alexander Wickeham , Sherwin Doroudi

In this study, a cluster-computing environment is employed as a computational platform. In order to increase the efficiency of the system, a dynamic task scheduling algorithm is proposed, which balances the load among the nodes of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-22 I. K. Savvas , M. Tahar Kechadi

Energy-efficient real-time task scheduling has been actively explored in the past decade. Different from the past work, this paper considers schedulability conditions for stochastic real-time tasks. A schedulability condition is first…

Operating Systems · Computer Science 2008-04-07 Vandy Berten , Chi-Ju Chang , Tei-Wei Kuo

Modern AI clusters, which host diverse workloads like data pre-processing, training and inference, often store the large-volume data in cloud storage and employ caching frameworks to facilitate remote data access. To avoid code-intrusion…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-17 Tianze Wang , Yifei Liu , Chen Chen , Pengfei Zuo , Jiawei Zhang , Qizhen Weng , Yin Chen , Zhenhua Han , Jieru Zhao , Quan Chen , Minyi Guo

In this paper we describe HeSP, a complete simulation framework to study a general task scheduling-partitioning problem on heterogeneous architectures, which treats recursive task partitioning and scheduling decisions on equal footing.…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-18 Anton Rey , Francisco D. Igual , Manuel Prieto-Matías

Hardware specialization is becoming a key enabler of energyefficient performance. Future systems will be increasingly heterogeneous, integrating multiple specialized and programmable accelerators, each with different memory demands.…

Hardware Architecture · Computer Science 2021-04-26 Johnathan Alsop , Weon Taek Na , Matthew D. Sinclair , Samuel Grayson , Sarita V. Adve

Software caches optimize the performance of diverse storage systems, databases and other software systems. Existing works on software caches automatically resort to fully associative cache designs. Our work shows that limited associativity…

Hardware Architecture · Computer Science 2021-09-08 Dolev Adas , Gil Einziger , Roy Friedman

While load balancing in distributed-memory computing has been well-studied, we present an innovative approach to this problem: a unified, reduced-order model that combines three key components to describe "work" in a distributed system:…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-26 Jonathan Lifflander , Philippe P. Pebay , Nicole L. Slattengren , Pierre L. Pebay , Robert A. Pfeiffer , Joseph D. Kotulski , Sean T. McGovern

In heterogeneous distributed computing (HC) systems, diversity can exist in both computational resources and arriving tasks. In an inconsistently heterogeneous computing system, task types have different execution times on heterogeneous…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-29 James Gentry , Chavit Denninnart , Mohsen Amini Salehi

Load balancing is critical for distributed storage to meet strict service-level objectives (SLOs). It has been shown that a fast cache can guarantee load balancing for a clustered storage system. However, when the system scales out to…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-18 Zaoxing Liu , Zhihao Bai , Zhenming Liu , Xiaozhou Li , Changhoon Kim , Vladimir Braverman , Xin Jin , Ion Stoica