English
Related papers

Related papers: Equinox: Holistic Fair Scheduling in Serving Large…

200 papers

Earth-observation satellites are emerging as distributed edge platforms for time-critical tasks, yet orbital scheduling remains challenged by intermittent energy harvesting and temporal coupling where eager execution risks future battery…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-23 Ansel Kaplan Erol , Divya Mahajan

Large language model (LLM) inference has become a dominant workload in modern data centers, driving significant GPU utilization and energy consumption. While prior systems optimize throughput and latency by batching, scheduling, and…

Artificial Intelligence · Computer Science 2026-05-21 Can Hankendi , Rana Shahout , Minlan Yu , Ayse K. Coskun

Multiple applications executing concurrently on a multicore system interfere with each other at different shared resources such as main memory and shared caches. Such inter-application interference, if uncontrolled, results in high system…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-08-14 Lavanya Subramanian

Expert Parallelism (EP) permits Mixture of Experts (MoE) models to scale beyond a single GPU. To address load imbalance across GPUs in EP, existing approaches aim to balance the number of tokens each GPU processes. Surprisingly, we find…

Over the past few decades, ubiquitous sensors and systems have been an integral part of humans' everyday life. They augment human capabilities and provide personalized experiences across diverse contexts such as healthcare, education, and…

Human-Computer Interaction · Computer Science 2023-08-21 Han Zhang , Leijie Wang , Yilun Sheng , Xuhai Xu , Jennifer Mankoff , Anind K. Dey

We consider fairness scheduling in a user-centric cell-free massive MIMO network, where $L$ remote radio units, each with $M$ antennas, serve $K_{\rm tot} \approx LM$ user equipments (UEs). Recent results show that the maximum network sum…

Information Theory · Computer Science 2023-05-16 Fabian Göttsch , Noboru Osawa , Yoshiaki Amano , Issei Kanno , Kosuke Yamazaki , Giuseppe Caire

In the realm of computer systems, efficient utilisation of the CPU (Central Processing Unit) has always been a paramount concern. Researchers and engineers have long sought ways to optimise process execution on the CPU, leading to the…

Operating Systems · Computer Science 2024-12-18 Supriya Manna , Krishna Siva Prasad Mudigonda

Scientific workflows have been predominantly used for complex and large scale data analysis and scientific computation/automation and the need for robust workflow scheduling techniques has grown considerably. But, most of the existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-04 S. Jaya Nirmala , Amrith Rajagopal Setlur , Har Simrat Singh , Sudhanshu Khoriya

Systems for processing big data---e.g., Hadoop, Spark, and massively parallel databases---need to run workloads on behalf of multiple tenants simultaneously. The abundant disk-based storage in these systems is usually complemented by a…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-12 Mayuresh Kunjir , Brandon Fain , Kamesh Munagala , Shivnath Babu

In the conventional information theoretic analysis of multiterminal communication scenarios, it is often assumed that all of the distributed terminals use the communication channel simultaneously. However, in practical wireless…

Information Theory · Computer Science 2019-01-24 Shahram Shahsavari , Farhad Shirani , Elza Erkip

MapReduce has become a popular programming model for running data intensive applications on the cloud. Completion time goals or deadlines of MapReduce jobs set by users are becoming crucial in existing cloud-based data processing…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-08-10 B. Thirumala Rao , L. S. S. Reddy

Mixture-of-Experts (MoE) has become a dominant architecture for scaling large language models (LLMs). However, the execution characteristics of MoE inference are changing rapidly and increasingly mismatch the assumptions underlying existing…

Hardware Architecture · Computer Science 2026-05-13 Jungwoo Kim , Rubens Lacouture , Genghan Zhang , Gina Sohn , Qizheng Zhang , Swapnil Gandhi , Christos Kozyrakis , Kunle Olukotun

Most commercial embedded devices have been deployed with a single processor architecture. The code size and complexity of applications running on embedded devices are rapidly increasing due to the emergence of application business models…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-26 Geunsik Lim , Changwoo Min , YoungIk Eom

Imposing fairness in resource allocation incurs a loss of system throughput, known as the Price of Fairness ($PoF$). In wireless scheduling, $PoF$ increases when serving users with very poor channel quality because the scheduler wastes…

Networking and Internet Architecture · Computer Science 2018-01-08 Apostolos Destounis , Georgios S. Paschos , David Gesbert

Performance-, power-, and energy-aware scheduling techniques play an essential role in optimally utilizing processing elements (PEs) of heterogeneous systems. List schedulers, a class of low-complexity static schedulers, have commonly been…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-17 Joshua Mack , Samet E. Arda , Umit Y. Ogras , Ali Akoglu

Graphics processors, or GPUs, have recently been widely used as accelerators in the shared environments such as clusters and clouds. In such shared environments, many kernels are submitted to GPUs from different users, and throughput is an…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-03-22 Jianlong Zhong , Bingsheng He

Resource provisioning in multi-tenant stream processing systems faces the dual challenges of keeping resource utilization high (without over-provisioning), and ensuring performance isolation. In our common production use cases, where…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-08 Le Xu , Shivaram Venkataraman , Indranil Gupta , Luo Mai , Rahul Potharaju

Finetuning large language models (LLMs) is essential for task adaptation, yet today's serving stacks isolate inference and finetuning on separate GPU clusters -- wasting resources and under-utilizing hardware. We introduce FlexLLM, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-27 Gabriele Oliaro , Xupeng Miao , Xinhao Cheng , Vineeth Kada , Mengdi Wu , Ruohan Gao , Yingyi Huang , Remi Delacourt , April Yang , Yingcheng Wang , Colin Unger , Zhihao Jia

Fairness-aware classification requires balancing performance and fairness, often intensified by intersectional biases. Conflicting fairness definitions further complicate the task, making it difficult to identify universally fair solutions.…

Machine Learning · Computer Science 2025-09-11 Swati Swati , Arjun Roy , Emmanouil Panagiotou , Eirini Ntoutsi

We describe mechanisms for the allocation of a scarce resource among multiple users in a way that is efficient, fair, and strategy-proof, but when users do not know their resource requirements. The mechanism is repeated for multiple rounds…

Machine Learning · Statistics 2020-12-17 Kirthevasan Kandasamy , Gur-Eyal Sela , Joseph E Gonzalez , Michael I Jordan , Ion Stoica