English
Related papers

Related papers: Optimal Resource Efficiency with Fairness in Heter…

200 papers

CPU-GPU heterogeneous architectures are now commonly used in a wide variety of computing systems from mobile devices to supercomputers. Maximizing the throughput for multi-programmed workloads on such systems is indispensable as one single…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-08 Issa Saba , Eishi Arima , Dai Liu , Martin Schulz

Energy conservation of large data centers for high-performance computing workloads, such as deep learning with big data, is of critical significance, where cutting down a few percent of electricity translates into million-dollar savings.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-02 Xinxin Mei , Qiang Wang , Xiaowen Chu , Hai Liu , Yiu-Wing Leung , Zongpeng Li

Simultaneously supporting latency- and throughout-sensitive workloads in a shared environment is an increasingly more common challenge in big data clusters. Despite many advances, existing cluster schedulers force the same performance goal…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-10 Tan N. Le , Xiao Sun , Mosharaf Chowdhury , Zhenhua Liu

Federated learning (FL) enables distributed training with private client data, but its convergence is hindered by system heterogeneity under realistic communication scenarios. Most FL schemes addressing system heterogeneity utilize global…

Machine Learning · Computer Science 2025-09-19 Keumseo Ryum , Jinu Gong , Joonhyuk Kang

Federated learning (FL) algorithms commonly aim to maximize clients' accuracy by training a model on their collective data. However, in several FL applications, the model's decisions should meet a group fairness constraint to be independent…

Machine Learning · Computer Science 2025-03-20 Haoyu Lei , Shizhan Gong , Qi Dou , Farzan Farnia

In the context of managing distributed energy resources (DERs) within distribution networks (DNs), this work focuses on the task of developing local controllers. We propose an unsupervised learning framework to train functions that can…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Zhenyi Yuan , Guido Cavraro , Ahmed S. Zamzam , Jorge Cortés

Resource allocation is crucial for the performance optimization of cloud-assisted multi-agent intelligence. Traditional methods often overlook agents' diverse computational capabilities and complex operating environments, leading to…

Machine Learning · Computer Science 2025-09-04 Oguzhan Baser , Kaan Kale , Po-han Li , Sandeep Chinchali

Heterogeneous computing systems provide high performance and energy efficiency. However, to optimally utilize such systems, solutions that distribute the work across host CPUs and accelerating devices are needed. In this paper, we present a…

Software Engineering · Computer Science 2021-06-04 Suejb Memeti , Sabri Pllana

We study the multi-resource allocation problem in cloud computing systems where the resource pool is constructed from a large number of heterogeneous servers, representing different points in the configuration space of resources such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-08-02 Wei Wang , Baochun Li , Ben Liang

Clustered federated learning (CFL) addresses the performance challenges posed by data heterogeneity in federated learning (FL) by organizing edge devices with similar data distributions into clusters, enabling collaborative model training…

Machine Learning · Computer Science 2025-01-06 Yuxin Zhang , Haoyu Chen , Zheng Lin , Zhe Chen , Jin Zhao

Designing efficient and fair algorithms for sharing multiple resources between heterogeneous demands is becoming increasingly important. Applications include compute clusters shared by multi-task jobs and routers equipped with middleboxes…

Networking and Internet Architecture · Computer Science 2014-10-06 Thomas Bonald , James Roberts

Federated Learning (FL) has emerged as a vital paradigm in modern machine learning that enables collaborative training across decentralized data sources without exchanging raw data. This approach not only addresses privacy concerns but also…

Machine Learning · Computer Science 2025-08-19 Zahra Kharaghani , Ali Dadras , Tommy Löfstedt

Training Deep Neural Networks (DNNs) is a widely popular workload in both enterprises and cloud data centers. Existing schedulers for DNN training consider GPU as the dominant resource, and allocate other resources such as CPU and memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-25 Jayashree Mohan , Amar Phanishayee , Janardhan Kulkarni , Vijay Chidambaram

Federated Learning is a training framework that enables multiple participants to collaboratively train a shared model while preserving data privacy and minimizing communication overhead. The heterogeneity of devices and networking resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-08 Rahul Mishra , Hari Prabhat Gupta , Garvit Banga

Efficient and secure federated learning (FL) is a critical challenge for resource-limited devices, especially mobile devices. Existing secure FL solutions commonly incur significant overhead, leading to a contradiction between efficiency…

Cryptography and Security · Computer Science 2025-03-20 Yunlong Mao , Mingyang Niu , Ziqin Dang , Chengxi Li , Hanning Xia , Yuejuan Zhu , Haoyu Bian , Yuan Zhang , Jingyu Hua , Sheng Zhong

The integration of distributed generation (DG) is essential to the energy transition but poses challenges for lowvoltage (LV) distribution networks (DNs) with limited hosting capacity (HC). This study incorporates multiple fairness…

Systems and Control · Electrical Eng. & Systems 2025-08-26 Olivia Rubbers , Sari Kerckhove , Md Umar Hashmi , Dirk Van Hertem

Federated Learning (FL) enables distributed training by learners using local data, thereby enhancing privacy and reducing communication. However, it presents numerous challenges relating to the heterogeneity of the data distribution, device…

Machine Learning · Computer Science 2022-11-07 Ahmed M. Abdelmoniem , Atal Narayan Sahu , Marco Canini , Suhaib A. Fahmy

Edge machine learning involves the deployment of learning algorithms at the network edge to leverage massive distributed data and computation resources to train artificial intelligence (AI) models. Among others, the framework of federated…

Information Theory · Computer Science 2020-07-16 Qunsong Zeng , Yuqing Du , Kaibin Huang , Kin K. Leung

Using correct design metrics and understanding the limitations of the underlying technology is critical to developing effective scheduling algorithms. Unfortunately, existing scheduling techniques used \emph{incorrect} metrics and had…

Operating Systems · Computer Science 2026-05-21 Emre Karabulut , Arsalan Ali Malik , Amro Awad , Aydin Aysu

Split Learning (SL) is a promising collaborative machine learning approach, enabling resource-constrained devices to train models without sharing raw data, while reducing computational load and preserving privacy simultaneously. However,…

Machine Learning · Computer Science 2024-11-22 Yunrui Sun , Gang Hu , Yinglei Teng , Dunbo Cai