English
Related papers

Related papers: Megha: Decentralized Global Fair Scheduling for Fe…

200 papers

Serverless computing is increasingly being used for parallel computing, which have traditionally been implemented as stateful applications. Executing complex, burst-parallel, directed acyclic graph (DAG) jobs poses a major challenge for…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-15 Benjamin Carver , Jingyuan Zhang , Ao Wang , Ali Anwar , Panruo Wu , Yue Cheng

Recent years have seen an increasing integration of distributed renewable energy resources into existing electric power grids. Due to the uncertain nature of renewable energy resources, network operators are faced with new challenges in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-05 Hatem Khalloof , Wilfried Jakob , Shadi Shahoud , Clemens Duepmeier , Veit Hagenmeyer

The demand for distributed applications has significantly increased over the past decade, with improvements in machine learning techniques fueling this growth. These applications predominantly utilize Cloud data centers for high-performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-02 Narges Mehran , Dragi Kimovski , Hermann Hellwagner , Dumitru Roman , Ahmet Soylu , Radu Prodan

Geo-distributed computing, a paradigm that assigns computational tasks to globally distributed nodes, has emerged as a promising approach in cloud computing, edge computing, cloud-edge computing and supercomputer computing (HPC). It enables…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-28 Yujian Wu , Shanjiang Tang , Ce Yu , Bin Yang , Chao Sun , Jian Xiao , Hutong Wu

In order to improve system performance efficiently, a number of systems choose to equip multi-core and many-core processors (such as GPUs). Due to their discrete memory these heterogeneous architectures comprise a distributed system within…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-02-27 Hao Wu , Daniel Lohmann , Wolfgang Schröder-Preikschat

This paper introduces a new framework for clustering in a distributed network called Distributed Clustering based on Distributional Kernel (K) or KDC that produces the final clusters based on the similarity with respect to the distributions…

Machine Learning · Computer Science 2024-09-17 Hang Zhang , Yang Xu , Lei Gong , Ye Zhu , Kai Ming Ting

Federated learning (FL) is a machine learning paradigm that allows multiple clients to collaboratively train a shared model while keeping their data on-premise. However, the straggler issue, due to slow clients, often hinders the efficiency…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-02 Hongpeng Guo , Haotian Gu , Xiaoyang Wang , Bo Chen , Eun Kyung Lee , Tamar Eilam , Deming Chen , Klara Nahrstedt

Many emerging Artificial Intelligence (AI) applications require on-demand provisioning of large-scale computing, which can only be enabled by leveraging distributed computing services interconnected through networking. To address such…

Networking and Internet Architecture · Computer Science 2024-07-09 Ruikun Wang , Jiawei Zhang , Qiaolun Zhang , Bojun Zhang , Zhiqun Gu , Aryanaz Attarpour , Yuefeng Ji , Massimo Tornatore

With the proliferation of data-driven services, the volume of data that needs to be processed by satellite networks has significantly increased. Federated learning (FL) is well-suited for big data processing in distributed,…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-05 Zhuocheng Liu , Zhishu Shen , Pan Zhou , Qiushi Zheng , Jiong Jin

Personalized decision-making can be implemented in a Federated learning (FL) framework that can collaboratively train a decision model by extracting knowledge across intelligent clients, e.g. smartphones or enterprises. FL can mitigate the…

Machine Learning · Computer Science 2023-02-01 Guodong Long , Ming Xie , Tao Shen , Tianyi Zhou , Xianzhi Wang , Jing Jiang , Chengqi Zhang

We consider the problem of designing a packet-level congestion control and scheduling policy for datacenter networks. Current datacenter networks primarily inherit the principles that went into the design of Internet, where congestion…

Networking and Internet Architecture · Computer Science 2017-10-10 Devavrat Shah , Qiaomin Xie

Federated learning (FL) enables collaborative model training among distributed devices without data sharing, but existing FL suffers from poor scalability because of global model synchronization. To address this issue, hierarchical…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-22 Tianyu Qi , Yufeng Zhan , Peng Li , Jingcai Guo , Yuanqing Xia

In an edge-cloud multi-tier network, datacenters provide services to mobile users, with each service having specific latency constraints and computational requirements. Deploying such a variety of services while matching their requirements…

Networking and Internet Architecture · Computer Science 2025-02-03 Itamar Cohen , Paolo Giaccone , Carla Fabiana Chiasserini

Many organizations routinely analyze large datasets using systems for distributed data-parallel processing and clusters of commodity resources. Yet, users need to configure adequate resources for their data processing jobs. This requires…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-02 Lauritz Thamsen , Dominik Scheinert , Jonathan Will , Jonathan Bader , Odej Kao

Driven by the growth of Web-scale decentralized services, Federated Clustering (FC) aims to extract knowledge from heterogeneous clients in an unsupervised manner while preserving the clients' privacy, which has emerged as a significant…

Machine Learning · Computer Science 2026-01-13 Shenghong Cai , Zihua Yang , Yang Lu , Mengke Li , Yuzhu Ji , Yiqun Zhang , Yiu-Ming Cheung

Personalized Federated Learning (PFL) aims to train customized models for clients with highly heterogeneous data distributions while preserving data privacy. Existing approaches often rely on heuristics like clustering or model…

Artificial Intelligence · Computer Science 2026-03-13 Ping Guo , Tiantian Zhang , Xi Lin , Xiang Li , Zhi-Ri Tang , Qingfu Zhang

We develop a family of distributed center-based clustering algorithms that work over networks of users. In the proposed scenario, users contain a local dataset and communicate only with their immediate neighbours, with the aim of finding a…

Machine Learning · Computer Science 2024-11-26 Aleksandar Armacki , Dragana Bajović , Dušan Jakovetić , Soummya Kar

Smart devices have become an indispensable part of our lives and gain increasing applicability in almost every area. Latency-aware applications such as Augmented Reality (AR), autonomous driving, and online gaming demand more resources such…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-24 Mostafa Hadadian Nejad Yousefi , Amirmasoud Ghiassi , Boshra Sadat Hashemi , Maziar Goudarzi

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes. The goal is to train a…

Machine Learning · Computer Science 2016-10-11 Jakub Konečný , H. Brendan McMahan , Daniel Ramage , Peter Richtárik

Although High Performance Computing (HPC) users understand basic resource requirements such as the number of CPUs and memory limits, internal infrastructural utilization data is exclusively leveraged by cluster operators, who use it to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-19 Abel Souza , Kristiaan Pelckmans , Johan Tordsson