English
Related papers

Related papers: Disaggregated Accelerator Management System for Cl…

200 papers

Cross-device federated learning (FL) has been well-studied from algorithmic, system scalability, and training speed perspectives. Nonetheless, moving from centralized training to cross-device FL for millions or billions of devices presents…

Machine Learning · Computer Science 2023-03-14 Ewen Wang , Ajay Kannan , Yuefeng Liang , Boyi Chen , Mosharaf Chowdhury

Most conventional Federated Learning (FL) models are using a star network topology where all users aggregate their local models at a single server (e.g., a cloud server). That causes significant overhead in terms of both communications and…

Information Theory · Computer Science 2022-06-30 Thinh Quang Dinh , Diep N. Nguyen , Dinh Thai Hoang , Pham Tran Vu , Eryk Dutkiewicz

In recent years, the integration of artificial intelligence (AI) and cloud computing has emerged as a promising avenue for addressing the growing computational demands of AI applications. This paper presents a comprehensive study of…

Machine Learning · Computer Science 2023-04-28 Neelesh Mungoli

Data-intensive applications often require exploratory analysis of large datasets. If analysis is performed on distributed resources, data locality can be crucial to high throughput and performance. We propose a "data diffusion" approach…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Ioan Raicu , Yong Zhao , Ian Foster , Alex Szalay

Recent efforts to design and develop Cloud technologies focus on defining novel methods, policies and mechanisms for efficiently managing Cloud infrastructures. One key challenge potential Cloud customers have before renting resources is to…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-02-11 Dr. Rahul Malhotra , Prince Jain

Many researchers have proposed replacing the aggregation server in federated learning with a blockchain system to improve privacy, robustness, and scalability. In this approach, clients would upload their updated models to the blockchain…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-15 Yongding Tian , Zhuoran Guo , Jiaxuan Zhang , Zaid Al-Ars

Federated Learning (FL) enables distributed Artificial Intelligence (AI) across cloud-edge environments by allowing collaborative model training without centralizing data. In cross-device deployments, FL systems face strict communication…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-11 Daniel M. Jimenez-Gutierrez , Giovanni Giunta , Mehrdad Hassanzadeh , Aris Anagnostopoulos , Ioannis Chatzigiannakis , Andrea Vitaletti

Federated Learning (FL) is a machine learning paradigm that safeguards privacy by retaining client data on edge devices. However, optimizing FL in practice can be challenging due to the diverse and heterogeneous nature of the learning…

Machine Learning · Computer Science 2024-06-11 Yongxin Guo , Xiaoying Tang , Tao Lin

Compute infrastructure hosted by a cloud provider allows an application to scale without limit. The application developer no longer needs to worry about the up-front investment in a server farm provisioned for a worst-case load scenario.…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-16 Michael Howard

The aggregation efficiency and accuracy of wireless Federated Learning (FL) are significantly affected by resource constraints, especially in heterogeneous environments where devices exhibit distinct data distributions and communication…

Machine Learning · Computer Science 2025-05-27 Pengcheng Sun , Erwu Liu , Wei Ni , Kanglei Yu , Rui Wang , Abbas Jamalipour

Cloud resource management has been a key factor for the cloud datacenters development. Many cloud datacenters have problems in understanding and implementing the techniques to manage, allocate and migrate the resources in their premises.…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-05 Alexander Ngenzi , Selvarani R , Suchithra R. Nair

Over the past ten years, many different approaches have been proposed for different aspects of the problem of resources management for long running, dynamic and diverse workloads such as processing query streams or distributed deep…

Performance · Computer Science 2023-08-24 Nader Alfares , George Kesidis , Ata Fatahi Baarzi , Aman Jain

The concept of the federated Cloud-Edge-IoT continuum promises to alleviate many woes of current systems, improving resource use, energy efficiency, quality of service, and more. However, this continuum is still far from being realized in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-08 Piotr Sowinski , Ignacio Lacalle , Rafael Vano , Carlos E. Palau

With their high parallelism and resource needs, many scientific applications benefit from cloud deployments. Today, scientific applications are executed on dedicated pools of VMs, resulting in resource fragmentation: users pay for…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-23 Simon Shillaker , Carlos Segarra , Eleftheria Mappoura , Mayeul Fournial , Lluis Vilanova , Peter Pietzuch

The future of computing systems is inevitably embracing a disaggregated and composable pattern: from clusters of computers to pools of resources that can be dynamically combined together and tailored around applications requirements.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Christian Pinto , Dong Li , Thaleia Dimitra Doudali , Christina Giannoula , Jie Ren

Since emerging edge applications such as Internet of Things (IoT) analytics and augmented reality have tight latency constraints, hardware AI accelerators have been recently proposed to speed up deep neural network (DNN) inference run by…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-20 Qianlin Liang , Walid A. Hanafy , Ahmed Ali-Eldin , Prashant Shenoy

The availability of powerful microprocessors and high-speed networks as commodity components has enabled high performance computing on distributed systems (wide-area cluster computing). In this environment, as the resources are usually…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-18 Rajkumar Buyya , David Abramson , Jon Giddy

In this paper, we describe the motivation, innovation, design, running example and future development of a Fault Inject Tool (FIT). This tool enables controlled causing of cloud platform issues such as resource stress and service or VM…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-21 Craig Sheridan , Darren Whigham , Matej Artač

Memory disaggregation (MD) allows for scalable and elastic data center design by separating compute (CPU) from memory. With MD, compute and memory are no longer coupled into the same server box. Instead, they are connected to each other via…

Databases · Computer Science 2022-07-08 Ruihong Wang , Jianguo Wang , Stratos Idreos , M. Tamer Özsu , Walid G. Aref

Serverless Function-as-a-Service (FaaS) is a popular cloud paradigm to quickly and cheaply implement complex applications. Because the function instances cloud providers start to execute user code run on shared infrastructure, their…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-27 Trever Schirmer , Natalie Carl , Nils Höller , Tobias Pfandzelter , David Bermbach