English
Related papers

Related papers: Distributed Learning on Heterogeneous Resource-Con…

200 papers

Modern mobile devices have access to a wealth of data suitable for learning models, which in turn can greatly improve the user experience on the device. For example, language models can improve speech recognition and text entry, and image…

Machine Learning · Computer Science 2023-01-30 H. Brendan McMahan , Eider Moore , Daniel Ramage , Seth Hampson , Blaise Agüera y Arcas

Interference among concurrent transmissions in a wireless network is a key factor limiting the system performance. One way to alleviate this problem is to manage the radio resources in order to maximize either the average or the worst-case…

Machine Learning · Computer Science 2019-06-24 Navid Naderializadeh , Jaroslaw Sydir , Meryem Simsek , Hosein Nikopour , Shilpa Talwar

As the quantity and complexity of information processed by software systems increase, large-scale software systems have an increasing requirement for high-performance distributed computing systems. With the acceleration of the Internet in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-22 Guangyao Zhou , Wenhong Tian , Rajkumar Buyya , Ruini Xue , Liang Song

Federated learning (FL) is an appealing concept to perform distributed training of Neural Networks (NN) while keeping data private. With the industrialization of the FL framework, we identify several problems hampering its successful…

Machine Learning · Computer Science 2020-11-13 Lixuan Yang , Cedric Beliard , Dario Rossi

As the number of edge devices with computing resources (e.g., embedded GPUs, mobile phones, and laptops) increases, recent studies demonstrate that it can be beneficial to collaboratively run convolutional neural network (CNN) inference on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-09 Xueyu Hou , Yongjie Guan , Tao Han , Ning Zhang

Federated Learning(FL) is a privacy-preserving machine learning paradigm where a global model is trained in-situ across a large number of distributed edge devices. These systems are often comprised of millions of user devices and only a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-05 Yuanli Wang , Lei Huang

Distributed machine learning (ML) can bring more computational resources to bear than single-machine learning, thus enabling reductions in training time. Distributed learning partitions models and data over many machines, allowing model and…

Machine Learning · Computer Science 2022-04-20 Binhang Yuan , Cameron R. Wolfe , Chen Dun , Yuxin Tang , Anastasios Kyrillidis , Christopher M. Jermaine

As the operations of autonomous systems generally affect simultaneously several users, it is crucial that their designs account for fairness considerations. In contrast to standard (deep) reinforcement learning (RL), we investigate the…

Artificial Intelligence · Computer Science 2020-08-19 Umer Siddique , Paul Weng , Matthieu Zimmer

The distributed inference paradigm enables the computation workload to be distributed across multiple devices, facilitating the implementations of deep learning based intelligent services on extremely resource-constrained Internet of Things…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-21 Li Wang , Liang Li , Lianming Xu , Xian Peng , Aiguo Fei

The existing work on the distributed training of machine learning (ML) models has consistently overlooked the distribution of the achieved learning quality, focusing instead on its average value. This leads to a poor dependability}of the…

Machine Learning · Computer Science 2024-02-23 Francesco Malandrino , Giuseppe Di Giacomo , Marco Levorato , Carla Fabiana Chiasserini

Federated Learning is a novel paradigm that involves learning from data samples distributed across a large network of clients while the data remains local. It is, however, known that federated learning is prone to multiple system challenges…

Machine Learning · Computer Science 2021-01-01 Amirhossein Reisizadeh , Isidoros Tziotis , Hamed Hassani , Aryan Mokhtari , Ramtin Pedarsani

Distributed learning on edge devices has attracted increased attention with the advent of federated learning (FL). Notably, edge devices often have limited battery and heterogeneous energy availability, while multiple rounds are required in…

Signal Processing · Electrical Eng. & Systems 2023-09-13 Rafael Valente da Silva , Onel L. Alcaraz López , Richard Demo Souza

There is a growing demand to deploy computation-intensive deep learning (DL) models on resource-constrained mobile devices for real-time intelligent applications. Equipped with a variety of processing units such as CPUs, GPUs, and NPUs, the…

Machine Learning · Computer Science 2024-05-06 Sicong Liu , Wentao Zhou , Zimu Zhou , Bin Guo , Minfan Wang , Cheng Fang , Zheng Lin , Zhiwen Yu

Federated learning is proposed as a machine learning setting to enable distributed edge devices, such as mobile phones, to collaboratively learn a shared prediction model while keeping all the training data on device, which can not only…

Machine Learning · Computer Science 2020-03-13 Lifeng Liu , Fengda Zhang , Jun Xiao , Chao Wu

Federated Learning (FL) is a distributed machine learning technique, where each device contributes to the learning model by independently computing the gradient based on its local training data. It has recently become a hot research topic,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-28 Afaf Taïk , Soumaya Cherkaoui

Federated learning (FL) refers to a distributed machine learning framework involving learning from several decentralized edge clients without sharing local dataset. This distributed strategy prevents data leakage and enables on-device…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-28 Taki Hasan Rafi , Faiza Anan Noor , Tahmid Hussain , Dong-Kyu Chae , Zhaohui Yang

It is widely perceived that leveraging the success of modern machine learning techniques to mobile devices and wireless networks has the potential of enabling important new services. This, however, poses significant challenges, essentially…

Machine Learning · Computer Science 2023-04-13 Matei Moldoveanu , Abdellatif Zaidi

Artificial intelligence has made remarkable progress in handling complex tasks, thanks to advances in hardware acceleration and machine learning algorithms. However, to acquire more accurate outcomes and solve more complex issues,…

Machine Learning · Computer Science 2023-09-12 Mohammad Dehghani , Zahra Yazdanparast

At the intersection of the cutting-edge technologies and privacy concerns, Federated Learning (FL) with its distributed architecture, stands at the forefront in a bid to facilitate collaborative model training across multiple clients while…

Machine Learning · Computer Science 2025-09-03 Noorain Mukhtiar , Adnan Mahmood , Quan Z. Sheng

Reinforcement learning (RL) has a rich history in neuroscience, from early work on dopamine as a reward prediction error signal (Schultz et al., 1997) to recent work proposing that the brain could implement a form of 'distributional…

Neurons and Cognition · Quantitative Biology 2024-12-19 Kristopher T. Jensen