English
Related papers

Related papers: Client-server multi-task learning from distributed…

200 papers

Distributed learning is the problem of inferring a function in the case where training data is distributed among multiple geographically separated sources. Particularly, the focus is on designing learning strategies with low computational…

Machine Learning · Statistics 2016-07-22 Simone Scardapane

In practice, training using federated learning can be orders of magnitude slower than standard centralized training. This severely limits the amount of experimentation and tuning that can be done, making it challenging to obtain good…

Machine Learning · Computer Science 2024-06-05 Jonathan Scott , Áine Cahill

Many real-world machine learning applications involve several learning tasks which are inter-related. For example, in healthcare domain, we need to learn a predictive model of a certain disease for many hospitals. The models for each…

Machine Learning · Computer Science 2016-10-03 Inci M. Baytas , Ming Yan , Anil K. Jain , Jiayu Zhou

In important applications involving multi-task networks with multiple objectives, agents in the network need to decide between these multiple objectives and reach an agreement about which single objective to follow for the network. In this…

Optimization and Control · Mathematics 2018-12-27 Sahar Khawatmi , Abdelhak M. Zoubir , Ali H. Sayed

With the growth of machine learning techniques, privacy of data of users has become a major concern. Most of the machine learning algorithms rely heavily on large amount of data which may be collected from various sources. Collecting these…

Machine Learning · Computer Science 2023-11-17 Mahfuzur Rahman Chowdhury , Muhammad Ibrahim

Federated learning is a data decentralization privacy-preserving technique used to perform machine or deep learning in a secure way. In this paper we present theoretical aspects about federated learning, such as the presentation of an…

Machine Learning · Computer Science 2022-11-09 Judith Sáinz-Pardo Díaz , Álvaro López García

The development of deep learning techniques is a leading field applied to cases in which medical data is used, particularly in cases of image diagnosis. This type of data has privacy and legal restrictions that in many cases prevent it from…

Machine Learning · Computer Science 2025-01-28 Judith Sáinz-Pardo Díaz , Álvaro López García

In Federated Learning (FL), the distributed nature and heterogeneity of client data present both opportunities and challenges. While collaboration among clients can significantly enhance the learning process, not all collaborations are…

Machine Learning · Computer Science 2024-07-18 Nazarii Tupitsa , Samuel Horváth , Martin Takáč , Eduard Gorbunov

Multi-task learning aims to improve generalization performance of multiple prediction tasks by appropriately sharing relevant information across them. In the context of deep neural networks, this idea is often realized by hand-designed…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Yongxi Lu , Abhishek Kumar , Shuangfei Zhai , Yu Cheng , Tara Javidi , Rogerio Feris

Continual data collection and widespread deployment of machine learning algorithms, particularly the distributed variants, have raised new privacy challenges. In a distributed machine learning scenario, the dataset is stored among several…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-16 Shripad Gade , Nitin H. Vaidya

We study a new form of federated learning where the clients train personalized local models and make predictions jointly with the server-side shared model. Using this new federated learning framework, the complexity of the central shared…

Machine Learning · Computer Science 2020-03-31 Alekh Agarwal , John Langford , Chen-Yu Wei

We consider a distributed learning setting where each agent/learner holds a specific parametric model and data source. The goal is to integrate information across a set of learners to enhance the prediction accuracy of a given learner. A…

Methodology · Statistics 2021-09-21 Jiaying Zhou , Jie Ding , Kean Ming Tan , Vahid Tarokh

Nowadays, with the widespread of smartphones and other portable gadgets equipped with a variety of sensors, data is ubiquitous available and the focus of machine learning has shifted from being able to infer from small training samples to…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-07 Radu Cristian Ionescu

This work focuses on the question of learning from a large number of devices with each device holding only a single sample of data. Several real-world applications exist to this one sample per client setup up including learning from fitness…

Machine Learning · Computer Science 2026-05-26 Praneeth Vepakomma , Amirhossein Reisizadeh , Samuel Horváth , Munther A. Dahleh

Distributed applications are broadly used due the existence of mobile devices as are mobile phones, tablets and chrome books. They are often based on an architecture client-server. A server part contains a central storage where all…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-04-12 Jan Kožusznik

Distributed machine learning systems require strong privacy guarantees, verifiable compliance, and scalable deployment across heterogeneous and multi-cloud environments. This work introduces a cloud-native privacy-preserving architecture…

Federated learning ensures the privacy of clients by conducting distributed training on individual client devices and sharing only the model weights with a central server. However, in real-world scenarios, the heterogeneity of data among…

Machine Learning · Computer Science 2024-04-30 Jaewon Jang , Bonjun Choi

Multi-server Federated learning (FL) has been considered as a promising solution to address the limited communication resource problem of single-server FL. We consider a typical multi-server FL architecture, where the coverage areas of…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-18 Zhe Qu , Xingyu Li , Jie Xu , Bo Tang , Zhuo Lu , Yao Liu

We propose clustered federated multitask learning to address statistical challenges in non-independent and identically distributed data across clients. Our approach tackles complexities in hierarchical wireless networks by clustering…

Networking and Internet Architecture · Computer Science 2024-07-15 Moqbel Hamood , Abdullatif Albaseer , Mohamed Abdallah , Ala Al-Fuqaha , Amr Mohamed

Federated learning (FL) is increasingly adopted in domains like healthcare, where data privacy is paramount. A fundamental challenge in these systems is statistical heterogeneity-the fact that data distributions vary significantly across…

Machine Learning · Computer Science 2026-02-12 Zijian Wang , Xiaofei Zhang , Xin Zhang , Yukun Liu , Qiong Zhang