English
Related papers

Related papers: Many-Task Federated Fine-Tuning via Unified Task V…

200 papers

Federated learning, an emerging machine learning paradigm, enables clients to collaboratively train a model without exchanging local data. Clients participating in the training process significantly impact the convergence rate, learning…

Machine Learning · Computer Science 2024-08-30 Fares Fourati , Salma Kharrat , Vaneet Aggarwal , Mohamed-Slim Alouini , Marco Canini

Federated learning (FL) has emerged as a promising paradigm in machine learning, enabling collaborative model training across decentralized devices without the need for raw data sharing. In FL, a global model is trained iteratively on local…

Machine Learning · Computer Science 2025-04-01 Kanishka Ranaweera , Azadeh Ghari Neiat , Xiao Liu , Bipasha Kashyap , Pubudu N. Pathirana

Fine-tuning pre-trained large language models (LLMs) has become a common practice for personalized natural language understanding (NLU) applications on downstream tasks and domain-specific datasets. However, there are two main challenges:…

Federated Learning (FL) is a distributed machine learning paradigm where data is distributed among clients who collaboratively train a model in a computation process coordinated by a central server. By assigning a weight to each client…

Machine Learning · Computer Science 2021-05-19 Amit Portnoy , Yoav Tirosh , Danny Hendler

Federated Learning (FL) enables collaborative learning across distributed clients while preserving data privacy. However, FL faces significant challenges when dealing with heterogeneous data distributions, which can lead to suboptimal…

Machine Learning · Computer Science 2025-03-11 Duy Phuong Nguyen , J. Pablo Munoz , Tanya Roosta , Ali Jannesari

Federated learning (FL) is a decentralized and privacy-preserving machine learning technique in which a group of clients collaborate with a server to learn a global model without sharing clients' data. One challenge associated with FL is…

Machine Learning · Computer Science 2022-01-27 Canh T. Dinh , Nguyen H. Tran , Tuan Dung Nguyen

Federated learning (FL) has emerged as a transformative training paradigm, particularly invaluable in privacy-sensitive domains like healthcare. However, client heterogeneity in data, computing power, and tasks poses a significant…

Machine Learning · Computer Science 2024-10-01 Huidong Tang , Chen Li , Huachong Yu , Sayaka Kamei , Yasuhiko Morimoto

Federated learning (FL) is an emerging technique that trains massive and geographically distributed edge data while maintaining privacy. However, FL has inherent challenges in terms of fairness and computational efficiency due to the rising…

Machine Learning · Computer Science 2023-04-28 Yingchun Wang , Jingcai Guo , Jie Zhang , Song Guo , Weizhan Zhang , Qinghua Zheng

The innovative Federated Multi-Task Learning (FMTL) approach consolidates the benefits of Federated Learning (FL) and Multi-Task Learning (MTL), enabling collaborative model training on multi-task learning datasets. However, a comprehensive…

Machine Learning · Computer Science 2024-04-17 Yuwen Yang , Yuxiang Lu , Suizhi Huang , Shalayiding Sirejiding , Hongtao Lu , Yue Ding

Federated Learning (FL) enables decentralised model training across distributed clients without requiring data centralisation. However, the generalisation performance of the global model is usually degraded by data heterogeneity across…

Machine Learning · Computer Science 2026-05-11 Ozgu Goksu , Nicolas Pugeault

Federated Learning (FL) is a novel machine learning approach that allows the model trainer to access more data samples, by training the model across multiple decentralized data sources, while data access constraints are in place. Such…

Computation and Language · Computer Science 2022-11-18 Andre Manoel , Mirian Hipolito Garcia , Tal Baumel , Shize Su , Jialei Chen , Dan Miller , Danny Karmon , Robert Sim , Dimitrios Dimitriadis

Training mixed-domain translation models is a complex task that demands tailored architectures and costly data preparation techniques. In this work, we leverage federated learning (FL) in order to tackle the problem. Our investigation…

Computation and Language · Computer Science 2022-05-04 Peyman Passban , Tanya Roosta , Rahul Gupta , Ankit Chadha , Clement Chung

Vertical federated learning (FL) is a collaborative machine learning framework that enables devices to learn a global model from the feature-partition datasets without sharing local raw data. However, as the number of the local intermediate…

Information Theory · Computer Science 2023-05-11 Yuanming Shi , Shuhao Xia , Yong Zhou , Yijie Mao , Chunxiao Jiang , Meixia Tao

Personalized Federated Learning (PFL) enables a collection of agents to collaboratively learn individual models without sharing raw data. We propose a new PFL approach in which each agent optimizes a weighted combination of all agents'…

Machine Learning · Computer Science 2026-03-04 Jean-Baptiste Fermanian , Batiste Le Bars , Aurélien Bellet

Federated learning (FL) has emerged as a key technique for distributed machine learning (ML). Most literature on FL has focused on ML model training for (i) a single task/model, with (ii) a synchronous scheme for updating model parameters,…

Machine Learning · Computer Science 2024-02-19 Zhan-Lun Chang , Seyyedali Hosseinalipour , Mung Chiang , Christopher G. Brinton

Federated learning (FL) is a machine learning paradigm that facilitates massively distributed model training with end-user data on edge devices directed by a central server. However, the large number of heterogeneous clients in FL…

Machine Learning · Computer Science 2025-04-23 Qifan Yan , Andrew Liu , Shiqi He , Mathias Lécuyer , Ivan Beschastnikh

Federated learning (FL) is a distributed model training paradigm that preserves clients' data privacy. It has gained tremendous attention from both academia and industry. FL hyper-parameters (e.g., the number of selected clients and the…

Machine Learning · Computer Science 2022-11-28 Huanle Zhang , Lei Fu , Mi Zhang , Pengfei Hu , Xiuzhen Cheng , Prasant Mohapatra , Xin Liu

Federated learning (FL) is a novel distributed machine learning paradigm that enables participants to collaboratively train a centralized model with privacy preservation by eliminating the requirement of data sharing. In practice, FL often…

Machine Learning · Computer Science 2024-03-05 Wei Guo , Fuzhen Zhuang , Xiao Zhang , Yiqi Tong , Jin Dong

Federated Learning (FL) is a distributed machine learning approach where multiple clients work together to solve a machine learning task. One of the key challenges in FL is the issue of partial participation, which occurs when a large…

Machine Learning · Computer Science 2023-03-01 Grigory Malinovsky , Samuel Horváth , Konstantin Burlachenko , Peter Richtárik

Spectral clustering has emerged as one of the most effective clustering algorithms due to its superior performance. However, most existing models are designed for centralized settings, rendering them inapplicable in modern decentralized…

Machine Learning · Computer Science 2026-04-17 Suyan Dai , Gan Sun , Fazeng Li , Xu Tang , Qianqian Wang , Yang Cong