English
Related papers

Related papers: Privately Customizing Prefinetuning to Better Matc…

200 papers

The rapid proliferation of large language models (LLMs) has created an unprecedented demand for fine-tuning models for specialized domains, such as medical science. While federated learning (FL) offers a decentralized and privacy-preserving…

Machine Learning · Computer Science 2025-06-25 Amir Faiyaz , Tara Salman

Federated learning (FL) is a distributed machine learning approach that allows multiple clients to collaboratively train a model without sharing their raw data. To prevent sensitive information from being inferred through the model updates…

Machine Learning · Computer Science 2024-09-23 Zhenxiao Zhang , Yuanxiong Guo , Yanmin Gong

In this paper, we address the problem of privacy-preserving hyperparameter (HP) tuning for cross-silo federated learning (FL). We first perform a comprehensive measurement study that benchmarks various HP strategies suitable for FL. Our…

Cryptography and Security · Computer Science 2024-05-24 Natalija Mitic , Apostolos Pyrgelis , Sinem Sav

Train machine learning models on sensitive user data has raised increasing privacy concerns in many areas. Federated learning is a popular approach for privacy protection that collects the local gradient information instead of real data.…

Cryptography and Security · Computer Science 2021-05-24 Lichao Sun , Jianwei Qian , Xun Chen

In many applications of federated learning (FL), clients desire models that are personalized using their local data, yet are also robust in the sense that they retain general global knowledge. However, the presence of data heterogeneity…

Machine Learning · Computer Science 2023-10-10 Liam Collins , Shanshan Wu , Sewoong Oh , Khe Chai Sim

Many application scenarios call for training a machine learning model among multiple participants. Federated learning (FL) was proposed to enable joint training of a deep learning model using the local data in each party without revealing…

Machine Learning · Computer Science 2021-02-12 Kai-Fung Chu , Lintao Zhang

The growing development of artificial intelligence based solutions, together with privacy legislation, has driven the rise of the so-called privacy preserving machine learning architectures, such as federated learning. While federated…

Cryptography and Security · Computer Science 2026-05-05 Judith Sáinz-Pardo Díaz , Álvaro López García

Federated learning (FL) that enables edge devices to collaboratively learn a shared model while keeping their training data locally has received great attention recently and can protect privacy in comparison with the traditional centralized…

Machine Learning · Computer Science 2022-11-17 Rui Hu , Yanmin Gong , Yuanxiong Guo

Foundation models have revolutionized artificial intelligence by providing robust, versatile architectures pre-trained on large-scale datasets. However, adapting these massive models to specific downstream tasks requires fine-tuning, which…

Machine Learning · Computer Science 2025-05-01 Jieming Bian , Yuanzhe Peng , Lei Wang , Yin Huang , Jie Xu

As people pay more and more attention to privacy protection, Federated Learning (FL), as a promising distributed machine learning paradigm, is receiving more and more attention. However, due to the biased distribution of data on devices in…

Machine Learning · Computer Science 2023-02-27 Yuquan Zhang , Yongquan Zhang

Federated learning (FL) enables multiple clients to collaboratively learn a shared model without sharing their individual data. Concerns about utility, privacy, and training efficiency in FL have garnered significant research attention.…

Machine Learning · Computer Science 2024-01-30 Hanlin Gu , Xinyuan Zhao , Gongxi Zhu , Yuxing Han , Yan Kang , Lixin Fan , Qiang Yang

Federated learning is a machine learning setting where a set of edge devices collaboratively train a model under the orchestration of a central server without sharing their local data. At each communication round of federated learning, edge…

Machine Learning · Computer Science 2020-09-23 Rui Hu , Yuanxiong Guo , Yanmin Gong

A key feature of federated learning (FL) is to preserve the data privacy of end users. However, there still exist potential privacy leakage in exchanging gradients under FL. As a result, recent research often explores the differential…

Cryptography and Security · Computer Science 2024-03-20 Yuntao Wang , Zhou Su , Yanghe Pan , Tom H Luan , Ruidong Li , Shui Yu

Integrating Foundation Models (FMs) into recommendation systems is an emerging and promising research direction. However, centralized paradigms face growing pressure from privacy concerns and strict regulatory requirements. Federated…

Machine Learning · Computer Science 2026-05-08 Zhiwei Li , Guodong Long , Chunxu Zhang , Honglei Zhang , Jing Jiang , Chengqi Zhang

Federated Learning (FL) is an emerging paradigm that enables distributed users to collaboratively and iteratively train machine learning models without sharing their private data. Motivated by the effectiveness and robustness of…

Machine Learning · Computer Science 2022-11-16 Jinyu Chen , Wenchao Xu , Song Guo , Junxiao Wang , Jie Zhang , Haozhao Wang

Federated Learning (FL) is a machine learning technique that enables multiple entities to collaboratively learn a shared model without exchanging their local data. Over the past decade, FL systems have achieved substantial progress, scaling…

Machine Learning · Computer Science 2025-03-04 Katharine Daly , Hubert Eichner , Peter Kairouz , H. Brendan McMahan , Daniel Ramage , Zheng Xu

Federated Learning (FL) allows training machine learning models in privacy-constrained scenarios by enabling the cooperation of edge devices without requiring local data sharing. This approach raises several challenges due to the different…

Machine Learning · Computer Science 2022-12-02 Riccardo Zaccone , Andrea Rizzardi , Debora Caldarola , Marco Ciccone , Barbara Caputo

Federated learning (FL) is an important technique for learning models from decentralized data in a privacy-preserving way. Existing FL methods usually uniformly sample clients for local model learning in each round. However, different…

Machine Learning · Computer Science 2023-06-27 Tao Qi , Fangzhao Wu , Lingjuan Lyu , Yongfeng Huang , Xing Xie

Federated learning (FL) allows to train a massive amount of data privately due to its decentralized structure. Stochastic gradient descent (SGD) is commonly used for FL due to its good empirical performance, but sensitive user information…

Machine Learning · Computer Science 2021-02-10 Muah Kim , Onur Günlü , Rafael F. Schaefer

Federated learning (FL) is a framework for machine learning across heterogeneous client devices in a privacy-preserving fashion. To date, most FL algorithms learn a "global" server model across multiple rounds. At each round, the same…

Machine Learning · Computer Science 2022-08-22 Zachary Charles , Kallista Bonawitz , Stanislav Chiknavaryan , Brendan McMahan , Blaise Agüera y Arcas