English
Related papers

Related papers: ZooPFL: Exploring Black-box Foundation Models for …

200 papers

Current state-of-the-art deep learning based face recognition (FR) models require a large number of face identities for central training. However, due to the growing privacy awareness, it is prohibited to access the face images on user…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Chih-Ting Liu , Chien-Yi Wang , Shao-Yi Chien , Shang-Hong Lai

Federated Learning (FL) is a method of training machine learning models on private data distributed over a large number of possibly heterogeneous clients such as mobile phones and IoT devices. In this work, we propose a new federated…

Machine Learning · Computer Science 2021-12-15 Enmao Diao , Jie Ding , Vahid Tarokh

To support real-world decision-making, it is crucial for models to be well-calibrated, i.e., to assign reliable confidence estimates to their predictions. Uncertainty quantification is particularly important in personalized federated…

Machine Learning · Computer Science 2024-10-21 Boning Zhang , Dongzhu Liu , Osvaldo Simeone , Guanchu Wang , Dimitrios Pezaros , Guangxu Zhu

Vertical Federated Learning (VFL) attracts increasing attention because it empowers multiple parties to jointly train a privacy-preserving model over vertically partitioned data. Recent research has shown that applying zeroth-order…

Machine Learning · Computer Science 2023-06-30 Ganyu Wang , Qingsong Zhang , Li Xiang , Boyu Wang , Bin Gu , Charles Ling

Federated learning (FL) can help promote data privacy by training a shared model in a de-centralized manner on the physical devices of clients. In the presence of highly heterogeneous distributions of local data, personalized FL strategy…

Machine Learning · Statistics 2022-10-12 Zhe Liu , Yue Hui , Fuchun Peng

Federated learning allows clients to collaboratively learn statistical models while keeping their data local. Federated learning was originally used to train a unique global model to be served to all clients, but this approach might be…

Machine Learning · Computer Science 2022-06-20 Othmane Marfoq , Giovanni Neglia , Laetitia Kameni , Richard Vidal

Federated Learning (FL) is currently the most widely adopted framework for collaborative training of (deep) machine learning models under privacy constraints. Albeit it's popularity, it has been observed that Federated Learning yields…

Machine Learning · Computer Science 2019-10-07 Felix Sattler , Klaus-Robert Müller , Wojciech Samek

Federated learning (FL) has become a prevalent distributed machine learning paradigm with improved privacy. After learning, the resulting federated model should be further personalized to each different client. While several methods have…

Machine Learning · Computer Science 2021-03-09 Bingyan Liu , Yao Guo , Xiangqun Chen

Large Language Models (LLMs) perform well on many NLP tasks, but fine-tuning them on resource-constrained mobile devices is challenging due to high memory and computation costs, despite growing demands for privacy-preserving…

Machine Learning · Computer Science 2026-01-21 He Sun , Jinrui Zhou , Li Li , Mingjun Xiao

Personalized federated learning (PFL) with foundation models has emerged as a promising paradigm enabling clients to adapt to heterogeneous data distributions. However, real-world scenarios often face the co-occurrence of non-IID data and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Shihao Hou , Chikai Shang , Zhiheng Yang , Jiacheng Yang , Xinyi Shang , Junlong Gao , Yiqun Zhang , Yang Lu

When the available hardware cannot meet the memory and compute requirements to efficiently train high performing machine learning models, a compromise in either the training quality or the model complexity is needed. In Federated Learning…

Machine Learning · Computer Science 2022-08-05 Xinchi Qiu , Javier Fernandez-Marques , Pedro PB Gusmao , Yan Gao , Titouan Parcollet , Nicholas Donald Lane

Federated Learning (FL) has emerged as a promising method to collaboratively learn from decentralized and heterogeneous data available at different clients without the requirement of data ever leaving the clients. Recent works on FL have…

Machine Learning · Computer Science 2024-11-28 Shivam Pal , Aishwarya Gupta , Saqib Sarwar , Piyush Rai

Federated Learning (FL) is an emerging learning framework that enables edge devices to collaboratively train ML models without sharing their local data. FL faces, however, a significant challenge due to the high amount of information that…

Machine Learning · Computer Science 2025-08-12 Mohamad Assaad , Zeinab Nehme , Merouane Debbah

Federated Learning (FL) enables decentralized, privacy-preserving model training but struggles to balance global generalization and local personalization due to non-identical data distributions across clients. Personalized Fine-Tuning…

Machine Learning · Computer Science 2025-12-30 Minghui Chen , Hrad Ghoukasian , Ruinan Jin , Zehua Wang , Sai Praneeth Karimireddy , Xiaoxiao Li

Effectively leveraging private datasets remains a significant challenge in developing foundation models. Federated Learning (FL) has recently emerged as a collaborative framework that enables multiple users to fine-tune these models while…

Machine Learning · Computer Science 2025-10-27 Yiyuan Yang , Guodong Long , Qinghua Lu , Liming Zhu , Jing Jiang , Chengqi Zhang

Federated learning (FL) is a privacy preserving machine learning paradigm designed to collaboratively learn a global model without data leakage. Specifically, in a typical FL system, the central server solely functions as an coordinator to…

Machine Learning · Computer Science 2024-12-17 Hangyu Zhu , Yuxiang Fan , Zhenping Xie

Federated learning (FL) has emerged as a powerful paradigm for collaborative model training across distributed clients while preserving data privacy. However, existing FL algorithms predominantly focus on unconstrained optimization problems…

Optimization and Control · Mathematics 2025-08-22 Hongye Wang , Zhaoye Pan , Chang He , Jiaxiang Li , Bo Jiang

In the context of personalized federated learning (FL), the critical challenge is to balance local model improvement and global model tuning when the personal and global objectives may not be exactly aligned. Inspired by Bayesian…

Machine Learning · Computer Science 2022-04-19 Huili Chen , Jie Ding , Eric Tramel , Shuang Wu , Anit Kumar Sahu , Salman Avestimehr , Tao Zhang

Foundation models open up new possibilities for the use of AI in healthcare. However, even when pre-trained on health data, they still need to be fine-tuned for specific downstream tasks. Furthermore, although foundation models reduce the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Adam Tupper , Christian Gagné

Federated Learning (FL) is a privacy-protected machine learning paradigm that allows model to be trained directly at the edge without uploading data. One of the biggest challenges faced by FL in practical applications is the heterogeneity…

Machine Learning · Computer Science 2021-08-20 Zirui Zhu , Ziyi Ye