English
Related papers

Related papers: Federated Customization of Large Models: Approache…

200 papers

Federated learning (FL) has become a prevalent distributed machine learning paradigm with improved privacy. After learning, the resulting federated model should be further personalized to each different client. While several methods have…

Machine Learning · Computer Science 2021-03-09 Bingyan Liu , Yao Guo , Xiangqun Chen

Efficient Federated learning (FL) is crucial for training deep networks over devices with limited compute resources and bounded networks. With the advent of big data, devices either generate or collect multimodal data to train either…

Machine Learning · Computer Science 2025-09-16 Sahil Tyagi

Federated learning (FL) has gained widespread attention for its privacy-preserving and collaborative learning capabilities. Due to significant statistical heterogeneity, traditional FL struggles to generalize a shared model across diverse…

Machine Learning · Computer Science 2025-02-04 Yu Feng , Yangli-ao Geng , Yifan Zhu , Zongfu Han , Xie Yu , Kaiwen Xue , Haoran Luo , Mengyang Sun , Guangwei Zhang , Meina Song

Machine learning in medical imaging often faces a fundamental dilemma, namely, the small sample size problem. Many recent studies suggest using multi-domain data pooled from different acquisition sites/centers to improve statistical power.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Hao Guan , Pew-Thian Yap , Andrea Bozoki , Mingxia Liu

Effectively leveraging private datasets remains a significant challenge in developing foundation models. Federated Learning (FL) has recently emerged as a collaborative framework that enables multiple users to fine-tune these models while…

Machine Learning · Computer Science 2025-10-27 Yiyuan Yang , Guodong Long , Qinghua Lu , Liming Zhu , Jing Jiang , Chengqi Zhang

Creating high-performance generalizable deep neural networks for phytoplankton monitoring requires utilizing large-scale data coming from diverse global water sources. A major challenge to training such networks lies in data privacy, where…

Machine Learning · Computer Science 2022-12-20 Daniel Zhang , Vikram Voleti , Alexander Wong , Jason Deglint

Multimodal data, which can comprehensively perceive and recognize the physical world, has become an essential path towards general artificial intelligence. However, multimodal large models trained on public datasets often underperform in…

Machine Learning · Computer Science 2023-08-25 Zengxiang Li , Zhaoxiang Hou , Hui Liu , Ying Wang , Tongzhi Li , Longfei Xie , Chao Shi , Chengyi Yang , Weishan Zhang , Zelei Liu , Liang Xu

Federated Learning (FL) aims at unburdening the training of deep models by distributing computation across multiple devices (clients) while safeguarding data privacy. On top of that, Federated Continual Learning (FCL) also accounts for data…

Machine Learning · Computer Science 2025-05-27 Riccardo Salami , Pietro Buzzega , Matteo Mosconi , Mattia Verasani , Simone Calderara

Federated Learning (FL) is a privacy-protected machine learning paradigm that allows model to be trained directly at the edge without uploading data. One of the biggest challenges faced by FL in practical applications is the heterogeneity…

Machine Learning · Computer Science 2021-08-20 Zirui Zhu , Ziyi Ye

Continual learning (CL) for Foundation Models (FMs) is an essential yet underexplored challenge, especially in Federated Continual Learning (FCL), where each client learns from a private, evolving task stream under strict data and…

Machine Learning · Computer Science 2025-08-14 Hao Yu , Xin Yang , Boyang Fan , Xuemei Cao , Hanlin Gu , Lixin Fan , Qiang Yang

Federated Learning (FL) has emerged as a significant paradigm for training machine learning models. This is due to its data-privacy-preserving property and its efficient exploitation of distributed computational resources. This is achieved…

Machine Learning · Computer Science 2025-01-22 Mustafa Ghaleb , Mohanad Obeed , Muhamad Felemban , Anas Chaaban , Halim Yanikomeroglu

Federated Learning offers a way to train deep neural networks in a distributed fashion. While this addresses limitations related to distributed data, it incurs a communication overhead as the model parameters or gradients need to be…

Machine Learning · Computer Science 2023-05-26 Morten From Elvebakken , Alexandros Iosifidis , Lukas Esterle

Federated Learning (FL) allows collaborative training while ensuring data privacy across distributed edge devices, making it a popular solution for privacy-sensitive applications. However, FL faces significant challenges due to statistical…

Machine Learning · Computer Science 2025-05-16 Huy Q. Le , Latif U. Khan , Choong Seon Hong

We propose an asymptotic framework to analyze the performance of (personalized) federated learning algorithms. In this new framework, we formulate federated learning as a multi-criterion objective, where the goal is to minimize each…

Machine Learning · Computer Science 2022-02-21 Gary Cheng , Karan Chadha , John Duchi

The classical machine learning paradigm requires the aggregation of user data in a central location where machine learning practitioners can preprocess data, calculate features, tune models and evaluate performance. The advantage of this…

Current state-of-the-art deep learning based face recognition (FR) models require a large number of face identities for central training. However, due to the growing privacy awareness, it is prohibited to access the face images on user…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Chih-Ting Liu , Chien-Yi Wang , Shao-Yi Chien , Shang-Hong Lai

Federated Learning (FL) is a novel, multidisciplinary Machine Learning paradigm where multiple clients, such as mobile devices, collaborate to solve machine learning problems. Initially introduced in Kone{\v{c}}n{\'y} et al. (2016a,b);…

Machine Learning · Computer Science 2025-09-11 Konstantin Burlachenko

Learning an effective global model on private and decentralized datasets has become an increasingly important challenge of machine learning when applied in practice. Existing distributed learning paradigms, such as Federated Learning,…

Machine Learning · Computer Science 2023-06-05 Tengfei Ma , Trong Nghia Hoang , Jie Chen

Federated learning is a collaborative model training method that iterates model updates by multiple clients and aggregation of the updates by a central server. Device and statistical heterogeneity of participating clients cause significant…

Machine Learning · Computer Science 2023-08-29 Ayano Nakai-Kasai , Tadashi Wadayama

Federated Learning (FL) is a machine learning paradigm in which many clients cooperatively train a single centralized model while keeping their data private and decentralized. FL is commonly used in edge computing, which involves placing…