English
Related papers

Related papers: Federated Learning with Uncertainty via Distilled …

200 papers

Clustered Federated Learning (CFL) addresses the challenges posed by non-IID data by training multiple group- or cluster-specific expert models. However, existing methods often overlook the shared information across clusters, which…

Machine Learning · Computer Science 2025-06-26 Zeqi Leng , Chunxu Zhang , Guodong Long , Riting Xia , Bo Yang

Federated learning is a promising privacy-preserving paradigm for distributed machine learning. In this context, there is sometimes a need for a specialized process called machine unlearning, which is required when the effect of some…

Cryptography and Security · Computer Science 2024-06-19 Heng Xu , Tianqing Zhu , Lefeng Zhang , Wanlei Zhou , Philip S. Yu

Federated Learning enables multiple data centers to train a central model collaboratively without exposing any confidential data. Even though deterministic models are capable of performing high prediction accuracy, their lack of calibration…

Machine Learning · Computer Science 2022-11-24 Atahan Ozer , Kadir Burak Buldu , Abdullah Akgül , Gozde Unal

Conventional federated learning (FL) frameworks often suffer from training degradation due to data uncertainty and heterogeneity across local clients. Probabilistic approaches such as Bayesian neural networks (BNNs) can mitigate this issue…

Machine Learning · Computer Science 2026-03-20 Ratun Rahman , Dinh C. Nguyen

Federated Learning (FL) is a machine learning paradigm where local nodes collaboratively train a central model while the training data remains decentralized. Existing FL methods typically share model parameters or employ co-distillation to…

Cryptography and Security · Computer Science 2022-09-13 Xuan Gong , Abhishek Sharma , Srikrishna Karanam , Ziyan Wu , Terrence Chen , David Doermann , Arun Innanje

Federated Learning (FL) has emerged as a promising method to collaboratively learn from decentralized and heterogeneous data available at different clients without the requirement of data ever leaving the clients. Recent works on FL have…

Machine Learning · Computer Science 2024-11-28 Shivam Pal , Aishwarya Gupta , Saqib Sarwar , Piyush Rai

Diffusion models are powerful generative models that can produce highly realistic samples for various tasks. Typically, these models are constructed using centralized, independently and identically distributed (IID) training data. However,…

Machine Learning · Computer Science 2025-03-14 Zihao Peng , Xijun Wang , Shengbo Chen , Hong Rao , Cong Shen

In this paper, we introduce DistDD, a novel approach within the federated learning framework that reduces the need for repetitive communication by distilling data directly on clients' devices. Unlike traditional federated learning that…

Machine Learning · Computer Science 2024-10-14 Peiran Wang , Haohan Wang

The canonical formulation of federated learning treats it as a distributed optimization problem where the model parameters are optimized against a global loss function that decomposes across client loss functions. A recent alternative…

Machine Learning · Computer Science 2023-02-09 Han Guo , Philip Greengard , Hongyi Wang , Andrew Gelman , Yoon Kim , Eric P. Xing

Federated learning allows clients to collaboratively learn statistical models while keeping their data local. Federated learning was originally used to train a unique global model to be served to all clients, but this approach might be…

Machine Learning · Computer Science 2022-06-20 Othmane Marfoq , Giovanni Neglia , Laetitia Kameni , Richard Vidal

Uncertainty estimation is a key component in any deployed machine learning system. One way to evaluate uncertainty estimation is using "out-of-distribution" (OoD) detection, that is, distinguishing between the training data distribution and…

Machine Learning · Computer Science 2021-12-03 Haiwen Huang , Joost van Amersfoort , Yarin Gal

Federated Learning (FL) is a novel approach that allows for collaborative machine learning while preserving data privacy by leveraging models trained on decentralized devices. However, FL faces challenges due to non-uniformly distributed…

Machine Learning · Computer Science 2024-04-16 Changlin Song , Divya Saxena , Jiannong Cao , Yuqing Zhao

Federated Learning (FL) aims to train a global inference model from remotely distributed clients, gaining popularity due to its benefit of improving data privacy. However, traditional FL often faces challenges in practical applications,…

Machine Learning · Computer Science 2025-10-24 Insu Jeon , Minui Hong , Junhyeog Yun , Gunhee Kim

Federated Learning (FL) is a collaborative machine learning paradigm for enhancing data privacy preservation. Its privacy-preserving nature complicates the explanation of the decision-making processes and the evaluation of the reliability…

Machine Learning · Computer Science 2025-03-10 Yanci Zhang , Han Yu

While Federated Learning (FL) is gaining popularity for training machine learning models in a decentralized fashion, numerous challenges persist, such as asynchronization, computational expenses, data heterogeneity, and gradient and…

Machine Learning · Computer Science 2025-03-13 Chun-Yin Huang , Ruinan Jin , Can Zhao , Daguang Xu , Xiaoxiao Li

Federated learning seeks to foster collaboration among distributed clients while preserving the privacy of their local data. Traditionally, federated learning methods assume a fixed setting in which client data and learning objectives…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Can Peng , Qianhui Men , Pramit Saha , Qianye Yang , Cheng Ouyang , J. Alison Noble

Fine-tuning pre-trained models is a popular approach in machine learning for solving complex tasks with moderate data. However, fine-tuning the entire pre-trained model is ineffective in federated data scenarios where local data…

Machine Learning · Computer Science 2025-02-28 Pei-Yau Weng , Minh Hoang , Lam M. Nguyen , My T. Thai , Tsui-Wei Weng , Trong Nghia Hoang

Federated learning is a distributed, privacy-aware learning scenario which trains a single model on data belonging to several clients. Each client trains a local model on its data and the local models are then aggregated by a central party.…

Machine Learning · Computer Science 2020-01-01 Hesham Mostafa

In Federated Learning, we aim to train models across multiple computing units (users), while users can only communicate with a common central server, without exchanging their data samples. This mechanism exploits the computational power of…

Machine Learning · Computer Science 2020-10-26 Alireza Fallah , Aryan Mokhtari , Asuman Ozdaglar

Federated learning enables joint training of machine learning models from distributed clients without sharing their local data. One key challenge in federated learning is to handle non-identically distributed data across the clients, which…

Machine Learning · Computer Science 2023-12-25 Tiejin Chen , Yuanpu Cao , Yujia Wang , Cho-Jui Hsieh , Jinghui Chen