English
Related papers

Related papers: FedDTG:Federated Data-Free Knowledge Distillation …

200 papers

Federated Learning (FL) is an emerging distributed learning paradigm under privacy constraint. Data heterogeneity is one of the main challenges in FL, which results in slow convergence and degraded performance. Most existing approaches only…

Machine Learning · Computer Science 2023-10-27 Lin Zhang , Li Shen , Liang Ding , Dacheng Tao , Ling-Yu Duan

Federated Learning (FL) is a distributed machine learning scheme in which clients jointly participate in the collaborative training of a global model by sharing model information rather than their private datasets. In light of concerns…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-17 Kangyang Luo , Shuai Wang , Yexuan Fu , Renrong Shao , Xiang Li , Yunshi Lan , Ming Gao , Jinlong Shu

Learning disentangled representation of data without supervision is an important step towards improving the interpretability of generative models. Despite recent advances in disentangled representation learning, existing approaches often…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Wonkwang Lee , Donggyun Kim , Seunghoon Hong , Honglak Lee

Federated learning enables multiple clients to collaboratively learn a global model by periodically aggregating the clients' models without transferring the local data. However, due to the heterogeneity of the system and data, many…

Machine Learning · Computer Science 2021-09-14 Dezhong Yao , Wanning Pan , Yutong Dai , Yao Wan , Xiaofeng Ding , Hai Jin , Zheng Xu , Lichao Sun

Data heterogeneity presents significant challenges for federated learning (FL). Recently, dataset distillation techniques have been introduced, and performed at the client level, to attempt to mitigate some of these challenges. In this…

Machine Learning · Computer Science 2023-12-05 Yuqi Jia , Saeed Vahidian , Jingwei Sun , Jianyi Zhang , Vyacheslav Kungurtsev , Neil Zhenqiang Gong , Yiran Chen

Federated Learning (FL) is gaining popularity as a distributed learning framework that only shares model parameters or gradient updates and keeps private data locally. However, FL is at risk of privacy leakage caused by privacy inference…

Machine Learning · Computer Science 2024-09-17 Kangyang Luo , Shuai Wang , Xiang Li , Yunshi Lan , Ming Gao , Jinlong Shu

Federated learning (FL) is a decentralized collaborative machine learning (ML) technique. It provides a solution to the issues of isolated data islands and data privacy leakage in industrial ML practices. One major challenge in FL is…

Machine Learning · Computer Science 2025-06-26 Yushan Zhao , Jinyuan He , Donglai Chen , Weijie Luo , Chong Xie , Ri Zhang , Yonghong Chen , Yan Xu

Data-free knowledge distillation aims to learn a compact student network from a pre-trained large teacher network without using the original training data of the teacher network. Existing collection-based and generation-based methods train…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Jialiang Tang , Shuo Chen , Chen Gong

Most existing federated learning algorithms are based on the vanilla FedAvg scheme. However, with the increase of data complexity and the number of model parameters, the amount of communication traffic and the number of iteration rounds for…

Machine Learning · Computer Science 2024-01-30 Xiaolin Zheng , Senci Ying , Fei Zheng , Jianwei Yin , Longfei Zheng , Chaochao Chen , Fengqin Dong

Federated learning (FL) is a privacy-preserving machine learning paradigm in which the server periodically aggregates local model parameters from clients without assembling their private data. Constrained communication and personalization…

Machine Learning · Computer Science 2023-11-10 Zhiyuan Wu , Sheng Sun , Yuwei Wang , Min Liu , Quyang Pan , Junbo Zhang , Zeju Li , Qingxiang Liu

Machine learning makes multimedia data (e.g., images) more attractive, however, multimedia data is usually distributed and privacy sensitive. Multiple distributed multimedia clients can resort to federated learning (FL) to jointly learn a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Hong Huang , Xinyu Lei , Tao Xiang

We propose Federated Generative Adversarial Network (FedGAN) for training a GAN across distributed sources of non-independent-and-identically-distributed data sources subject to communication and privacy constraints. Our algorithm uses…

Machine Learning · Computer Science 2020-06-16 Mohammad Rasouli , Tao Sun , Ram Rajagopal

Federated learning (FL) is a distributed training technology that enhances data privacy in mobile edge networks by allowing data owners to collaborate without transmitting raw data to the edge server. However, data heterogeneity and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yu Qiao , Apurba Adhikary , Kitae Kim , Eui-Nam Huh , Zhu Han , Choong Seon Hong

Social bot detection is of paramount importance to the resilience and security of online social platforms. The state-of-the-art detection models are siloed and have largely overlooked a variety of data characteristics from multiple…

Machine Learning · Computer Science 2023-03-14 Yingguang Yang , Renyu Yang , Hao Peng , Yangyang Li , Tong Li , Yong Liao , Pengyuan Zhou

Federated Generative Adversarial Network (FedGAN) is a communication-efficient approach to train a GAN across distributed clients without clients having to share their sensitive training data. In this paper, we experimentally show that…

Machine Learning · Computer Science 2021-04-19 Vaikkunth Mugunthan , Vignesh Gokul , Lalana Kagal , Shlomo Dubnov

Knowledge distillation (KD) can enable collaborative learning among distributed clients that have different model architectures and do not share their local data and model parameters with others. Each client updates its local model using…

Machine Learning · Computer Science 2024-06-04 Pengchao Han , Xingyan Shi , Jianwei Huang

Federated Learning (FL) is a decentralized machine-learning paradigm, in which a global server iteratively averages the model parameters of local users without accessing their data. User heterogeneity has imposed significant challenges to…

Machine Learning · Computer Science 2021-06-11 Zhuangdi Zhu , Junyuan Hong , Jiayu Zhou

Knowledge distillation has been widely used to produce portable and efficient neural networks which can be well applied on edge devices for computer vision tasks. However, almost all top-performing knowledge distillation methods need to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Haoran Zhao , Xin Sun , Junyu Dong , Hui Yu , Huiyu Zhou

In federated learning, a strong global model is collaboratively learned by aggregating clients' locally trained models. Although this precludes the need to access clients' data directly, the global model's convergence often suffers from…

Machine Learning · Computer Science 2022-11-30 Gihun Lee , Minchan Jeong , Yongjin Shin , Sangmin Bae , Se-Young Yun

Graph neural networks (GNNs) have been widely used in modeling graph structured data, owing to its impressive performance in a wide range of practical applications. Recently, knowledge distillation (KD) for GNNs has enabled remarkable…

Machine Learning · Computer Science 2022-06-17 Yuanxin Zhuang , Lingjuan Lyu , Chuan Shi , Carl Yang , Lichao Sun
‹ Prev 1 2 3 10 Next ›