English
Related papers

Related papers: Secure Federated Data Distillation

200 papers

Deep neural networks (DNNs) have achieved significant success in numerous applications. The remarkable performance of DNNs is largely attributed to the availability of massive, high-quality training datasets. However, processing such…

Sound · Computer Science 2024-07-23 Wenbo Jiang , Rui Zhang , Hongwei Li , Xiaoyuan Liu , Haomiao Yang , Shui Yu

Dataset distillation (DD) is a newly emerging research area aiming at alleviating the heavy computational load in training models on large datasets. It tries to distill a large dataset into a small and condensed one so that models trained…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Yuxuan Duan , Jianfu Zhang , Liqing Zhang

Federated learning suffers in the case of non-iid local datasets, i.e., when the distributions of the clients' data are heterogeneous. One promising approach to this challenge is the recently proposed method FedAUX, an augmentation of…

Machine Learning · Computer Science 2022-06-22 Haley Hoech , Roman Rischke , Karsten Müller , Wojciech Samek

Federated Learning (FL) seeks to train a model collaboratively without sharing private training data from individual clients. Despite its promise, FL encounters challenges such as high communication costs for large-scale models and the…

Machine Learning · Computer Science 2024-04-15 Lin Li , Jianping Gou , Baosheng Yu , Lan Du , Zhang Yiand Dacheng Tao

Federated learning (FL) has emerged as a promising approach for collaborative medical image analysis, enabling multiple institutions to build robust predictive models while preserving sensitive patient data. In the context of Whole Slide…

Image and Video Processing · Electrical Eng. & Systems 2025-06-19 Haolong Jin , Shenglin Liu , Cong Cong , Qingmin Feng , Yongzhi Liu , Lina Huang , Yingzi Hu

Huge amount of data is the key of the success of deep learning, however, redundant information impairs the generalization ability of the model and increases the burden of calculation. Dataset Distillation (DD) compresses the original…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Hangyang Kong , Wenbo Zhou , Xuxiang He , Xiaotong Tu , Xinghao Ding

Dataset distillation is the technique of synthesizing smaller condensed datasets from large original datasets while retaining necessary information to persist the effect. In this paper, we approach the dataset distillation problem from a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Mingyang Chen , Bo Huang , Junda Lu , Bing Li , Yi Wang , Minhao Cheng , Wei Wang

Dataset distillation compresses large datasets into compact synthetic ones to reduce storage and computational costs. Among various approaches, distribution matching (DM)-based methods have attracted attention for their high efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Fengli Ran , Xiao Pu , Bo Liu , Xiuli Bi , Bin Xiao

Decentralized Federated Learning (DFL) enables collaborative model training without a central server, but it remains vulnerable to privacy leakage because shared model updates can expose sensitive information through inversion,…

Cryptography and Security · Computer Science 2025-12-09 Fardin Jalil Piran , Zhiling Chen , Yang Zhang , Qianyu Zhou , Jiong Tang , Farhad Imani

Dataset distillation (DD) aims to generate a compact yet informative dataset that achieves performance comparable to the original dataset, thereby reducing demands on storage and computational resources. Although diffusion models have made…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Yawen Zou , Guang Li , Zi Wang , Chunzhi Gu , Chao Zhang

Dataset distillation (DD) has emerged as a powerful paradigm for dataset compression, enabling the synthesis of compact surrogate datasets that approximate the training utility of large-scale ones. While significant progress has been…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xulin Gu , Xinhao Zhong , Zhixing Wei , Yimin Zhou , Shuoyang Sun , Bin Chen , Hongpeng Wang , Yuan Luo

Federated learning(FL) is an emerging distributed learning paradigm with default client privacy because clients can keep sensitive data on their devices and only share local training parameter updates with the federated server. However,…

Machine Learning · Computer Science 2021-07-05 Wenqi Wei , Ling Liu , Yanzhao Wu , Gong Su , Arun Iyengar

Federated learning (FL) is inherently susceptible to privacy breaches and poisoning attacks. To tackle these challenges, researchers have separately devised secure aggregation mechanisms to protect data privacy and robust aggregation…

Cryptography and Security · Computer Science 2025-02-11 Runhua Xu , Shiqi Gao , Chao Li , James Joshi , Jianxin Li

One-shot Federated learning (FL) is a powerful technology facilitating collaborative training of machine learning models in a single round of communication. While its superiority lies in communication efficiency and privacy preservation…

Machine Learning · Computer Science 2024-12-09 Junyuan Zhang , Songhua Liu , Xinchao Wang

Federated Learning (FL) is a distributed and privacy-preserving machine learning paradigm that coordinates multiple clients to train a model while keeping the raw data localized. However, this traditional FL poses some challenges, including…

Machine Learning · Computer Science 2026-05-12 Laiqiao Qin , Tianqing Zhu , Wanlei Zhou , Philip S. Yu

Federated learning (FL) is a machine learning paradigm in which distributed local nodes collaboratively train a central model without sharing individually held private data. Existing FL methods either iteratively share local model…

Machine Learning · Computer Science 2023-12-25 Xuan Gong , Shanglin Li , Yuxiang Bao , Barry Yao , Yawen Huang , Ziyan Wu , Baochang Zhang , Yefeng Zheng , David Doermann

Recently, innovative model aggregation methods based on knowledge distillation (KD) have been proposed for federated learning (FL). These methods not only improved the robustness of model aggregation over heterogeneous learning environment,…

Machine Learning · Computer Science 2023-12-29 Ho Man Kwan , Shenghui Song

Conventional federated learning directly averages model weights, which is only possible for collaboration between models with homogeneous architectures. Sharing prediction instead of weight removes this obstacle and eliminates the risk of…

Cryptography and Security · Computer Science 2021-05-24 Lichao Sun , Lingjuan Lyu

In recent years, the financial sector has faced growing pressure to adopt advanced machine learning models to derive valuable insights while preserving data privacy. However, the highly sensitive nature of financial data presents…

Computational Engineering, Finance, and Science · Computer Science 2024-10-18 Peilin He , Chenkai Lin , Isabella Montoya

Advanced adversarial attacks such as membership inference and model memorization can make federated learning (FL) vulnerable and potentially leak sensitive private data. Local differentially private (LDP) approaches are gaining more…

Cryptography and Security · Computer Science 2022-08-04 M. A. P. Chamikara , Dongxi Liu , Seyit Camtepe , Surya Nepal , Marthie Grobler , Peter Bertok , Ibrahim Khalil