中文
相关论文

相关论文: An Efficient Federated Distillation Learning Syste…

200 篇论文

In recent years, federated learning (FL) has emerged as a promising technique for training machine learning models in a decentralized manner while also preserving data privacy. The non-independent and identically distributed (non-i.i.d.)…

机器学习 · 计算机科学 2024-02-15 Yousef Alsenani , Rahul Mishra , Khaled R. Ahmed , Atta Ur Rahman

Most existing federated learning algorithms are based on the vanilla FedAvg scheme. However, with the increase of data complexity and the number of model parameters, the amount of communication traffic and the number of iteration rounds for…

机器学习 · 计算机科学 2024-01-30 Xiaolin Zheng , Senci Ying , Fei Zheng , Jianwei Yin , Longfei Zheng , Chaochao Chen , Fengqin Dong

Personalization in federated learning (FL) functions as a coordinator for clients with high variance in data or behavior. Ensuring the convergence of these clients' models relies on how closely users collaborate with those with similar…

机器学习 · 计算机科学 2023-02-24 Eunjeong Jeong , Marios Kountouris

Federated Learning (FL) is a machine learning setting where many devices collaboratively train a machine learning model while keeping the training data decentralized. In most of the current training schemes the central model is refined by…

机器学习 · 计算机科学 2021-03-30 Tao Lin , Lingjing Kong , Sebastian U. Stich , Martin Jaggi

With the rapid expansion of edge devices, such as IoT devices, where crucial data needed for machine learning applications is generated, it becomes essential to promote their participation in privacy-preserving Federated Learning (FL)…

机器学习 · 计算机科学 2025-01-03 Hongrui Shi , Valentin Radu , Po Yang

While diffusion models effectively generate remarkable synthetic images, a key limitation is the inference inefficiency, requiring numerous sampling steps. To accelerate inference and maintain high-quality synthesis, teacher-student…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Chi Hong , Jiyue Huang , Robert Birke , Dick Epema , Stefanie Roos , Lydia Y. Chen

The training of deep learning models in seizure prediction requires large amounts of Electroencephalogram (EEG) data. However, acquiring sufficient labeled EEG data is difficult due to annotation costs and privacy constraints. Federated…

机器学习 · 计算机科学 2025-10-13 Jionghao Lou , Jian Zhang , Zhongmei Li , Lanlan Chen , Enbo Feng

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

分布式、并行与集群计算 · 计算机科学 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Federated Learning (FL) seeks to train a model collaboratively without sharing private training data from individual clients. Despite its promise, FL encounters challenges such as high communication costs for large-scale models and the…

机器学习 · 计算机科学 2024-04-15 Lin Li , Jianping Gou , Baosheng Yu , Lan Du , Zhang Yiand Dacheng Tao

While Federated Learning (FL) is gaining popularity for training machine learning models in a decentralized fashion, numerous challenges persist, such as asynchronization, computational expenses, data heterogeneity, and gradient and…

机器学习 · 计算机科学 2025-03-13 Chun-Yin Huang , Ruinan Jin , Can Zhao , Daguang Xu , Xiaoxiao Li

Discrete diffusion models (DDMs) have shown powerful generation ability for discrete data modalities like text and molecules. However, their practical application is hindered by inefficient sampling, requiring a large number of sampling…

机器学习 · 计算机科学 2025-09-25 Feiyang Fu , Tongxian Guo , Zhaoqiang Liu

One-shot Federated learning (FL) is a powerful technology facilitating collaborative training of machine learning models in a single round of communication. While its superiority lies in communication efficiency and privacy preservation…

机器学习 · 计算机科学 2024-12-09 Junyuan Zhang , Songhua Liu , Xinchao Wang

The growing interest in intelligent services and privacy protection for mobile devices has given rise to the widespread application of federated learning in Multi-access Edge Computing (MEC). Diverse user behaviors call for personalized…

机器学习 · 计算机科学 2025-02-28 Zhiyuan Wu , Sheng Sun , Yuwei Wang , Min Liu , Quyang Pan , Xuefeng Jiang , Bo Gao

Distributed Learning (DL) enables the training of machine learning models across multiple devices, yet it faces challenges like non-IID data distributions and device capability disparities, which can impede training efficiency.…

机器学习 · 计算机科学 2025-02-20 Mengchen Fan , Keren Li , Tianyun Zhang , Qing Tian , Baocheng Geng

While federated learning is promising for privacy-preserving collaborative learning without revealing local data, it remains vulnerable to white-box attacks and struggles to adapt to heterogeneous clients. Federated distillation (FD), built…

机器学习 · 计算机科学 2023-12-18 Jiawei Shao , Fangzhao Wu , Jun Zhang

Cross-Domain Few-Shot Semantic Segmentation (CD-FSS) seeks to segment unknown classes in unseen domains using only a few annotated examples. This setting is inherently challenging: source and target domains exhibit substantial distribution…

计算机视觉与模式识别 · 计算机科学 2025-12-08 Pasquale De Marinis , Pieter M. Blok , Uzay Kaymak , Rogier Brussee , Gennaro Vessio , Giovanna Castellano

Distributed learning frameworks often rely on exchanging model parameters across workers, instead of revealing their raw data. A prime example is federated learning that exchanges the gradients or weights of each neural network model. Under…

机器学习 · 计算机科学 2020-11-05 Hyowoon Seo , Jihong Park , Seungeun Oh , Mehdi Bennis , Seong-Lyun Kim

Federated learning (FL), which utilizes communication between the server (core) and local devices (edges) to indirectly learn from more data, is an emerging field in deep learning research. Recently, Knowledge Distillation-based FL methods…

机器学习 · 计算机科学 2021-02-10 Sangho Lee , Kiyoon Yoo , Nojun Kwak

Federated Learning (FL) has emerged as a promising solution in Edge Computing (EC) environments to process the proliferation of data generated by edge devices. By collaboratively optimizing the global machine learning models on distributed…

机器学习 · 计算机科学 2024-02-14 Yongzhe Jia , Xuyun Zhang , Amin Beheshti , Wanchun Dou

Knowledge Distillation (KD) aims to transfer knowledge in a teacher-student framework, by providing the predictions of the teacher network to the student network in the training stage to help the student network generalize better. It can…

计算机视觉与模式识别 · 计算机科学 2019-09-25 SeongUk Park , Nojun Kwak