中文
相关论文

相关论文: Federated Knowledge Distillation for Multi-Model A…

200 篇论文

Federated Learning (FL) enables collaborative model training across multiple devices while preserving data privacy. However, it remains susceptible to backdoor attacks, where malicious participants can compromise the global model. Existing…

密码学与安全 · 计算机科学 2025-02-26 Ebtisaam Alharbi , Leandro Soriano Marcolino , Qiang Ni , Antonios Gouglidis

Most current federated learning frameworks are modeled as static processes, ignoring the dynamic characteristics of the learning system. Under the limited communication budget of the central server, the flexible model architecture of a…

机器学习 · 计算机科学 2025-03-11 Yiting Zheng , Bohan Lin , Jinqian Chen , Jihua Zhu

Is it possible to design an universal API for federated learning using which an ad-hoc group of data-holders (agents) collaborate with each other and perform federated learning? Such an API would necessarily need to be model-agnostic i.e.…

机器学习 · 计算机科学 2022-05-12 Andrei Afonin , Sai Praneeth Karimireddy

The robustness of federated learning (FL) is vital for the distributed training of an accurate global model that is shared among large number of clients. The collaborative learning framework by typically aggregating model updates is…

The increasing demand for intelligent services and privacy protection of mobile and Internet of Things (IoT) devices motivates the wide application of Federated Edge Learning (FEL), in which devices collaboratively train on-device Machine…

机器学习 · 计算机科学 2024-03-06 Zhiyuan Wu , Sheng Sun , Yuwei Wang , Min Liu , Xuefeng Jiang , Runhan Li , Bo Gao

While federated learning is promising for privacy-preserving collaborative learning without revealing local data, it remains vulnerable to white-box attacks and struggles to adapt to heterogeneous clients. Federated distillation (FD), built…

机器学习 · 计算机科学 2023-12-18 Jiawei Shao , Fangzhao Wu , Jun Zhang

Federated Learning (FL) enables collaborative model training without centralizing data. However, real-world deployments must simultaneously address statistical heterogeneity across client data (non-IID), system heterogeneity in device…

机器学习 · 计算机科学 2026-05-21 Chaimaa Medjadji , Sylvain Kubler , Yves Le Traon , Guilain Leduc , Sadi Alawadi , Feras M. Awaysheh

Federated Learning (FL) seeks to train a model collaboratively without sharing private training data from individual clients. Despite its promise, FL encounters challenges such as high communication costs for large-scale models and the…

机器学习 · 计算机科学 2024-04-15 Lin Li , Jianping Gou , Baosheng Yu , Lan Du , Zhang Yiand Dacheng Tao

Federated Learning (FL) is an emerging distributed learning paradigm under privacy constraint. Data heterogeneity is one of the main challenges in FL, which results in slow convergence and degraded performance. Most existing approaches only…

机器学习 · 计算机科学 2023-10-27 Lin Zhang , Li Shen , Liang Ding , Dacheng Tao , Ling-Yu Duan

Electrocardiogram (ECG) monitoring in Internet of Medical Things (IoMT) networks is constrained by strict data-sharing regulations and privacy concerns. Federated learning (FL) enables collaborative learning by keeping raw ECG data on…

人工智能 · 计算机科学 2026-05-15 Zixuan Shu , Tiancheng Cao , Hen-Wei Huang

Knowledge Distillation (KD) aims to transfer knowledge in a teacher-student framework, by providing the predictions of the teacher network to the student network in the training stage to help the student network generalize better. It can…

计算机视觉与模式识别 · 计算机科学 2019-09-25 SeongUk Park , Nojun Kwak

Heterogeneous distillation is an effective way to transfer knowledge from cross-architecture teacher models to student models. However, existing heterogeneous distillation methods do not take full advantage of the dark knowledge hidden in…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Yaoxin Yang , Peng Ye , Weihao Lin , Kangcong Li , Yan Wen , Jia Hao , Tao Chen

Federated learning enables the creation of a powerful centralized model without compromising data privacy of multiple participants. While successful, it does not incorporate the case where each participant independently designs its own…

机器学习 · 计算机科学 2019-10-10 Daliang Li , Junpu Wang

Facial Landmark Detection (FLD) in thermal imagery is critical for applications in challenging lighting conditions, but it is hampered by the lack of rich visual cues. Conventional cross-modal solutions, like feature fusion or image…

机器学习 · 计算机科学 2025-10-27 Qiyi Tong , Olivia Nocentini , Marta Lagomarsino , Kuanqi Cai , Marta Lorenzini , Arash Ajoudani

Knowledge distillation (KD) can enable collaborative learning among distributed clients that have different model architectures and do not share their local data and model parameters with others. Each client updates its local model using…

机器学习 · 计算机科学 2024-06-04 Pengchao Han , Xingyan Shi , Jianwei Huang

Distributed learning frameworks often rely on exchanging model parameters across workers, instead of revealing their raw data. A prime example is federated learning that exchanges the gradients or weights of each neural network model. Under…

机器学习 · 计算机科学 2020-11-05 Hyowoon Seo , Jihong Park , Seungeun Oh , Mehdi Bennis , Seong-Lyun Kim

While Federated Learning (FL) is gaining popularity for training machine learning models in a decentralized fashion, numerous challenges persist, such as asynchronization, computational expenses, data heterogeneity, and gradient and…

机器学习 · 计算机科学 2025-03-13 Chun-Yin Huang , Ruinan Jin , Can Zhao , Daguang Xu , Xiaoxiao Li

Recently, innovative model aggregation methods based on knowledge distillation (KD) have been proposed for federated learning (FL). These methods not only improved the robustness of model aggregation over heterogeneous learning environment,…

机器学习 · 计算机科学 2023-12-29 Ho Man Kwan , Shenghui Song

Federated Averaging, and many federated learning algorithm variants which build upon it, have a limitation: all clients must share the same model architecture. This results in unused modeling capacity on many clients, which limits model…

机器学习 · 计算机科学 2023-10-05 Jared Lichtarge , Ehsan Amid , Shankar Kumar , Tien-Ju Yang , Rohan Anil , Rajiv Mathews

Federated learning (FL) offers a promising framework for collaborative digital pathology by enabling model training across institutions. However, real-world deployments face heterogeneity arising from diverse multiple instance learning…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Luru Jing , Cong Cong , Yanyuan Chen , Yongzhi Cao