English
Related papers

Related papers: Federated Progressive Self-Distillation with Logit…

200 papers

Federated learning (FL) allows multiple clients to collectively train a high-performance global model without sharing their private data. However, the key challenge in federated learning is that the clients have significant statistical…

Machine Learning · Computer Science 2022-03-23 Liang Gao , Huazhu Fu , Li Li , Yingwen Chen , Ming Xu , Cheng-Zhong Xu

Federated Prompt Learning (FPL) incorporates large pre-trained Vision-Language models (VLM) into federated learning through prompt tuning. The transferable representations and remarkable generalization capacity of VLM make them highly…

Machine Learning · Computer Science 2024-09-04 Tianyu Cui , Hongxia Li , Jingya Wang , Ye Shi

Traditional Federated Learning (FL) methods typically train a single global model collaboratively without exchanging raw data. In contrast, Personalized Federated Learning (PFL) techniques aim to create multiple models that are better…

Machine Learning · Computer Science 2024-04-23 Emilio Cantu-Cervini

Electric load forecasting is essential for power management and stability in smart grids. This is mainly achieved via advanced metering infrastructure, where smart meters (SMs) are used to record household energy consumption. Traditional…

Machine Learning · Computer Science 2024-11-19 Ratun Rahman , Neeraj Kumar , Dinh C. Nguyen

Federated Learning (FL) facilitates collaborative model training across decentralized clients while preserving data privacy by avoiding raw data exchange. Despite its potential, FL performance is often compromised by data heterogeneity…

Machine Learning · Computer Science 2026-05-12 Qijun Hou , Yuchen Shi , Pingyi Fan , Khaled B. Letaief

Federated learning is inherently hampered by data heterogeneity: non-i.i.d. training data over local clients. We propose a novel model training approach for federated learning, FLex&Chill, which exploits the Logit Chilling method. Through…

Machine Learning · Computer Science 2025-12-24 Kichang Lee , Pei Zhang , Songkuk Kim , JeongGil Ko

Personalized federated learning (PFL) aims to produce the greatest personalized model for each client to face an insurmountable problem--data heterogeneity in real FL systems. However, almost all existing works have to face large…

Machine Learning · Computer Science 2023-05-25 Yifan Shi , Yingqi Liu , Yan Sun , Zihao Lin , Li Shen , Xueqian Wang , Dacheng Tao

The vast increase of Internet of Things (IoT) technologies and the ever-evolving attack vectors have increased cyber-security risks dramatically. A common approach to implementing AI-based Intrusion Detection systems (IDSs) in distributed…

Cryptography and Security · Computer Science 2023-08-07 Othmane Belarbi , Theodoros Spyridopoulos , Eirini Anthi , Ioannis Mavromatis , Pietro Carnelli , Aftab Khan

Federated learning (FL) enables collaborative model training across distributed clients while preserving data privacy. Despite its widespread adoption, most FL approaches focusing solely on privacy protection fall short in scenarios where…

Machine Learning · Computer Science 2024-10-17 Jinqian Chen , Jihua Zhu

Federated Learning (FL) facilitates decentralized model training while preserving data privacy. However, achieving both robust generalization and effective personalization simultaneously in heterogeneous (non-IID) environments remains a…

Machine Learning · Computer Science 2026-03-17 Eun Gyung Kong , Je Won Yeom , Yonghoon Jeon , Taesup Kim

Recent advancements in federated learning (FL) have greatly facilitated the development of decentralized collaborative applications, particularly in the domain of Artificial Intelligence of Things (AIoT). However, a critical aspect missing…

Artificial Intelligence · Computer Science 2024-01-25 Ziyan An , Taylor T. Johnson , Meiyi Ma

The ongoing deployment of the Internet of Things (IoT)-based smart applications is spurring the adoption of machine learning as a key technology enabler. To overcome the privacy and overhead challenges of centralized machine learning, there…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-21 Latif U. Khan , Walid Saad , Zhu Han , Choong Seon Hong

In the context of personalized federated learning (FL), the critical challenge is to balance local model improvement and global model tuning when the personal and global objectives may not be exactly aligned. Inspired by Bayesian…

Machine Learning · Computer Science 2022-04-19 Huili Chen , Jie Ding , Eric Tramel , Shuang Wu , Anit Kumar Sahu , Salman Avestimehr , Tao Zhang

Federated learning (FL) enables distributed clients to collaboratively train a global model using local private data. Nevertheless, recent studies show that conventional FL algorithms still exhibit deficiencies in privacy protection, and…

Cryptography and Security · Computer Science 2026-03-31 Ruiyang Wang , Rong Pan , Zhengan Yao

With the development of wireless network, Multi-Access Edge Computing (MEC) and Artificial Intelligence (AI)-native Radio Access Network (RAN) have attracted significant attention. Particularly, the integration of AI-RAN and MEC is…

Machine Learning · Computer Science 2026-03-11 Luyao Zou , Hayoung Oh , Chu Myaet Thwal , Apurba Adhikary , Seohyeon Hong , Zhu Han

Recent research on knowledge distillation has increasingly focused on logit distillation because of its simplicity, effectiveness, and versatility in model compression. In this paper, we introduce Refined Logit Distillation (RLD) to address…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Wujie Sun , Defang Chen , Siwei Lyu , Genlang Chen , Chun Chen , Can Wang

Cross-platform recommendation aims to improve recommendation accuracy by gathering heterogeneous features from different platforms. However, such cross-silo collaborations between platforms are restricted by increasingly stringent privacy…

Information Retrieval · Computer Science 2024-01-31 Sheng Wan , Dashan Gao , Hanlin Gu , Daning Hu

Federated learning (FL) provides a privacy-preserving solution for fine-tuning pre-trained large language models (LLMs) using distributed private datasets, enabling task-specific adaptation while preserving data privacy. However,…

Machine Learning · Computer Science 2025-01-09 Na Yan , Yang Su , Yansha Deng , Robert Schober

This paper focuses on Federated Domain-Incremental Learning (FDIL) where each client continues to learn incremental tasks where their domain shifts from each other. We propose a novel adaptive knowledge matching-based personalized FDIL…

Machine Learning · Computer Science 2024-07-19 Yichen Li , Wenchao Xu , Haozhao Wang , Ruixuan Li , Yining Qi , Jingcai Guo

Federated learning (FL) is an emerging distributed machine learning paradigm that avoids data sharing among training nodes so as to protect data privacy. Under coordination of the FL server, each client conducts model training using its own…

Machine Learning · Computer Science 2021-01-01 Binbin Guo , Yuan Mei , Danyang Xiao , Weigang Wu , Ye Yin , Hongli Chang