English
Related papers

Related papers: Federated Distillation on Edge Devices: Efficient …

200 papers

Federated Learning (FL) is gaining popularity as a distributed learning framework that only shares model parameters or gradient updates and keeps private data locally. However, FL is at risk of privacy leakage caused by privacy inference…

Machine Learning · Computer Science 2024-09-17 Kangyang Luo , Shuai Wang , Xiang Li , Yunshi Lan , Ming Gao , Jinlong Shu

Vehicle edge caching is a promising technology that can significantly reduce the latency for vehicle users (VUs) to access content by pre-caching user-interested content at edge nodes. It is crucial to accurately predict the content that…

Machine Learning · Computer Science 2026-04-07 Xun Li , Qiong Wu , Pingyi Fan , Kezhi Wang , Wen Chen , Cui Zhang

Federated learning (FL) achieves collaborative learning without the need for data sharing, thus preventing privacy leakage. To extend FL into a fully decentralized algorithm, researchers have applied distributed optimization algorithms to…

Networking and Internet Architecture · Computer Science 2023-12-20 Akihito Taya , Yuuki Nishiyama , Kaoru Sezaki

Federated Averaging remains the most widely used aggregation strategy in federated learning due to its simplicity and scalability. However, its performance degrades significantly in non-IID data settings, where client distributions are…

Machine Learning · Computer Science 2025-03-07 Marco Arazzi , Mert Cihangiroglu , Antonino Nocera

This paper proposes a cooperative mechanism for mitigating the performance degradation due to non-independent-and-identically-distributed (non-IID) data in collaborative machine learning (ML), namely federated learning (FL), which trains an…

Machine Learning · Computer Science 2020-03-06 Naoya Yoshida , Takayuki Nishio , Masahiro Morikura , Koji Yamamoto , Ryo Yonetani

Federated Reinforcement Learning (FedRL) improves sample efficiency while preserving privacy; however, most existing studies assume homogeneous agents, limiting its applicability in real-world scenarios. This paper investigates FedRL in…

Machine Learning · Computer Science 2025-02-04 Wenzheng Jiang , Ji Wang , Xiongtao Zhang , Weidong Bao , Cheston Tan , Flint Xiaofeng Fan

Data-free knowledge distillation (DFKD) has emerged as a pivotal technique in the domain of model compression, substantially reducing the dependency on the original training data. Nonetheless, conventional DFKD methods that employ…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Muquan Li , Dongyang Zhang , Tao He , Xiurui Xie , Yuan-Fang Li , Ke Qin

With the proliferation of distributed data sources, Federated Learning (FL) has emerged as a key approach to enable collaborative intelligence through decentralized model training while preserving data privacy. However, conventional FL…

Machine Learning · Computer Science 2026-02-03 Noorain Mukhtiar , Adnan Mahmood , Quan Z. Sheng

Federated learning (FL) has emerged as a privacy-preserving paradigm that trains neural networks on edge devices without collecting data at a central server. However, FL encounters an inherent challenge in dealing with non-independent and…

Machine Learning · Computer Science 2023-08-10 Zijian Li , Yuchang Sun , Jiawei Shao , Yuyi Mao , Jessie Hui Wang , Jun Zhang

Edge General Intelligence (EGI) represents a paradigm shift in mobile edge computing, where intelligent agents operate autonomously in dynamic, resource-constrained environments. However, the deployment of advanced agentic AI models on…

One of the most challenging issues in federated learning is that the data is often not independent and identically distributed (nonIID). Clients are expected to contribute the same type of data and drawn from one global distribution.…

Machine Learning · Computer Science 2024-01-08 Hung Nguyen , Peiyuan Wu , Morris Chang

Distributed learning algorithms aim to leverage distributed and diverse data stored at users' devices to learn a global phenomena by performing training amongst participating devices and periodically aggregating their local models'…

Machine Learning · Computer Science 2021-02-04 Naram Mhaisen , Alaa Awad , Amr Mohamed , Aiman Erbad , Mohsen Guizani

Knowledge Distillation is crucial for optimizing face recognition models for deployment in computationally limited settings, such as edge devices. Traditional KD methods, such as Raw L2 Feature Distillation or Feature Consistency loss,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Durgesh Mishra , Rishabh Uikey

Efficient object detection methods have recently received great attention in remote sensing. Although deep convolutional networks often have excellent detection accuracy, their deployment on resource-limited edge devices is difficult.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Pourya Shamsolmoali , Jocelyn Chanussot , Huiyu Zhou , Yue Lu

Federated Learning (FL) is a promising distributed machine learning approach that enables collaborative training of a global model using multiple edge devices. The data distributed among the edge devices is highly heterogeneous. Thus, FL…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-16 Ji Liu , Beichen Ma , Qiaolin Yu , Ruoming Jin , Jingbo Zhou , Yang Zhou , Huaiyu Dai , Haixun Wang , Dejing Dou , Patrick Valduriez

Federated Averaging, and many federated learning algorithm variants which build upon it, have a limitation: all clients must share the same model architecture. This results in unused modeling capacity on many clients, which limits model…

Machine Learning · Computer Science 2023-10-05 Jared Lichtarge , Ehsan Amid , Shankar Kumar , Tien-Ju Yang , Rohan Anil , Rajiv Mathews

Clustered Federated Learning (CFL) addresses the challenges posed by non-IID data by training multiple group- or cluster-specific expert models. However, existing methods often overlook the shared information across clusters, which…

Machine Learning · Computer Science 2025-06-26 Zeqi Leng , Chunxu Zhang , Guodong Long , Riting Xia , Bo Yang

Federated learning seeks to foster collaboration among distributed clients while preserving the privacy of their local data. Traditionally, federated learning methods assume a fixed setting in which client data and learning objectives…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Can Peng , Qianhui Men , Pramit Saha , Qianye Yang , Cheng Ouyang , J. Alison Noble

Federated Edge Learning (FEEL) is a promising distributed learning technique that aims to train a shared global model while reducing communication costs and promoting users' privacy. However, the training process might significantly occupy…

Networking and Internet Architecture · Computer Science 2022-03-10 Boubakr Nour , Soumaya Cherkaoui

Federated Learning (FL) is a decentralized approach for collaborative model training on edge devices. This distributed method of model training offers advantages in privacy, security, regulatory compliance, and cost-efficiency. Our emphasis…

Machine Learning · Computer Science 2024-10-24 Charuka Herath , Xiaolan Liu , Sangarapillai Lambotharan , Yogachandran Rahulamathavan