English
Related papers

Related papers: When Foresight Pruning Meets Zeroth-Order Optimiza…

200 papers

Federated Learning (FL) is an emerging paradigm that allows a model to be trained across a number of participants without sharing data. Recent works have begun to consider the effects of using pre-trained models as an initialization point…

Machine Learning · Computer Science 2023-11-07 Gwen Legate , Nicolas Bernier , Lucas Caccia , Edouard Oyallon , Eugene Belilovsky

Federated continual learning (FCL) aims to learn from sequential data stream in the decentralized federated learning setting, while simultaneously mitigating the catastrophic forgetting issue in classical continual learning. Existing FCL…

Machine Learning · Computer Science 2024-12-25 Yuchen He , Chuyun Shen , Xiangfeng Wang , Bo Jin

Spiking Neural Networks (SNNs) offer a promising alternative to conventional Artificial Neural Networks (ANNs) for the implementation of on-device low-power online learning and inference. On-device training is, however, constrained by the…

Machine Learning · Computer Science 2019-10-24 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

Federated Learning (FL) enables distributed training on edge devices but faces significant challenges due to resource constraints in edge environments, impacting both communication and computational efficiency. Existing iterative pruning…

Machine Learning · Computer Science 2025-04-02 Haonan Wang , Zeli Liu , Kajimusugura Hoshino , Tuo Zhang , John Paul Walters , Stephen Crago

Federated Learning (FL) is a distributed machine learning approach that enables devices to collaboratively train models without sharing their local data, ensuring user privacy and scalability. However, applying FL to real-world data…

Machine Learning · Computer Science 2024-08-14 Jieming Bian , Lei Wang , Jie Xu

Federated learning (FL) has become a transformative paradigm for distributed machine learning across wireless networks. However, the performance of FL is often hindered by the unreliable communication links between resource-constrained…

Signal Processing · Electrical Eng. & Systems 2025-03-28 Xuhui Zhang , Wenchao Liu , Jinke Ren , Huijun Xing , Gui Gui , Yanyan Shen , Shuguang Cui

The conventional model aggregation-based federated learning (FL) approach requires all local models to have the same architecture, which fails to support practical scenarios with heterogeneous local models. Moreover, frequent model exchange…

Signal Processing · Electrical Eng. & Systems 2023-03-23 Zhixiong Chen , Wenqiang Yi , Yuanwei Liu , Arumugam Nallanathan

Federated Learning (FL) can be vulnerable to attacks, such as model poisoning, where adversaries send malicious local weights to compromise the global model. Federated Unlearning (FU) is emerging as a solution to address such…

Machine Learning · Computer Science 2025-08-20 Nicolò Romandini , Cristian Borcea , Rebecca Montanari , Luca Foschini

When personalized federated learning (FL) meets large foundation models, new challenges arise from various limitations in resources. In addition to typical limitations such as data, computation, and communication costs, access to the models…

Artificial Intelligence · Computer Science 2023-10-10 Wang Lu , Hao Yu , Jindong Wang , Damien Teney , Haohan Wang , Yiqiang Chen , Qiang Yang , Xing Xie , Xiangyang Ji

Recently, a considerable amount of works have been made to tackle the communication burden in federated learning (FL) (e.g., model quantization, data sparsification, and model compression). However, the existing methods, that boost the…

Information Theory · Computer Science 2022-06-15 Xuan-Tung Nguyen , Minh-Duong Nguyen , Quoc-Viet Pham , Vinh-Quang Do , Won-Joo Hwang

Federated unlearning has become an attractive approach to address privacy concerns in collaborative machine learning, for situations when sensitive data is remembered by AI models during the machine learning process. It enables the removal…

Cryptography and Security · Computer Science 2026-03-10 Yu Jiang , Xindi Tong , Ziyao Liu , Xiaoxi Zhang , Kwok-Yan Lam , Chee Wei Tan

Federated Learning (FL) enables multiple devices to collaboratively train a shared model while preserving data privacy. Ever-increasing model complexity coupled with limited memory resources on the participating devices severely bottlenecks…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-16 Chunlin Tian , Li Li , Kahou Tam , Yebo Wu , Chengzhong Xu

Finetuning large language models (LLMs) in federated learning (FL) settings has become increasingly important as it allows resource-constrained devices to finetune a model using private data. However, finetuning LLMs using backpropagation…

Machine Learning · Computer Science 2024-10-23 Kunjal Panchal , Nisarg Parikh , Sunav Choudhary , Lijun Zhang , Yuriy Brun , Hui Guan

Federated learning (FL) is a distributed learning paradigm that enables a large number of mobile devices to collaboratively learn a model under the coordination of a central server without sharing their raw data. Despite its practical…

Machine Learning · Computer Science 2021-09-14 Bing Luo , Xiang Li , Shiqiang Wang , Jianwei Huang , Leandros Tassiulas

Machine learning models have been deployed in mobile networks to deal with massive data from different layers to enable automated network management and intelligence on devices. To overcome high communication cost and severe privacy…

Machine Learning · Computer Science 2023-02-28 Chen Gong , Zhenzhe Zheng , Yunfeng Shao , Bingshuai Li , Fan Wu , Guihai Chen

Federated learning (FL) is a general principle for decentralized clients to train a server model collectively without sharing local data. FL is a promising framework with practical applications, but its standard training paradigm requires…

Machine Learning · Computer Science 2024-07-23 Haozhe Feng , Tianyu Pang , Chao Du , Wei Chen , Shuicheng Yan , Min Lin

Distributed learning frameworks often rely on exchanging model parameters across workers, instead of revealing their raw data. A prime example is federated learning that exchanges the gradients or weights of each neural network model. Under…

Machine Learning · Computer Science 2020-11-05 Hyowoon Seo , Jihong Park , Seungeun Oh , Mehdi Bennis , Seong-Lyun Kim

Federated learning is a distributed machine learning approach in which clients train models locally with their own data and upload them to a server so that their trained results are shared between them without uploading raw data to the…

Machine Learning · Computer Science 2023-09-07 Yuto Hoshino , Hiroki Kawakami , Hiroki Matsutani

Federated Learning using the Federated Averaging algorithm has shown great advantages for large-scale applications that rely on collaborative learning, especially when the training data is either unbalanced or inaccessible due to privacy…

Machine Learning · Computer Science 2021-07-21 Jonatan Reyes , Lisa Di Jorio , Cecile Low-Kam , Marta Kersten-Oertel

Bayesian optimization (BO) is a prominent approach to optimizing expensive-to-evaluate black-box functions. The massive computational capability of edge devices such as mobile phones, coupled with privacy concerns, has led to a surging…

Machine Learning · Computer Science 2020-10-23 Zhongxiang Dai , Kian Hsiang Low , Patrick Jaillet