English
Related papers

Related papers: Single-shot Hyper-parameter Optimization for Feder…

200 papers

Federated learning (FL) is a distributed machine learning technique that enables collaborative model training while avoiding explicit data sharing. The inherent privacy-preserving property of FL algorithms makes them especially attractive…

Federated Learning (FL) is a privacy-protected machine learning paradigm that allows model to be trained directly at the edge without uploading data. One of the biggest challenges faced by FL in practical applications is the heterogeneity…

Machine Learning · Computer Science 2021-08-20 Zirui Zhu , Ziyi Ye

Federated Learning (FL) is a distributed machine learning (ML) paradigm, in which multiple clients collaboratively train ML models without centralizing their local data. Similar to conventional ML pipelines, the client local optimization…

Machine Learning · Computer Science 2024-07-24 Haokun Chen , Denis Krompass , Jindong Gu , Volker Tresp

Federated learning (FL) is an emerging machine learning paradigm involving multiple clients, e.g., mobile phone devices, with an incentive to collaborate in solving a machine learning problem coordinated by a central server. FL was proposed…

Machine Learning · Computer Science 2022-07-04 Samuel Horváth

Federated learning (FL) can achieve privacy-safe and reliable collaborative training without collecting users' private data. Its excellent privacy security potential promotes a wide range of FL applications in Internet-of-Things (IoT),…

Machine Learning · Computer Science 2023-09-26 Xiaofeng Liu , Qing Wang , Yunfeng Shao , Yinchuan Li

One-shot FL enables collaborative training in a single round, eliminating the need for iterative communication, making it particularly suitable for use in resource-constrained and privacy-sensitive applications. This survey offers a…

Machine Learning · Computer Science 2025-05-06 Flora Amato , Lingyu Qiu , Mohammad Tanveer , Salvatore Cuomo , Fabio Giampaolo , Francesco Piccialli

Efficiently aggregating trained neural networks from local clients into a global model on a server is a widely researched topic in federated learning. Recently, motivated by diminishing privacy concerns, mitigating potential attacks, and…

Machine Learning · Computer Science 2024-10-22 Xiang Liu , Liangxi Liu , Feiyang Ye , Yunheng Shen , Xia Li , Linshan Jiang , Jialin Li

Deep learning-based fault diagnosis (FD) approaches require a large amount of training data, which are difficult to obtain since they are located across different entities. Federated learning (FL) enables multiple clients to collaboratively…

Machine Learning · Computer Science 2023-10-16 Jixuan Cui , Jun Li , Zhen Mei , Kang Wei , Sha Wei , Ming Ding , Wen Chen , Song Guo

Large language models (LLMs) have emerged as important components across various fields, yet their training requires substantial computation resources and abundant labeled data. It poses a challenge to robustly training LLMs for individual…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-13 Jiaxing QI , Zhongzhi Luan , Shaohan Huang , Carol Fung , Hailong Yang , Depei Qian

Low-rank adaptation (LoRA) is one of the most popular task-specific parameter-efficient fine-tuning (PEFT) methods on pre-trained language models for its good performance and computational efficiency. LoRA injects a product of two trainable…

Machine Learning · Computer Science 2024-03-20 Youbang Sun , Zitao Li , Yaliang Li , Bolin Ding

Federated Learning (FL) enables multiple clients to collaboratively learn a machine learning model without exchanging their own local data. In this way, the server can exploit the computational power of all clients and train the model on a…

Machine Learning · Computer Science 2023-07-04 Song Wang , Xingbo Fu , Kaize Ding , Chen Chen , Huiyuan Chen , Jundong Li

Federated Learning (FL) is a decentralized machine learning protocol that allows a set of participating agents to collaboratively train a model without sharing their data. This makes FL particularly suitable for settings where data privacy…

Machine Learning · Computer Science 2020-10-30 Mustafa Safa Ozdayi , Murat Kantarcioglu , Rishabh Iyer

Federated learning (FL) is a well established method for performing machine learning tasks over massively distributed data. However in settings where data is distributed in a non-iid (not independent and identically distributed) fashion --…

Machine Learning · Computer Science 2020-05-07 Christopher Briggs , Zhong Fan , Peter Andras

Most of the research on Federated Learning (FL) has focused on analyzing global optimization, privacy, and communication, with limited attention focusing on analyzing the critical matter of performing efficient local training and inference…

Machine Learning · Computer Science 2020-09-09 Basheer Qolomany , Kashif Ahmad , Ala Al-Fuqaha , Junaid Qadir

In the rapidly evolving field of artificial intelligence, multimodal models, e.g., integrating vision and language into visual-language models (VLMs), have become pivotal for many applications, ranging from image captioning to multimodal…

Machine Learning · Computer Science 2024-04-24 Duy Phuong Nguyen , J. Pablo Munoz , Ali Jannesari

We propose a federated learning (FL) in stratosphere (FLSTRA) system, where a high altitude platform station (HAPS) facilitates a large number of terrestrial clients to collaboratively learn a global model without sharing the training data.…

Networking and Internet Architecture · Computer Science 2023-06-12 Amin Farajzadeh , Animesh Yadav , Omid Abbasi , Wael Jaafar , Halim Yanikomeroglu

Federated Learning has recently been utilized to collaboratively fine-tune foundation models across multiple clients. Notably, federated low-rank adaptation LoRA-based fine-tuning methods have recently gained attention, which allows clients…

Machine Learning · Computer Science 2025-06-17 Zikai Zhang , Ping Liu , Jiahao Xu , Rui Hu

Federated Learning (FL) enables collaborative model training across diverse entities while safeguarding data privacy. However, FL faces challenges such as data heterogeneity and model diversity. The Meta-Federated Learning (Meta-FL)…

Machine Learning · Computer Science 2024-06-25 Zahir Alsulaimawi

Federated learning (FL) offers a promising distributed learning paradigm for internet of vehicles (IoV) applications. However, it faces challenges from communication overhead and dynamic environments. Model compression techniques reduce…

Machine Learning · Computer Science 2026-04-28 Huaicheng Li , Junhui Zhao , Haoyu Quan , Xiaoming Wang

Large Language Models (LLMs) have demonstrated remarkable capabilities across various domains, particularly in task generalization for both text and vision data. While fine-tuning these models can significantly enhance their performance on…

Machine Learning · Computer Science 2025-01-15 Navyansh Mahla , Kshitij Sharad Jadhav , Ganesh Ramakrishnan