English
Related papers

Related papers: Leveraging Foundation Models for Efficient Federat…

200 papers

Foundation models (FMs) have shown prominent success in a wide range of tasks. Their applicability to specific domain-task pairings relies on the availability of, both, high-quality data and significant computational resources. These…

Machine Learning · Computer Science 2023-11-10 Lekang Jiang , Filip Svoboda , Nicholas D. Lane

The number of Internet of Things (IoT) applications, especially latency-sensitive ones, have been significantly increased. So, Cloud computing, as one of the main enablers of the IoT that offers centralized services, cannot solely satisfy…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-08 Wuji Zhu , Mohammad Goudarzi , Rajkumar Buyya

The vision of pervasive artificial intelligence (AI) services can be realized by training an AI model on time using real-time data collected by internet of things (IoT) devices. To this end, IoT devices require offloading their data to an…

Machine Learning · Computer Science 2024-02-20 Sujin Kook , Won-Yong Shin , Seong-Lyun Kim , Seung-Woo Ko

Recently, foundation models have exhibited remarkable advancements in multi-modal learning. These models, equipped with millions (or billions) of parameters, typically require a substantial amount of data for finetuning. However, collecting…

Machine Learning · Computer Science 2023-08-25 Haokun Chen , Yao Zhang , Denis Krompass , Jindong Gu , Volker Tresp

Federated learning has become an emerging technology for data analysis for IoT applications. This paper implements centralized and decentralized federated learning frameworks for crop yield prediction based on Long Short-Term Memory…

Machine Learning · Computer Science 2025-12-16 Anwesha Mukherjee , Rajkumar Buyya

Federated learning (FL) is a popular technique for distributing machine learning (ML) across a set of edge devices. In this paper, we study fully decentralized FL, where in addition to devices conducting training locally, they carry out…

Machine Learning · Computer Science 2025-11-20 Shahryar Zehtabi , Seyyedali Hosseinalipour , Christopher G. Brinton

As a popular paradigm of distributed learning, personalized federated learning (PFL) allows personalized models to improve generalization ability and robustness by utilizing knowledge from all distributed clients. Most existing PFL…

Machine Learning · Computer Science 2023-03-16 Guanghao Li , Wansen Wu , Yan Sun , Li Shen , Baoyuan Wu , Dacheng Tao

Prompt learning has become an efficient paradigm for adapting CLIP to downstream tasks. Compared with traditional fine-tuning, prompt learning optimizes a few parameters yet yields highly competitive results, especially appealing in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Jianhan Wu , Xiaoyang Qu , Zhangcheng Huang , Jianzong Wang

Large machine learning models trained on diverse data have recently seen unprecedented success. Federated learning enables training on private data that may otherwise be inaccessible, such as domain-specific datasets decentralized across…

The increasing demand for intelligent services and privacy protection of mobile and Internet of Things (IoT) devices motivates the wide application of Federated Edge Learning (FEL), in which devices collaboratively train on-device Machine…

Machine Learning · Computer Science 2024-03-06 Zhiyuan Wu , Sheng Sun , Yuwei Wang , Min Liu , Xuefeng Jiang , Runhan Li , Bo Gao

With the development of wireless network, Multi-Access Edge Computing (MEC) and Artificial Intelligence (AI)-native Radio Access Network (RAN) have attracted significant attention. Particularly, the integration of AI-RAN and MEC is…

Machine Learning · Computer Science 2026-03-11 Luyao Zou , Hayoung Oh , Chu Myaet Thwal , Apurba Adhikary , Seohyeon Hong , Zhu Han

The vision of pervasive machine learning (ML) services can be realized by training an ML model on time using real-time data collected by internet of things (IoT) devices. To this end, IoT devices require offloading their data to an edge…

Networking and Internet Architecture · Computer Science 2022-11-15 Sujin Kook , Won-Yong Shin , Seong-Lyun Kim , Seung-Woo Ko

Federated learning (FL) enables multiple clients to collaboratively train a global model without disclosing their data. Previous researches often require training the complete model parameters. However, the emergence of powerful pre-trained…

Machine Learning · Computer Science 2024-03-13 Shangchao Su , Mingzhao Yang , Bin Li , Xiangyang Xue

Adapting Foundation Models (FMs) for downstream tasks through Federated Learning (FL) emerges a promising strategy for protecting data privacy and valuable FMs. Existing methods fine-tune FM by allocating sub-FM to clients in FL, however,…

Machine Learning · Computer Science 2024-04-30 Zhaopeng Peng , Xiaoliang Fan , Yufan Chen , Zheng Wang , Shirui Pan , Chenglu Wen , Ruisheng Zhang , Cheng Wang

As a paradigm of distributed machine learning, federated learning typically requires all edge devices to train a complete model locally. However, with the increasing scale of artificial intelligence models, the limited resources on edge…

Machine Learning · Computer Science 2024-12-11 Junhe Zhang , Wanli Ni , Dongyu Wang

Emerging technologies and applications including Internet of Things (IoT), social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-19 Shiqiang Wang , Tiffany Tuor , Theodoros Salonidis , Kin K. Leung , Christian Makaya , Ting He , Kevin Chan

Applying Federated Learning (FL) on Internet-of-Things devices is necessitated by the large volumes of data they produce and growing concerns of data privacy. However, there are three challenges that need to be addressed to make FL…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-19 Di Wu , Rehmat Ullah , Paul Harvey , Peter Kilpatrick , Ivor Spence , Blesson Varghese

In real-world applications, Federated Learning (FL) meets two challenges: (1) scalability, especially when applied to massive IoT networks; and (2) how to be robust against an environment with heterogeneous data. Realizing the first…

Machine Learning · Computer Science 2022-10-03 Minh-Duong Nguyen , Quoc-Viet Pham , Dinh Thai Hoang , Long Tran-Thanh , Diep N. Nguyen , Won-Joo Hwang

Federated learning (FL) has emerged as a powerful paradigm for learning from decentralized data, and federated domain generalization further considers the test dataset (target domain) is absent from the decentralized training data (source…

Machine Learning · Computer Science 2024-03-14 Sikai Bai , Jie Zhang , Shuaicheng Li , Song Guo , Jingcai Guo , Jun Hou , Tao Han , Xiaocheng Lu

Prompt learning in pretrained visual-language models has shown remarkable flexibility across various downstream tasks. Leveraging its inherent lightweight nature, recent research attempted to integrate the powerful pretrained models into…

Machine Learning · Computer Science 2024-04-04 Hongxia Li , Wei Huang , Jingya Wang , Ye Shi