中文
相关论文

相关论文: TSFLora: Token-Compressed Split Fine-Tuning for Wi…

200 篇论文

Federated fine-tuning enables privacy-preserving Large Language Model (LLM) adaptation, but its high memory cost limits participation from resource-constrained devices. We propose FedPruner, an innovative federated fine-tuning paradigm that…

分布式、并行与集群计算 · 计算机科学 2025-08-26 Yebo Wu , Jingguang Li , Chunlin Tian , Zhijiang Guo , Li Li

Internet of Things (IoT) services will use machine learning tools to efficiently analyze various types of data collected by IoT devices for inference, autonomy, and control purposes. However, due to resource constraints and privacy…

信息论 · 计算机科学 2020-09-01 Mingzhe Chen , H. Vincent Poor , Walid Saad , Shuguang Cui

Large language models (LLMs) have emerged as important components across various fields, yet their training requires substantial computation resources and abundant labeled data. It poses a challenge to robustly training LLMs for individual…

分布式、并行与集群计算 · 计算机科学 2024-06-13 Jiaxing QI , Zhongzhi Luan , Shaohan Huang , Carol Fung , Hailong Yang , Depei Qian

Federated learning (FL) is a new artificial intelligence concept that enables Internet-of-Things (IoT) devices to learn a collaborative model without sending the raw data to centralized nodes for processing. Despite numerous advantages, low…

机器学习 · 计算机科学 2022-06-22 Minh-Duong Nguyen , Sang-Min Lee , Quoc-Viet Pham , Dinh Thai Hoang , Diep N. Nguyen , Won-Joo Hwang

Private data holds promise for improving LLMs due to its high quality, but its scattered distribution across data silos and the high computational demands of LLMs limit their deployment in federated environments. To address this, the…

计算与语言 · 计算机科学 2026-01-05 Zishuai Zhang , Hainan zhang , Weihua Li , Qinnan zhang , jin Dong , Yongxin Tong , Zhiming Zheng

Advancements in artificial intelligence (AI) and low-earth orbit (LEO) satellites have promoted the application of large remote sensing foundation models for various downstream tasks. However, direct downloading of these models for…

机器学习 · 计算机科学 2025-08-01 Yan Zhu , Jingyang Zhu , Ting Wang , Yuanming Shi , Chunxiao Jiang , Khaled Ben Letaief

Low-rank adaptation (LoRA) is a natural method for finetuning in communication-constrained machine learning settings such as cross-device federated learning. Prior work that has studied LoRA in the context of federated learning has focused…

机器学习 · 计算机科学 2024-06-11 Kevin Kuo , Arian Raje , Kousik Rajesh , Virginia Smith

Federated learning (FL) and split learning (SL) are two effective distributed learning paradigms in wireless networks, enabling collaborative model training across mobile devices without sharing raw data. While FL supports low-latency…

机器学习 · 计算机科学 2025-11-26 Kun Guo , Xuefei Li , Xijun Wang , Howard H. Yang , Wei Feng , Tony Q. S. Quek

This paper introduces a novel federated learning framework termed LoRa-FL designed for training low-rank one-shot image detection models deployed on edge devices. By incorporating low-rank adaptation techniques into one-shot detection…

计算机视觉与模式识别 · 计算机科学 2025-04-24 Abdul Hannaan , Zubair Shah , Aiman Erbad , Amr Mohamed , Ali Safa

Federated fine-tuning has emerged as a promising approach to adapt foundation models to downstream tasks using decentralized data. However, real-world deployment remains challenging due to the high computational and communication demands of…

机器学习 · 计算机科学 2025-08-21 Yajie Zhou , Xiaoyi Pang , Zhibo Wang

Fine-tuning is essential to adapt general-purpose large language models (LLMs) to domain-specific tasks. As a privacy-preserving framework to leverage decentralized data for collaborative model training, Federated Learning (FL) is gaining…

机器学习 · 计算机科学 2026-02-04 Guohao Yang , Tongle Wu , Yuanxiong Guo , Ying Sun , Yanmin Gong

Federated Learning (FL) has emerged as a new paradigm for training machine learning models distributively without sacrificing data security and privacy. Learning models on edge devices such as mobile phones is one of the most common use…

机器学习 · 计算机科学 2023-02-10 Sixing Yu , Phuong Nguyen , Ali Anwar , Ali Jannesari

This paper addresses the critical challenges of communication overhead, data heterogeneity, and privacy in deep learning for channel state information (CSI) feedback in massive MIMO systems. To this end, we propose Fed-PELAD, a novel…

信息论 · 计算机科学 2025-10-30 Yixiang Zhou , Tong Wu , Meixia Tao , Jianhua Mo

Federated learning can train models without directly providing local data to the server. However, the frequent updating of the local model brings the problem of large communication overhead. Recently, scholars have achieved the…

机器学习 · 计算机科学 2024-05-07 Ying Zhuansun , Dandan Li , Xiaohong Huang , Caijun Sun

As on-device large language model (LLM) systems become increasingly prevalent, federated fine-tuning enables advanced language understanding and generation directly on edge devices; however, it also involves processing sensitive,…

密码学与安全 · 计算机科学 2025-09-12 Honghui Xu , Shiva Shrestha , Wei Chen , Zhiyuan Li , Zhipeng Cai

Unmanned aerial vehicles (UAVs) with integrated sensing, communication, computation and control (ISC3) capabilities have become key enablers of next-generation wireless networks. Federated edge learning (FEL) leverages UAVs as mobile…

分布式、并行与集群计算 · 计算机科学 2026-02-02 Xiangwang Hou , Xianghe Wang , Jiacheng Wang , Zekai Zhang , Jun Du , Jingjing Wang , Yong Ren

In telecommunications, Autonomous Networks (ANs) automatically adjust configurations based on specific requirements (e.g., bandwidth) and available resources. These networks rely on continuous monitoring and intelligent mechanisms for…

Communication overhead is a known bottleneck in federated learning (FL). To address this, lossy compression is commonly used on the information communicated between the server and clients during training. In horizontal FL, where each client…

机器学习 · 计算机科学 2025-02-25 Pedro Valdeira , João Xavier , Cláudia Soares , Yuejie Chi

Mass data traffics, low-latency wireless services and advanced artificial intelligence (AI) technologies have driven the emergence of a new paradigm for wireless networks, namely edge-intelligent networks, which are more efficient and…

信息论 · 计算机科学 2022-05-17 Qiao Qi , Xiaoming Chen

Federated learning enables collaborative machine learning while preserving data privacy, but high communication and computation costs, exacerbated by statistical and device heterogeneity, limit its practicality in mobile edge computing.…

系统与控制 · 电气工程与系统科学 2025-10-30 Jinghong Tan , Zhichen Zhang , Kun Guo , Tsung-Hui Chang , Tony Q. S. Quek