English
Related papers

Related papers: Federated Continual Instruction Tuning

200 papers

Federated learning (FL) is a popular privacy-preserving paradigm that enables distributed clients to collaboratively train models with a central server while keeping raw data locally. In practice, distinct model architectures, varying data…

Machine Learning · Computer Science 2024-05-28 Yuting Ma , Lechao Cheng , Yaxiong Wang , Zhun Zhong , Xiaohua Xu , Meng Wang

As Web technology continues to develop, it has become increasingly common to use data stored on different clients. At the same time, federated learning has received widespread attention due to its ability to protect data privacy when let…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Xin Luo , Fang-Yi Liang , Jiale Liu , Yu-Wei Zhan , Zhen-Duo Chen , Xin-Shun Xu

Federated Learning (FL) holds great potential for diverse applications owing to its privacy-preserving nature. However, its convergence is often challenged by non-IID data distributions, limiting its effectiveness in real-world deployments.…

Machine Learning · Computer Science 2025-04-22 Kun Zhai , Yifeng Gao , Difan Zou , Guangnan Ye , Siheng Chen , Xingjun Ma , Yu-Gang Jiang

Federated learning (FL) provides a privacy-preserving solution for fine-tuning pre-trained large language models (LLMs) using distributed private datasets, enabling task-specific adaptation while preserving data privacy. However,…

Machine Learning · Computer Science 2025-01-09 Na Yan , Yang Su , Yansha Deng , Robert Schober

Federated Learning (FL) facilitates decentralized model training while preserving data privacy. However, achieving both robust generalization and effective personalization simultaneously in heterogeneous (non-IID) environments remains a…

Machine Learning · Computer Science 2026-03-17 Eun Gyung Kong , Je Won Yeom , Yonghoon Jeon , Taesup Kim

Large Language Models (LLMs) have demonstrated impressive success across various tasks. Integrating LLMs with Federated Learning (FL), a paradigm known as FedLLM, offers a promising avenue for collaborative model adaptation while preserving…

Machine Learning · Computer Science 2026-02-25 Yebo Wu , Chunlin Tian , Jingguang Li , He Sun , Kahou Tam , Zhanting Zhou , Haicheng Liao , Jing Xiong , Zhijiang Guo , Li Li , Chengzhong Xu

Continual Instruction Tuning (CIT) is adopted to continually instruct Large Models to follow human intent data by data. It is observed that existing gradient update would heavily destroy the performance on previous datasets during CIT…

Machine Learning · Computer Science 2025-12-15 Jingyang Qiao , Zhizhong Zhang , Xin Tan , Yanyun Qu , Shouhong Ding , Yuan Xie

With increasing privacy concerns on data, recent studies have made significant progress using federated learning (FL) on privacy-sensitive natural language processing (NLP) tasks. Much literature suggests fully fine-tuning pre-trained…

Machine Learning · Computer Science 2023-06-05 Zhuo Zhang , Yuanhang Yang , Yong Dai , Lizhen Qu , Zenglin Xu

As a promising paradigm to collaboratively train models with decentralized data, Federated Learning (FL) can be exploited to fine-tune Large Language Models (LLMs). While LLMs correspond to huge size, the scale of the training data…

Machine Learning · Computer Science 2024-10-21 Ji Liu , Jiaxiang Ren , Ruoming Jin , Zijie Zhang , Yang Zhou , Patrick Valduriez , Dejing Dou

Continual instruction tuning(CIT) during the post-training phase is crucial for adapting multimodal large language models (MLLMs) to evolving real-world demands. However, the progress is hampered by the lack of benchmarks with rigorous,…

Computation and Language · Computer Science 2026-02-16 Haiyun Guo , Zhiyan Hou , Yandu Sun , Jinghan He , Yu Chen , Yuzhe Zhou , Yuheng Jia , Jinqiao Wang , Tat-Seng Chua

Instruction tuning for large language models (LLMs) can drive them to produce results consistent with human goals in specific downstream tasks. However, the process of continual instruction tuning (CIT) for LLMs may bring about the…

Computation and Language · Computer Science 2025-05-28 Yongquan He , Wenyuan Zhang , Xuancheng Huang , Peng Zhang , Lingxun Meng , Xiang Zhou , Ke Zeng , Xunliang Cai

To investigate the heterogeneity in federated learning in real-world scenarios, we generalize the classic federated learning to federated hetero-task learning, which emphasizes the inconsistency across the participants in federated learning…

Machine Learning · Computer Science 2022-06-22 Liuyi Yao , Dawei Gao , Zhen Wang , Yuexiang Xie , Weirui Kuang , Daoyuan Chen , Haohui Wang , Chenhe Dong , Bolin Ding , Yaliang Li

Multimodal Continual Instruction Tuning (MCIT) aims to finetune Multimodal Large Language Models (MLLMs) to continually align with human intent across sequential tasks. Existing approaches often rely on the Mixture-of-Experts (MoE) LoRA…

Computation and Language · Computer Science 2025-06-04 Duzhen Zhang , Yong Ren , Zhong-Zhi Li , Yahan Yu , Jiahua Dong , Chenxing Li , Zhilong Ji , Jinfeng Bai

Federated fine-tuning enables Large Language Models (LLMs) to adapt to downstream tasks while preserving data privacy, but its resource-intensive nature limits deployment on edge devices. In this paper, we introduce Developmental Federated…

Machine Learning · Computer Science 2025-08-04 Yebo Wu , Jingguang Li , Zhijiang Guo , Li Li

While providing machine learning model as a service to process users' inference requests, online applications can periodically upgrade the model utilizing newly collected data. Federated learning (FL) is beneficial for enabling the training…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-22 Pengchao Han , Shiqiang Wang , Yang Jiao , Jianwei Huang

Federated Learning (FL) has gained significant attraction due to its ability to enable privacy-preserving training over decentralized data. Current literature in FL mostly focuses on single-task learning. However, over time, new tasks may…

Machine Learning · Computer Science 2023-10-18 Yavuz Faruk Bakman , Duygu Nur Yaldiz , Yahya H. Ezzeldin , Salman Avestimehr

Federated learning (FL) is increasingly being recognized as a key approach to overcoming the data silos that so frequently obstruct the training and deployment of machine-learning models in clinical settings. This work contributes to a…

Machine Learning · Computer Science 2024-07-08 Fatemeh Tavakoli , D. B. Emerson , Sana Ayromlou , John Jewell , Amrit Krishnan , Yuchong Zhang , Amol Verma , Fahad Razak

Federated learning is renowned for its efficacy in distributed model training, ensuring that users, called clients, retain data privacy by not disclosing their data to the central server that orchestrates collaborations. Most previous work…

Machine Learning · Computer Science 2024-10-30 Pouya M. Ghari , Yanning Shen

Federated Learning (FL) enables the multiple participating devices to collaboratively contribute to a global neural network model while keeping the training data locally. Unlike the centralized training setting, the non-IID, imbalanced…

Machine Learning · Computer Science 2024-04-16 Moming Duan , Duo Liu , Xinyuan Ji , Yu Wu , Liang Liang , Xianzhang Chen , Yujuan Tan

Instruction tuning, a specialized technique to enhance large language model (LLM) performance via instruction datasets, relies heavily on the quality of employed data. Existing quality improvement methods alter instruction data through…

Computation and Language · Computer Science 2023-12-29 Yang Xu , Yongqiang Yao , Yufan Huang , Mengnan Qi , Maoquan Wang , Bin Gu , Neel Sundaresan