English
Related papers

Related papers: LLM-QFL: Distilling Large Language Model for Quant…

200 papers

Federated Learning (FL) enables decentralized, privacy-preserving model training but struggles to balance global generalization and local personalization due to non-identical data distributions across clients. Personalized Fine-Tuning…

Machine Learning · Computer Science 2025-12-30 Minghui Chen , Hrad Ghoukasian , Ruinan Jin , Zehua Wang , Sai Praneeth Karimireddy , Xiaoxiao Li

Large language models (LLMs) are increasingly powering web-based applications, whose effectiveness relies on fine-tuning with large-scale instruction data. However, such data often contains valuable or sensitive information that limits its…

Machine Learning · Computer Science 2025-10-10 Yicheng Zhang , Zhen Qin , Zhaomin Wu , Jian Hou , Shuiguang Deng

Federated Learning (FL) enables training models across decentralized data silos while preserving client data privacy. Recent research has explored efficient methods for post-training large language models (LLMs) within FL to address…

Machine Learning · Computer Science 2025-08-25 Tao Guo , Junxiao Wang , Fushuo Huo , Laizhong Cui , Song Guo , Jie Gui , Dacheng Tao

Federated fine-tuning (FedFT) provides an effective paradigm for fine-tuning large language models (LLMs) in privacy-sensitive scenarios. However, practical deployment remains challenging due to the limited resources on end devices.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-03 Rukuo Li , Jianchun Liu , Hongli Xu , Liusheng Huang

In the era of advanced technologies, mobile devices are equipped with computing and sensing capabilities that gather excessive amounts of data. These amounts of data are suitable for training different learning models. Cooperated with…

Machine Learning · Computer Science 2020-04-07 Muhammad Asad , Ahmed Moustafa , Takayuki Ito , Muhammad Aslam

A common challenge towards the adaptability of Large Language Models (LLMs) is their ability to learn new languages over time without hampering the model's performance on languages in which the model is already proficient (usually English).…

Computation and Language · Computer Science 2026-04-24 Divyanshu Aggarwal , Sankarshan Damle , Navin Goyal , Satya Lokam , Sunayana Sitaram

Large Language Models (LLMs) have achieved remarkable success, underpinning diverse AI applications. However, they often suffer from performance degradation due to factors such as catastrophic forgetting during Supervised Fine-Tuning (SFT),…

Machine Learning · Computer Science 2026-04-20 Chi Liu , Xin Chen , Xu Zhou , Fangbo Tu , Srinivasan Manoharan

Enhancing computational efficiency and reducing deployment costs for large language models (LLMs) have become critical challenges in various resource-constrained scenarios. In this work, we present DistilQwen2.5, a family of distilled,…

Computation and Language · Computer Science 2025-04-22 Chengyu Wang , Junbing Yan , Yuanhao Yue , Jun Huang

Federated learning (FL) is a decentralized approach, enabling multiple participants to collaboratively train a model while ensuring the protection of data privacy. The transmission of updates from numerous edge clusters to the server…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-20 Haowei Li , Weiying Xie , Hangyu Ye , Jitao Ma , Shuran Ma , Yunsong Li

Federated learning (FL) offers a solution to train a global machine learning model while still maintaining data privacy, without needing access to data stored locally at the clients. However, FL suffers performance degradation when client…

Machine Learning · Computer Science 2021-08-13 Zihan Chen , Kai Fong Ernest Chong , Tony Q. S. Quek

The large language model (LLM) is typically integrated into the mainstream optimization protocol. No work has questioned whether maintaining the model integrity is \textit{indispensable} for promising performance. In this work, we introduce…

Computation and Language · Computer Science 2026-03-17 Mingyuan Zhang , Yue Bai , Huan Wang , Yizhou Wang , Qihua Dong , Yitian Zhang , Yun Fu

Fine-tuning Large Language Models (LLMs) typically involves either full fine-tuning, which updates all model parameters, or Parameter-Efficient Fine-Tuning (PEFT), which adjusts a small subset of parameters. However, both approaches have…

Artificial Intelligence · Computer Science 2026-04-14 Shaocong Ma , Peiran Yu , Heng Huang

Federated Learning (FL) facilitates collaborative machine learning by training models on local datasets, and subsequently aggregating these local models at a central server. However, the frequent exchange of model parameters between clients…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-15 Liwei Wang , Jun Li , Wen Chen , Qingqing Wu , Ming Ding

Large language models (LLMs) are increasingly pivotal in a wide range of natural language processing tasks. Access to pre-trained models, courtesy of the open-source community, has made it possible to adapt these models to specific…

Computation and Language · Computer Science 2023-12-04 Kai Lv , Shuo Zhang , Tianle Gu , Shuhao Xing , Jiawei Hong , Keyu Chen , Xiaoran Liu , Yuqing Yang , Honglin Guo , Tengxiao Liu , Yu Sun , Qipeng Guo , Hang Yan , Xipeng Qiu

Quantum federated learning (QFL) has been recently introduced to enable a distributed privacy-preserving quantum machine learning (QML) model training across quantum processors (clients). Despite recent research efforts, existing QFL…

Artificial Intelligence · Computer Science 2025-10-21 Atit Pokharel , Ratun Rahman , Thomas Morris , Dinh C. Nguyen

Federated learning (FL) is a novel machine learning setting that enables on-device intelligence via decentralized training and federated optimization. Deep neural networks' rapid development facilitates the learning techniques for modeling…

Machine Learning · Computer Science 2021-09-27 Shaoxiong Ji , Wenqi Jiang , Anwar Walid , Xue Li

Federated fine-tuning of on-device large language models (LLMs) mitigates privacy concerns by preventing raw data sharing. However, the intensive computational and memory demands pose significant challenges for resource-constrained edge…

Networking and Internet Architecture · Computer Science 2026-02-13 Tao Li , Yulin Tang , Yiyang Song , Cong Wu , Xihui Liu , Pan Li , Xianhao Chen

Large Language Models (LLMs) have been extensively researched and used in both academia and industry since the rise in popularity of the Transformer model, which demonstrates excellent performance in AI. However, the computational demands…

Machine Learning · Computer Science 2024-11-06 Jiedong Lang , Zhehao Guo , Shuyu Huang

Large Language Models (LLMs) are increasingly integrated into real-world applications, raising concerns about privacy, security and the need to remove undesirable knowledge. Machine Unlearning has emerged as a promising solution, yet faces…

Machine Learning · Computer Science 2025-10-22 Yisheng Zhong , Zhengbang Yang , Zhuangdi Zhu

Supervised fine-tuning (SFT) is a standard approach to adapting large language models (LLMs) to new domains. In this work, we improve the statistical efficiency of SFT by selecting an informative subset of training examples. Specifically,…

Machine Learning · Computer Science 2025-05-22 Rohan Deb , Kiran Thekumparampil , Kousha Kalantari , Gaurush Hiranandani , Shoham Sabach , Branislav Kveton