English
Related papers

Related papers: Thinking Forward: Memory-Efficient Federated Finet…

200 papers

Considering the hardware-friendly characteristics and broad applicability, structured pruning has emerged as an efficient solution to reduce the resource demands of large language models (LLMs) on resource-constrained devices. Traditional…

Machine Learning · Computer Science 2025-01-28 Zihuai Xu , Yang Xu , Hongli Xu , Yunming Liao , Zhiwei Yao , Zuan Xie

Neural network pruning is an essential technique for reducing the size and complexity of deep neural networks, enabling large-scale models on devices with limited resources. However, existing pruning approaches heavily rely on training data…

Machine Learning · Computer Science 2023-07-12 Hong Huang , Lan Zhang , Chaoyue Sun , Ruogu Fang , Xiaoyong Yuan , Dapeng Wu

Large language models (LLMs) show amazing performance on many domain-specific tasks after fine-tuning with some appropriate data. However, many domain-specific data are privately distributed across multiple owners. Thus, this dilemma raises…

Machine Learning · Computer Science 2024-06-26 Feijie Wu , Zitao Li , Yaliang Li , Bolin Ding , Jing Gao

Although large language models (LLMs) have achieved remarkable success across various domains, their considerable scale necessitates substantial computational resources, posing significant challenges for deployment in resource-constrained…

Machine Learning · Computer Science 2024-11-26 Yao Lu , Hao Cheng , Yujie Fang , Zeyu Wang , Jiaheng Wei , Dongwei Xu , Qi Xuan , Xiaoniu Yang , Zhaowei Zhu

Large Language Models (LLMs) perform well on many NLP tasks, but fine-tuning them on resource-constrained mobile devices is challenging due to high memory and computation costs, despite growing demands for privacy-preserving…

Machine Learning · Computer Science 2026-01-21 He Sun , Jinrui Zhou , Li Li , Mingjun Xiao

Federated Learning (FL) is an emerging paradigm that enables distributed users to collaboratively and iteratively train machine learning models without sharing their private data. Motivated by the effectiveness and robustness of…

Machine Learning · Computer Science 2022-11-16 Jinyu Chen , Wenchao Xu , Song Guo , Junxiao Wang , Jie Zhang , Haozhao Wang

Large language models (LLMs) have emerged as important components across various fields, yet their training requires substantial computation resources and abundant labeled data. It poses a challenge to robustly training LLMs for individual…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-13 Jiaxing QI , Zhongzhi Luan , Shaohan Huang , Carol Fung , Hailong Yang , Depei Qian

Model pruning, i.e., removing a subset of model weights, has become a prominent approach to reducing the memory footprint of large language models (LLMs) during inference. Notably, popular inference engines, such as vLLM, enable users to…

Machine Learning · Computer Science 2026-04-07 Kazuki Egashira , Robin Staab , Thibaud Gloaguen , Mark Vero , Martin Vechev

Large Artificial Intelligence Models (LAMs) powered by massive datasets, extensive parameter scales, and extensive computational resources, leading to significant transformations across various industries. Yet, their practical deployment on…

Machine Learning · Computer Science 2026-04-22 Xianke Qiang , Hongda Liu , Xinran Zhang , Zheng Chang , Ying-Chang Liang

Transformer-based Large Language Models (LLMs) have made a significant impact on various domains. However, LLMs' efficiency suffers from both heavy computation and memory overheads. Compression techniques like sparsification and…

This report examines the fine-tuning of Large Language Models (LLMs), integrating theoretical insights with practical applications. It outlines the historical evolution of LLMs from traditional Natural Language Processing (NLP) models to…

Machine Learning · Computer Science 2024-10-31 Venkatesh Balavadhani Parthasarathy , Ahtsham Zafar , Aafaq Khan , Arsalan Shahid

Although Federated Learning (FL) enables collaborative learning in Artificial Intelligence of Things (AIoT) design, it fails to work on low-memory AIoT devices due to its heavy memory usage. To address this problem, various federated…

Machine Learning · Computer Science 2024-05-09 Pengyu Zhang , Yingjie Liu , Yingbo Zhou , Xiao Du , Xian Wei , Ting Wang , Mingsong Chen

Recently, prompt tuning (PT) has gained increasing attention as a parameter-efficient way of tuning pre-trained language models (PLMs). Despite extensively reducing the number of tunable parameters and achieving satisfying performance, PT…

Computation and Language · Computer Science 2022-11-15 Yufei Huang , Yujia Qin , Huadong Wang , Yichun Yin , Maosong Sun , Zhiyuan Liu , Qun Liu

Large language models have driven significant progress in natural language processing, but their deployment requires substantial compute and memory resources. As models scale, compression techniques become essential for balancing model…

Machine Learning · Computer Science 2025-05-13 Vithursan Thangarasa , Ganesh Venkatesh , Mike Lasby , Nish Sinnadurai , Sean Lie

Nowadays, Large Language Models (LLMs) have been trained using extended context lengths to foster more creative applications. However, long context training poses great challenges considering the constraint of GPU memory. It not only leads…

Machine Learning · Computer Science 2025-01-16 Pinxue Zhao , Hailin Zhang , Fangcheng Fu , Xiaonan Nie , Qibin Liu , Fang Yang , Yuanbo Peng , Dian Jiao , Shuaipeng Li , Jinbao Xue , Yangyu Tao , Bin Cui

The popularity of LLaMA (Touvron et al., 2023a;b) and other recently emerged moderate-sized large language models (LLMs) highlights the potential of building smaller yet powerful LLMs. Regardless, the cost of training such models from…

Computation and Language · Computer Science 2024-04-12 Mengzhou Xia , Tianyu Gao , Zhiyuan Zeng , Danqi Chen

The rapid advancement of large-language models (LLMs) has driven extensive research into parameter compression after training has been completed, yet compression during the training phase remains largely unexplored. In this work, we…

Machine Learning · Computer Science 2025-11-19 Jun Wu , Jiangtao Wen , Yuxing Han

The extensive memory footprint of language model (LM) fine-tuning poses a challenge for both researchers and practitioners. LMs use an embedding matrix to represent extensive vocabularies, forming a substantial proportion of the model…

Computation and Language · Computer Science 2025-03-26 Miles Williams , Nikolaos Aletras

LLM pruning has emerged as a promising technology for compressing LLMs, enabling their deployment on resource-limited devices. However, current methodologies typically require access to public calibration samples, which can be challenging…

Machine Learning · Computer Science 2025-05-21 Pengxin Guo , Yinong Wang , Wei Li , Mengting Liu , Ming Li , Jinkai Zheng , Liangqiong Qu

Pretrained language models (PLMs) are today the primary model for natural language processing. Despite their impressive downstream performance, it can be difficult to apply PLMs to new languages, a barrier to making their capabilities…

Computation and Language · Computer Science 2024-01-15 Yihong Chen , Kelly Marchisio , Roberta Raileanu , David Ifeoluwa Adelani , Pontus Stenetorp , Sebastian Riedel , Mikel Artetxe