English
Related papers

Related papers: SparseLoRA: Accelerating LLM Fine-Tuning with Cont…

200 papers

Parameter-Efficient Fine-Tuning (PEFT) has gained prominence through low-rank adaptation methods like LoRA. In this paper, we focus on sparsity-based PEFT (SPEFT), which introduces trainable sparse adaptations to the weight matrices in the…

Computation and Language · Computer Science 2025-06-30 Xinxin Liu , Aaron Thomas , Cheng Zhang , Jianyi Cheng , Yiren Zhao , Xitong Gao

Among the widely used parameter-efficient fine-tuning (PEFT) methods, LoRA and its variants have gained considerable popularity because of avoiding additional inference costs. However, there still often exists an accuracy gap between these…

Computation and Language · Computer Science 2024-07-10 Shih-Yang Liu , Chien-Yi Wang , Hongxu Yin , Pavlo Molchanov , Yu-Chiang Frank Wang , Kwang-Ting Cheng , Min-Hung Chen

Large language models (LLMs) are a promising avenue for machine translation (MT). However, current LLM-based MT systems are brittle: their effectiveness highly depends on the choice of few-shot examples and they often require extra…

While Large Language Models (LLMs) have revolutionized artificial intelligence, fine-tuning LLMs is extraordinarily computationally expensive, preventing smaller businesses and research teams with limited GPU resources from engaging with…

Machine Learning · Computer Science 2025-08-26 Daniel Frees , Aditri Bhagirath , Moritz Bolling

Dense large language models(LLMs) face critical efficiency bottlenecks as they rigidly activate all parameters regardless of input complexity. While existing sparsity methods(static pruning or dynamic activation) address this partially,…

Computation and Language · Computer Science 2025-02-27 Yiheng Yang , Yujie Wang , Chi Ma , Lei Yu , Emmanuele Chersoni , Chu-Ren Huang

We propose a memory-efficient finetuning algorithm for large language models (LLMs) that supports finetuning LLMs with 65B parameters in 2/3/4-bit precision on as little as one 24GB GPU. Our method, modular low-rank adaptation (ModuLoRA),…

Machine Learning · Computer Science 2024-03-12 Junjie Yin , Jiahao Dong , Yingheng Wang , Christopher De Sa , Volodymyr Kuleshov

Multilingual neural machine translation models support fine-tuning hundreds of languages simultaneously. However, fine-tuning on full parameters solely is inefficient potentially leading to negative interactions among languages. In this…

Computation and Language · Computer Science 2024-09-10 Zhe Cao , Zhi Qu , Hidetaka Kamigaito , Taro Watanabe

The growing scale of Large Language Models (LLMs) has necessitated the development of parameter-efficient fine-tuning techniques. Low-Rank Adaptation (LoRA) has emerged as a promising approach, reducing the number of trainable parameters by…

Machine Learning · Computer Science 2025-09-01 Jessica Liang , Anirudh Bharadwaj

Fine-tuning large language models (LLMs) for downstream tasks has become increasingly crucial due to their widespread use and the growing availability of open-source models. However, the high memory costs associated with fine-tuning remain…

Machine Learning · Computer Science 2025-02-04 David H. Yang , Mohammad Mohammadi Amiri , Tejaswini Pedapati , Subhajit Chaudhury , Pin-Yu Chen

With the ever-growing size of pretrained models (PMs), fine-tuning them has become more expensive and resource-hungry. As a remedy, low-rank adapters (LoRA) keep the main pretrained weights of the model frozen and just introduce some…

Computation and Language · Computer Science 2023-04-20 Mojtaba Valipour , Mehdi Rezagholizadeh , Ivan Kobyzev , Ali Ghodsi

Large Language Models (LLMs) have driven significant progress, yet their growing parameter counts and context windows incur prohibitive compute, energy, and monetary costs. We introduce EfficientLLM, a novel benchmark and the first…

Large Language Models (LLMs) offer strong capabilities but incur high inference costs due to dense computation and memory access. Training-free activation sparsity is a promising approach for efficient LLM inference, yet existing methods…

Machine Learning · Computer Science 2026-02-17 Lei Chen , Yuan Meng , Xiaoyu Zhan , Zhi Wang , Wenwu Zhu

Low Rank Adaptation (LoRA) has gained massive attention in the recent generative AI research. One of the main advantages of LoRA is its ability to be fused with pretrained models, adding no overhead during inference. However, from a mobile…

Fueled by their remarkable ability to tackle diverse tasks across multiple domains, large language models (LLMs) have grown at an unprecedented rate, with some recent models containing trillions of parameters. This growth is accompanied by…

Machine Learning · Computer Science 2025-05-30 Athanasios Glentis , Jiaxiang Li , Qiulin Shang , Andi Han , Ioannis Tsaknakis , Quan Wei , Mingyi Hong

Low-Rank Adapters (LoRAs) have transformed the fine-tuning of Large Language Models (LLMs) by enabling parameter-efficient updates. However, their widespread adoption remains limited by the reliance on GPU-based training. In this work, we…

Machine Learning · Computer Science 2025-07-03 Reza Arabpour , Haitz Sáez de Ocáriz Borde , Anastasis Kratsios

Large Language Models (LLMs) have achieved remarkable success with their billion-level parameters, yet they incur high inference overheads. The emergence of activation sparsity in LLMs provides a natural approach to reduce this cost by…

Computation and Language · Computer Science 2024-12-13 Haizhong Zheng , Xiaoyan Bai , Xueshen Liu , Z. Morley Mao , Beidi Chen , Fan Lai , Atul Prakash

Parameter-efficient fine-tuning (PEFT) is an effective method for adapting pre-trained vision models to downstream tasks by tuning a small subset of parameters. Among PEFT methods, sparse tuning achieves superior performance by only…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Shufan Shen , Junshu Sun , Xiangyang Ji , Qingming Huang , Shuhui Wang

Parameter-Efficient Fine-Tuning (PEFT) methods have transformed the approach to fine-tuning large models for downstream tasks by enabling the adjustment of significantly fewer parameters than those in the original model matrices. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Alessio Quercia , Zhuo Cao , Arya Bangun , Richard D. Paul , Abigail Morrison , Ira Assent , Hanno Scharr

Large Language Models (LLMs) have shown remarkable performance across various tasks, but the escalating demands on computational resources pose significant challenges, particularly in the extensive utilization of full fine-tuning for…

Machine Learning · Computer Science 2025-01-07 Jia-Hong Huang , Yixian Shen , Hongyi Zhu , Stevan Rudinac , Evangelos Kanoulas

With the proliferation of large pre-trained language models (PLMs), fine-tuning all model parameters becomes increasingly inefficient, particularly when dealing with numerous downstream tasks that entail substantial training and storage…

Computation and Language · Computer Science 2024-01-23 Nadav Benedek , Lior Wolf