English
Related papers

Related papers: Optimizing Retrieval-Augmented Generation (RAG) fo…

200 papers

Low-rank adaptation (LoRA) has emerged as the de facto standard for parameter-efficient fine-tuning (PEFT) of foundation models, enabling the adaptation of billion-parameter networks with minimal computational and memory overhead. Despite…

Machine Learning · Computer Science 2026-04-24 Bingcong Li , Yilang Zhang , Georgios B. Giannakis

A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation Download PDF Neal Gregory Lawton, Alfy Samuel, Anoop Kumar, Daben Liu Published: 20 Aug 2025, Retrieval augmented generation (RAG) is a popular…

Computation and Language · Computer Science 2025-10-21 Neal Gregory Lawton , Alfy Samuel , Anoop Kumar , Daben Liu

We investigate parameter-efficient fine-tuning (PEFT) methods that can provide good accuracy under limited computational and memory budgets in the context of large language models (LLMs). We present a new PEFT method called Robust…

Computation and Language · Computer Science 2024-06-04 Mahdi Nikdan , Soroush Tabesh , Elvir Crnčević , Dan Alistarh

Parameter-Efficient Fine-Tuning (PEFT) has risen as an innovative training strategy that updates only a select few model parameters, significantly lowering both computational and memory demands. PEFT also helps to decrease data transfer in…

Machine Learning · Computer Science 2024-09-05 Shuangyi Chen , Yue Ju , Hardik Dalal , Zhongwen Zhu , Ashish Khisti

Low-rank adaptation (LoRA) and its mixture-of-experts (MOE) variants are highly effective parameter-efficient fine-tuning (PEFT) methods. However, they introduce significant latency in multi-tenant settings due to the LoRA modules and MOE…

Computation and Language · Computer Science 2024-10-24 Jingfan Zhang , Yi Zhao , Dan Chen , Xing Tian , Huanran Zheng , Wei Zhu

Large language models are increasingly adapted to downstream tasks through fine-tuning. Full supervised fine-tuning (SFT) and parameter-efficient fine-tuning (PEFT) methods, such as Low-Rank Adaptation (LoRA), are two dominant approaches.…

Computation and Language · Computer Science 2025-12-18 Darshita Rathore , Vineet Kumar , Chetna Bansal , Anindya Moitra

Finetuning Large Language Models helps improve the results for domain-specific use cases. End-to-end finetuning of large language models is time and resource intensive and has high storage requirements to store the finetuned version of the…

Computation and Language · Computer Science 2023-07-12 Kunal Suri , Prakhar Mishra , Saumajit Saha , Atul Singh

Fine-tuning is widely used to tailor large language models for specific tasks such as neural machine translation (NMT). However, leveraging transfer learning is computationally expensive when fine-tuning large multilingual models with…

Computation and Language · Computer Science 2025-10-22 Josh McGiff , Nikola S. Nikolov

This technical report details a novel approach to combining reasoning and retrieval augmented generation (RAG) within a single, lean language model architecture. While existing RAG systems typically rely on large-scale models and external…

Parameter-efficient fine-tuning (PEFT) has emerged as a powerful paradigm for adapting large-scale pre-trained models to downstream tasks with minimal additional parameters. Among PEFT methods, Low-Rank Adaptation (LoRA) stands out for its…

Machine Learning · Computer Science 2026-02-03 Nghiem T. Diep , Dung Le , Tuan Truong , Tan Dinh , Huy Nguyen , Nhat Ho

Adapting pretrained language models to novel domains, such as clinical applications, traditionally involves retraining their entire set of parameters. Parameter-Efficient Fine-Tuning (PEFT) techniques for fine-tuning language models…

Computation and Language · Computer Science 2024-06-11 Aryo Pradipta Gema , Pasquale Minervini , Luke Daines , Tom Hope , Beatrice Alex

Parameter-efficient fine-tuning (PEFT) has become the standard approach for adapting large language models under limited compute and memory budgets. Although previous methods improve efficiency through low-rank updates, quantization, or…

Machine Learning · Computer Science 2025-10-21 Zhuxuanzi Wang , Mingqiao Mo , Xi Xiao , Chen Liu , Chenrui Ma , Yunbei Zhang , Xiao Wang , Smita Krishnaswamy , Tianyang Wang

Adapting large language models (LLMs) to downstream tasks via full fine-tuning is increasingly impractical due to its computational and memory demands. Parameter-efficient fine-tuning (PEFT) approaches such as Low-Rank Adaptation (LoRA)…

Machine Learning · Computer Science 2026-05-19 Jing Gao , Zhong-Yi Lu , Pan Zhang , Ze-Feng Gao

Low-Rank Adaptation (LoRA) is a widely adopted parameter-efficient fine-tuning (PEFT) method for Large Language Models (LLMs), but it still incurs notable overhead and suffers from parameter interference in complex datasets. While recent…

Computation and Language · Computer Science 2025-12-19 Chunlin Tian , Xuyang Wei , Huanrong Liu , Zhijiang Guo , Li Li

Fine-tuning pre-trained large language models in a parameter-efficient manner is widely studied for its effectiveness and efficiency. LoRA is one of the most widely used methods, which assumes that the optimization process is essentially…

Computation and Language · Computer Science 2024-12-16 Changqun Li , Chaofan Ding , Kexin Luan , Xinhan Di

The rapid progress of large language models (LLMs) has transformed natural language processing, yet the challenge of efficient adaptation remains unresolved. Full fine-tuning achieves strong performance but imposes prohibitive computational…

Quantum Physics · Physics 2025-09-23 Emily Jimin Roh , Hyojun Ahn , Samuel Yen-Chi Chen , Soohyun Park , Joongheon Kim

Parameter-Efficient Fine-Tuning (PEFT) has become the standard for customising Foundation Models (FMs) to user-specific downstream tasks. However, typical PEFT methods require storing multiple task-specific adapters, creating scalability…

Machine Learning · Computer Science 2024-11-04 Abhinav Jain , Swarat Chaudhuri , Thomas Reps , Chris Jermaine

Parameter-Efficient Fine-Tuning (PEFT) methods like Low-Rank Adaptation (LoRA) optimize federated training by reducing computational and communication costs. We propose RoLoRA, a federated framework using alternating optimization to…

Machine Learning · Computer Science 2025-11-06 Shuangyi Chen , Yuanxin Guo , Yue Ju , Harik Dalal , Zhongwen Zhu , Ashish Khisti

Self-supervised representation learning for point cloud has demonstrated effectiveness in improving pre-trained model performance across diverse tasks. However, as pre-trained models grow in complexity, fully fine-tuning them for downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Song Wang , Xiaolu Liu , Lingdong Kong , Jianyun Xu , Chunyong Hu , Gongfan Fang , Wentong Li , Jianke Zhu , Xinchao Wang

Parameter-Efficient Fine-Tuning (PEFT) methods, such as Low-Rank Adaptation (LoRA), have significantly reduced the number of trainable parameters needed in fine-tuning large language models (LLMs). The developments of LoRA-style adapters…

Machine Learning · Computer Science 2026-04-15 Yuxuan Gu , Wuyang Zhou , Giorgos Iacovides , Danilo Mandic