English
Related papers

Related papers: Efficient Ensemble for Fine-tuning Language Models…

200 papers

Large Language Models (LLMs) demonstrate exceptional performance across various tasks but demand substantial computational resources even for fine-tuning computation. Although Low-Rank Adaptation (LoRA) significantly alleviates memory…

Machine Learning · Computer Science 2025-02-04 Guanduo Chen , Yutong He , Yipeng Hu , Kun Yuan , Binhang Yuan

Finetuning is a common practice widespread across different communities to adapt pretrained models to particular tasks. Text classification is one of these tasks for which many pretrained models are available. On the other hand, ensembles…

Computation and Language · Computer Science 2024-10-29 Sebastian Pineda Arango , Maciej Janowski , Lennart Purucker , Arber Zela , Frank Hutter , Josif Grabocka

The advent of large language models (LLMs) has revolutionized natural language processing, enabling unprecedented capabilities in understanding and generating human-like text. However, the computational cost and convergence times associated…

Computation and Language · Computer Science 2024-11-26 Kerim Büyükakyüz

Fine-tuning large language models (LLMs) with low-rank adaptations (LoRAs) has become common practice, often yielding numerous copies of the same LLM differing only in their LoRA updates. This paradigm presents challenges for systems that…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-02 Rickard Brüel-Gabrielsson , Jiacheng Zhu , Onkar Bhardwaj , Leshem Choshen , Kristjan Greenewald , Mikhail Yurochkin , Justin Solomon

Fine-tuning large pre-trained models for downstream tasks has become a fundamental approach in natural language processing. Fully fine-tuning all model parameters is computationally expensive and memory-intensive, especially in…

Computation and Language · Computer Science 2025-09-24 Yu Chen , Yifei Han , Long Zhang , Yue Du , Bin Li

Merging parameter-efficient task experts has recently gained growing attention as a way to build modular architectures that can be rapidly adapted on the fly for specific downstream tasks, without requiring additional fine-tuning.…

This study examines whether Low-Rank Adaptation (LoRA) fine-tuned Large Language Models (LLMs) can approximate the performance of fully fine-tuned models in generating human-interpretable decisions and explanations for malware…

Cryptography and Security · Computer Science 2025-11-26 Stephen C. Gravereaux , Sheikh Rabiul Islam

As Large Language Models (LLMs) are frequently updated, LoRA weights trained on earlier versions quickly become obsolete. The conventional practice of retraining LoRA weights from scratch on the latest model is costly, time-consuming, and…

Machine Learning · Computer Science 2025-05-21 Yanan Li , Fanxu Meng , Muhan Zhang , Shiai Zhu , Shangguang Wang , Mengwei Xu

Fine-tuning large language models (LLMs) is increasingly costly as models scale to hundreds of billions of parameters, and even parameter-efficient fine-tuning (PEFT) methods like LoRA remain resource-intensive. We introduce LowRA, the…

Machine Learning · Computer Science 2025-02-13 Zikai Zhou , Qizheng Zhang , Hermann Kumbong , Kunle Olukotun

Parameter efficient fine tuning methods like LoRA have enabled task specific adaptation of large language models, but efficiently composing multiple specialized adapters for unseen tasks remains challenging. We present a novel framework for…

Computation and Language · Computer Science 2026-02-26 Riya Adsul , Balachandra Devarangadi Sunil , Isha Nalawade , Sudharshan Govindan

Recently, large language models (LLMs) have achieved remarkable breakthroughs, revolutionizing the natural language processing domain and beyond. Due to immense parameter sizes, fine-tuning these models with private data for diverse…

Machine Learning · Computer Science 2025-05-06 Zheng Lin , Yuxin Zhang , Zhe Chen , Zihan Fang , Xianhao Chen , Praneeth Vepakomma , Wei Ni , Jun Luo , Yue Gao

Large language models (LLMs) have reached human-like proficiency in generating diverse textual content, underscoring the necessity for effective fake text detection to avoid potential risks such as fake news in social media. Previous…

Machine Learning · Computer Science 2024-03-21 Zhixin Lai , Xuesheng Zhang , Suiyao Chen

Parameter-efficient fine-tuning techniques like Low-Rank Adaptation (LoRA) have revolutionized the adaptation of large language models (LLMs) to diverse tasks. Recent efforts have explored mixtures of LoRA modules for multi-task settings.…

Computation and Language · Computer Science 2024-08-06 Lin Ning , Harsh Lara , Meiqi Guo , Abhinav Rastogi

Parameter-Efficient Fine-Tuning (PEFT) is widely used for adapting Large Language Models (LLMs) for various tasks. Recently, there has been an increasing demand for fine-tuning a single LLM for multiple tasks because it requires overall…

Computation and Language · Computer Science 2026-05-15 Anjir Ahmed Chowdhury , Syed Zawad , Xiaolong Ma , Xu Dong , Feng Yan

Semantic text classification requires the understanding of the contextual significance of specific tokens rather than surface-level patterns or keywords (as in rule-based or statistical text classification), making large language models…

Machine Learning · Computer Science 2025-08-13 Adit Krishnan , Chu Wang , Chris Kong

Time series modeling holds significant importance in many real-world applications and has been extensively studied. While pre-trained foundation models have made impressive strides in the fields of natural language processing (NLP) and…

Computation and Language · Computer Science 2025-02-20 Juyuan Zhang , Wei Zhu , Jiechao Gao

Due to the demand for efficient fine-tuning of large language models, Low-Rank Adaptation (LoRA) has been widely adopted as one of the most effective parameter-efficient fine-tuning methods. Nevertheless, while LoRA improves efficiency,…

Computation and Language · Computer Science 2025-06-13 Naibin Gu , Zhenyu Zhang , Xiyu Liu , Peng Fu , Zheng Lin , Shuohuan Wang , Yu Sun , Hua Wu , Weiping Wang , Haifeng Wang

Finetuned large language models (LLMs) have shown remarkable performance in financial tasks, such as sentiment analysis and information retrieval. Due to privacy concerns, finetuning and deploying Financial LLMs (FinLLMs) locally are…

Machine Learning · Computer Science 2025-01-22 Dannong Wang , Daniel Kim , Bo Jin , Xingjian Zhao , Tianfan Fu , Steve Yang , Xiao-Yang Liu

Parameter efficient finetuning (PEFT) methods are widely used in LLMs and generative models in computer vision. Especially one can use multiple of these during inference to change the behavior of the base model. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Ege Kesim , Selahattin Serdar Helli

Advancements in Large Language Models (LLMs) have significantly enhanced instruction-following capabilities. However, most Instruction Fine-Tuning (IFT) datasets are predominantly in English, limiting model performance in other languages.…

Computation and Language · Computer Science 2024-07-03 Sathish Reddy Indurthi , Wenxuan Zhou , Shamil Chollampatt , Ravi Agrawal , Kaiqiang Song , Lingxiao Zhao , Chenguang Zhu