English
Related papers

Related papers: Position-Aware Parameter Efficient Fine-Tuning App…

200 papers

Parameter-Efficient Fine-Tuning (PEFT) methods have gained significant popularity for adapting pre-trained Large Language Models (LLMs) to downstream tasks, primarily due to their potential to significantly reduce memory and computational…

Computation and Language · Computer Science 2024-11-06 Kai Yao , Penglei Gao , Lichun Li , Yuan Zhao , Xiaofeng Wang , Wei Wang , Jianke Zhu

Recent studies applied Parameter Efficient Fine-Tuning techniques (PEFTs) to efficiently narrow the performance gap between pre-training and downstream. There are two important factors for various PEFTs, namely, the accessible data size and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Yuxin Tian , Mouxing Yang , Yunfan Li , Dayiheng Liu , Xingzhang Ren , Xi Peng , Jiancheng Lv

Large language models (LLMs) demonstrate impressive capabilities to generate accurate code snippets given natural language intents in a zero-shot manner, i.e., without the need for specific fine-tuning. While prior studies have highlighted…

Software Engineering · Computer Science 2024-12-30 Martin Weyssow , Xin Zhou , Kisub Kim , David Lo , Houari Sahraoui

Fine-tuning large language models (LLMs) on downstream tasks requires substantial computational resources. Selective PEFT, a class of parameter-efficient fine-tuning (PEFT) methodologies, aims to mitigate these computational challenges by…

Computation and Language · Computer Science 2025-06-24 Aradhye Agarwal , Suhas K Ramesh , Ayan Sengupta , Tanmoy Chakraborty

The adaptation of large language models (LLMs) to specialized reasoning tasks is fundamentally constrained by computational resources. Parameter-Efficient Fine-Tuning (PEFT) methods have emerged as a powerful solution, yet the landscape of…

Computation and Language · Computer Science 2025-09-15 Brennen Hill

Large Language Models (LLMs) are composed of neurons that exhibit various behaviors and roles, which become increasingly diversified as models scale. Recent studies have revealed that not all neurons are active across different datasets,…

Computation and Language · Computer Science 2024-03-19 Haoyun Xu , Runzhe Zhan , Derek F. Wong , Lidia S. Chao

Large language models (LLMs) face the challenges in fine-tuning and deployment due to their high memory demands and computational costs. While parameter-efficient fine-tuning (PEFT) methods aim to reduce the memory usage of the optimizer…

Machine Learning · Computer Science 2023-10-31 Jeonghoon Kim , Jung Hyun Lee , Sungdong Kim , Joonsuk Park , Kang Min Yoo , Se Jung Kwon , Dongsoo Lee

The large models, as predicted by scaling raw forecasts, have made groundbreaking progress in many fields, particularly in natural language generation tasks, where they have approached or even surpassed human levels. However, the…

Computation and Language · Computer Science 2025-04-25 Luping Wang , Sheng Chen , Linnan Jiang , Shu Pan , Runze Cai , Sen Yang , Fei Yang

The rapid advancements in Large Language Models (LLMs) have revolutionized natural language processing (NLP) and related fields. However, fine-tuning these models for specific tasks remains computationally expensive and risks degrading…

Computation and Language · Computer Science 2024-12-17 Md Kowsher , Nusrat Jahan Prottasha , Prakash Bhat

To fully leverage the advantages of large-scale pre-trained language models (PLMs) on downstream tasks, it has become a ubiquitous adaptation paradigm to fine-tune the entire parameters of PLMs. However, this paradigm poses issues of…

Computation and Language · Computer Science 2023-05-09 Anchun Gui , Han Xiao

One-size-fits-all large language models (LLMs) are increasingly being used to help people with their writing. However, the style these models are trained to write in may not suit all users or use cases. LLMs would be more useful as writing…

Computation and Language · Computer Science 2024-09-10 Xinyue Liu , Harshita Diddee , Daphne Ippolito

Parameter Efficient Fine-Tuning (PEFT) methods have emerged as effective and promising approaches for fine-tuning pre-trained language models. Compared with Full parameter Fine-Tuning (FFT), PEFT achieved comparable task performance with a…

Machine Learning · Computer Science 2025-06-10 Tongzhou Yu , Zhuhao Zhang , Guanghui Zhu , Shen Jiang , Meikang Qiu , Yihua Huang

Instruction tuning has become an important step for finetuning pretrained language models to better follow human instructions and generalize on various tasks. Nowadays, pretrained language models become increasingly larger, and full…

Computation and Language · Computer Science 2024-11-27 Pengfei He

The fine-tuning of Large Language Models (LLMs) is pivotal for achieving optimal performance across diverse downstream tasks. However, while full fine-tuning delivers superior results, it entails significant computational and resource…

Computation and Language · Computer Science 2025-01-15 Yao Liang , Yuwei Wang , Yi Zeng

Adapting pretrained language models to novel domains, such as clinical applications, traditionally involves retraining their entire set of parameters. Parameter-Efficient Fine-Tuning (PEFT) techniques for fine-tuning language models…

Computation and Language · Computer Science 2024-06-11 Aryo Pradipta Gema , Pasquale Minervini , Luke Daines , Tom Hope , Beatrice Alex

Parameter-efficient fine-tuning (PEFT) has emerged as the predominant technique for fine-tuning in the era of large language models. However, existing PEFT methods still have inadequate training efficiency. Firstly, the utilization of…

Computation and Language · Computer Science 2024-06-07 Naibin Gu , Peng Fu , Xiyu Liu , Bowen Shen , Zheng Lin , Weiping Wang

While Large Language Models (LLMs) have made significant strides in replicating human-like abilities, there are concerns about a reduction in the linguistic diversity of their outputs. This results in the homogenization of viewpoints and…

Computation and Language · Computer Science 2024-12-05 Long Mai , Julie Carson-Berndsen

The rise of Artificial Intelligence (AI)-and particularly Large Language Models (LLMs) for code-has reshaped Software Engineering (SE) by enabling the automation of tasks such as code generation, bug detection, and repair. However, these…

Software Engineering · Computer Science 2025-08-18 Saima Afrin , Md Zahidul Haque , Antonio Mastropaolo

When using LLMs to rank items based on given criteria, or evaluate answers, the order of candidate items can influence the model's final decision. This sensitivity to item positioning in a LLM's prompt is known as position bias. Prior…

Machine Learning · Computer Science 2025-07-25 Ali Vardasbi , Gustavo Penha , Claudia Hauff , Hugues Bouchard

Long context understanding remains challenging for large language models due to their limited context windows. This paper introduces Long Input Fine-Tuning (LIFT) for long context modeling, a novel framework that enhances LLM performance on…

Computation and Language · Computer Science 2024-12-19 Yansheng Mao , Jiaqi Li , Fanxu Meng , Jing Xiong , Zilong Zheng , Muhan Zhang