English
Related papers

Related papers: Safe LoRA: the Silver Lining of Reducing Safety Ri…

200 papers

We study and quantify the problem of forgetting when fine-tuning pre-trained large language models (LLMs) on a downstream task. We find that parameter-efficient fine-tuning (PEFT) strategies, such as Low-Rank Adapters (LoRA), still suffer…

Computation and Language · Computer Science 2024-01-12 Damjan Kalajdzievski

Within the realm of software engineering, specialized tasks on code, such as program repair, present unique challenges, necessitating fine-tuning Large language models~(LLMs) to unlock state-of-the-art performance. Fine-tuning approaches…

Software Engineering · Computer Science 2025-09-23 Boyang Yang , Haoye Tian , Jiadong Ren , Hongyu Zhang , Jacques Klein , Tegawendé F. Bissyandé , Claire Le Goues , Shunfu Jin

Large Language Models (LLMs) are typically aligned for safety during the post-training phase; however, they may still generate inappropriate outputs that could potentially pose risks to users. This challenge underscores the need for robust…

Machine Learning · Computer Science 2025-12-08 Mahesh Kumar Nandwana , Youngwan Lim , Joseph Liu , Alex Yang , Varun Notibala , Nishchaie Khanna

The recent surge in Large Language Models (LLMs) has garnered significant attention across numerous fields. Fine-tuning is often required to fit general LLMs for a specific domain, like the web-based healthcare system. However, two problems…

Computation and Language · Computer Science 2024-06-03 Qidong Liu , Xian Wu , Xiangyu Zhao , Yuanshao Zhu , Derong Xu , Feng Tian , Yefeng Zheng

Low-rank adaptation is a popular parameter-efficient fine-tuning method for large language models. In this paper, we analyze the impact of low-rank updating, as implemented in LoRA. Our findings suggest that the low-rank updating mechanism…

Computation and Language · Computer Science 2024-05-21 Ting Jiang , Shaohan Huang , Shengyue Luo , Zihan Zhang , Haizhen Huang , Furu Wei , Weiwei Deng , Feng Sun , Qi Zhang , Deqing Wang , Fuzhen Zhuang

Large language models (LLMs) show inherent brittleness in their safety mechanisms, as evidenced by their susceptibility to jailbreaking and even non-malicious fine-tuning. This study explores this brittleness of safety alignment by…

Machine Learning · Computer Science 2024-10-28 Boyi Wei , Kaixuan Huang , Yangsibo Huang , Tinghao Xie , Xiangyu Qi , Mengzhou Xia , Prateek Mittal , Mengdi Wang , Peter Henderson

Large Language Models (LLMs) have demonstrated powerful capabilities that render them valuable in different applications, including conversational AI products. It is paramount to ensure the security and reliability of these products by…

Computation and Language · Computer Science 2025-01-23 Melissa Kazemi Rad , Huy Nghiem , Andy Luo , Sahil Wadhwa , Mohammad Sorower , Stephen Rawls

Low-Rank Adapters (LoRAs) have transformed the fine-tuning of Large Language Models (LLMs) by enabling parameter-efficient updates. However, their widespread adoption remains limited by the reliance on GPU-based training. In this work, we…

Machine Learning · Computer Science 2025-07-03 Reza Arabpour , Haitz Sáez de Ocáriz Borde , Anastasis Kratsios

Low-Rank Adaptation (LoRA) and its variants have shown impressive results in reducing the number of trainable parameters and memory requirements of large transformer networks while maintaining fine-tuning performance. The low-rank nature of…

Computation and Language · Computer Science 2025-03-13 Paul Albert , Frederic Z. Zhang , Hemanth Saratchandran , Cristian Rodriguez-Opazo , Anton van den Hengel , Ehsan Abbasnejad

Ensuring the safe alignment of large language models (LLMs) with human values is critical as they become integral to applications like translation and question answering. Current alignment methods struggle with dynamic user intentions and…

Computation and Language · Computer Science 2024-10-29 Rima Hazra , Sayan Layek , Somnath Banerjee , Soujanya Poria

Advances in large language models (LLMs) have empowered a variety of applications. However, there is still a significant gap in research when it comes to understanding and enhancing the capabilities of LLMs in the field of mental health. In…

Computation and Language · Computer Science 2024-01-30 Xuhai Xu , Bingsheng Yao , Yuanzhe Dong , Saadia Gabriel , Hong Yu , James Hendler , Marzyeh Ghassemi , Anind K. Dey , Dakuo Wang

The LoRA-finetuning quantization of LLMs has been extensively studied to obtain accurate yet compact LLMs for deployment on resource-constrained hardware. However, existing methods cause the quantized LLM to severely degrade and even fail…

Machine Learning · Computer Science 2024-05-28 Haotong Qin , Xudong Ma , Xingyu Zheng , Xiaoyang Li , Yang Zhang , Shouda Liu , Jie Luo , Xianglong Liu , Michele Magno

Fine-tuning large language models (LLMs) improves performance but introduces critical safety vulnerabilities: even minimal harmful data can severely compromise safety measures. We observe that perturbations orthogonal to the alignment…

Machine Learning · Computer Science 2026-01-08 Shuo Yang , Qihui Zhang , Yuyang Liu , Xiaojun Jia , Kunpeng Ning , Jiayu Yao , Jigang Wang , Hailiang Dai , Yibing Song , Li Yuan

The proliferation of edge devices has created an urgent need for security solutions capable of detecting malware in real time while operating under strict computational and memory constraints. Recently, Large Language Models (LLMs) have…

Cryptography and Security · Computer Science 2026-02-13 Christian Rondanini , Barbara Carminati , Elena Ferrari , Niccolò Lardo , Ashish Kundu

Due to the demand for efficient fine-tuning of large language models, Low-Rank Adaptation (LoRA) has been widely adopted as one of the most effective parameter-efficient fine-tuning methods. Nevertheless, while LoRA improves efficiency,…

Computation and Language · Computer Science 2025-06-13 Naibin Gu , Zhenyu Zhang , Xiyu Liu , Peng Fu , Zheng Lin , Shuohuan Wang , Yu Sun , Hua Wu , Weiping Wang , Haifeng Wang

Low-rank adaptation (LoRA) methods show great potential for scaling pre-trained general-purpose Large Language Models (LLMs) to hundreds or thousands of use scenarios. However, their efficacy in high-stakes domains like finance is rarely…

Computational Engineering, Finance, and Science · Computer Science 2025-05-27 Dannong Wang , Jaisal Patel , Daochen Zha , Steve Y. Yang , Xiao-Yang Liu

Warning: This paper contains examples of harmful language, and reader discretion is recommended. The increasing open release of powerful large language models (LLMs) has facilitated the development of downstream applications by reducing the…

Computation and Language · Computer Science 2023-10-05 Xianjun Yang , Xiao Wang , Qi Zhang , Linda Petzold , William Yang Wang , Xun Zhao , Dahua Lin

Recent advancements in Large Language Models (LLMs) have emphasized the critical role of fine-tuning (FT) techniques in adapting LLMs to specific tasks, especially when retraining from scratch is computationally infeasible. Fine-tuning…

Artificial Intelligence · Computer Science 2025-10-23 Xiao Han , Zimo Zhao , Wanyu Wang , Maolin Wang , Zitao Liu , Yi Chang , Xiangyu Zhao

Parameter-efficient fine-tuning (PEFT) is essential for adapting large language models (LLMs), with low-rank adaptation (LoRA) being the most popular approach. However, LoRA suffers from slow convergence, and some recent LoRA variants, such…

Computation and Language · Computer Science 2025-02-21 Chenlu Guo , Yuan Wu , Yi Chang

Instruction fine-tuning has recently emerged as a promising approach for improving the zero-shot capabilities of Large Language Models (LLMs) on new tasks. This technique has shown particular strength in improving the performance of…

Computation and Language · Computer Science 2023-07-13 Jiuding Sun , Chantal Shaib , Byron C. Wallace