English
Related papers

Related papers: Breaking PEFT Limitations: Leveraging Weak-to-Stro…

200 papers

The proliferation of open-weight Large Language Models (LLMs) has democratized agentic AI, yet fine-tuned weights are frequently shared and adopted with limited scrutiny beyond leaderboard performance. This creates a risk where third-party…

Cryptography and Security · Computer Science 2026-03-05 Bhanu Pallakonda , Mikkel Hindsbo , Sina Ehsani , Prag Mishra

Parameter-efficient fine-tuning (PEFT) of pre-trained language models (PLMs) has emerged as a highly successful approach, with training only a small number of parameters without sacrificing performance and becoming the de-facto learning…

Computation and Language · Computer Science 2023-10-20 Baohao Liao , Shaomu Tan , Christof Monz

With the continuous growth in the number of parameters of transformer-based pretrained language models (PLMs), particularly the emergence of large language models (LLMs) with billions of parameters, many natural language processing (NLP)…

Computation and Language · Computer Science 2023-12-20 Lingling Xu , Haoran Xie , Si-Zhao Joe Qin , Xiaohui Tao , Fu Lee Wang

Large language models (LLMs) and vision language models (VLMs) demonstrate excellent performance on a wide range of tasks by scaling up parameter counts from O(10^9) to O(10^{12}) levels and further beyond. These large scales make it…

Computation and Language · Computer Science 2023-10-19 Yaqing Wang , Jialin Wu , Tanmaya Dabral , Jiageng Zhang , Geoff Brown , Chun-Ta Lu , Frederick Liu , Yi Liang , Bo Pang , Michael Bendersky , Radu Soricut

Mainstream backdoor attack methods typically demand substantial tuning data for poisoning, limiting their practicality and potentially degrading the overall performance when applied to Large Language Models (LLMs). To address these issues,…

Cryptography and Security · Computer Science 2024-03-21 Yanzhou Li , Tianlin Li , Kangjie Chen , Jian Zhang , Shangqing Liu , Wenhan Wang , Tianwei Zhang , Yang Liu

During fine-tuning, large language models (LLMs) are increasingly vulnerable to data-poisoning backdoor attacks, which compromise their reliability and trustworthiness. However, existing defense strategies suffer from limited…

Cryptography and Security · Computer Science 2025-10-13 Shuai Zhao , Xinyi Wu , Shiqian Zhao , Xiaobao Wu , Zhongliang Guo , Yanhao Jia , Anh Tuan Luu

Backdoor Attacks have been a serious vulnerability against Large Language Models (LLMs). However, previous methods only reveal such risk in specific models, or present tasks transferability after attacking the pre-trained phase. So, how…

Cryptography and Security · Computer Science 2024-08-20 Pengzhou Cheng , Zongru Wu , Tianjie Ju , Wei Du , Zhuosheng Zhang Gongshen Liu

Parameter-efficient fine-tuning (PEFT) has become a key training strategy for large language models. However, its reliance on fewer trainable parameters poses security risks, such as task-agnostic backdoors. Despite their severe impact on a…

Computation and Language · Computer Science 2024-10-08 Jaehan Kim , Minkyoo Song , Seung Ho Na , Seungwon Shin

Parameter-Efficient Fine-Tuning (PEFT) is a popular class of techniques that strive to adapt large models in a scalable and resource-efficient manner. Yet, the mechanisms underlying their training performance and generalization remain…

Machine Learning · Computer Science 2026-02-10 Zahra Rahimi Afzal , Tara Esmaeilbeig , Mojtaba Soltanalian , Mesrob I. Ohannessian

Parameter Efficient Fine-Tuning (PEFT) methods are proposed as an alternative fine-tuning approach for Large Language Models (LLM) to minimize high training costs. While prior research demonstrates the effectiveness of PEFT methods in…

Software Engineering · Computer Science 2025-01-28 Amirreza Esmaeili , Iman Saberi , Fatemeh H. Fard

Foundation models have revolutionized artificial intelligence by providing robust, versatile architectures pre-trained on large-scale datasets. However, adapting these massive models to specific downstream tasks requires fine-tuning, which…

Machine Learning · Computer Science 2025-05-01 Jieming Bian , Yuanzhe Peng , Lei Wang , Yin Huang , Jie Xu

Existing works show that augmenting the training data of pre-trained language models (PLMs) for classification tasks fine-tuned via parameter-efficient fine-tuning methods (PEFT) using both clean and adversarial examples can enhance their…

Computation and Language · Computer Science 2024-06-18 Tuc Nguyen , Thai Le

This survey delves into the realm of Parameter-Efficient Fine-Tuning (PEFT) within the context of Foundation Models (FMs). PEFT, a cost-effective fine-tuning technique, minimizes parameters and computational complexity while striving for…

Computation and Language · Computer Science 2025-01-24 Dan Zhang , Tao Feng , Lilong Xue , Yuandong Wang , Yuxiao Dong , Jie Tang

The implications of backdoor attacks on English-centric large language models (LLMs) have been widely examined - such attacks can be achieved by embedding malicious behaviors during training and activated under specific conditions that…

Computation and Language · Computer Science 2025-03-18 Xuanli He , Jun Wang , Qiongkai Xu , Pasquale Minervini , Pontus Stenetorp , Benjamin I. P. Rubinstein , Trevor Cohn

Multimodal large language models (MLLMs) fine-tuned with multimodal instruction datasets have demonstrated remarkable capabilities in multimodal tasks. However, fine-tuning all parameters of MLLMs has become challenging as they usually…

Computation and Language · Computer Science 2024-06-10 Xiongtao Zhou , Jie He , Yuhua Ke , Guangyao Zhu , Víctor Gutiérrez-Basulto , Jeff Z. Pan

This paper delves into the pressing need in Parameter-Efficient Fine-Tuning (PEFT) for Large Language Models (LLMs). While LLMs possess remarkable capabilities, their extensive parameter requirements and associated computational demands…

Computation and Language · Computer Science 2023-11-23 Chengyu Wang , Junbing Yan , Wei Zhang , Jun Huang

The Large Language Models (LLMs) are poised to offer efficient and intelligent services for future mobile communication networks, owing to their exceptional capabilities in language comprehension and generation. However, the extremely high…

Cryptography and Security · Computer Science 2023-09-07 Haomiao Yang , Kunlan Xiang , Mengyu Ge , Hongwei Li , Rongxing Lu , Shui Yu

Fine-tuning adapts pretrained models for specific tasks but poses the risk of catastrophic forgetting (CF), where critical knowledge from pretraining is overwritten. To address the issue of CF in a general-purpose framework, we propose…

Computation and Language · Computer Science 2025-11-25 Runyu Wang , Peng Ping , Zhengyu Guo , Xiaoye Zhang , Quan Shi , Liting Zhou , Tianbo Ji

The success of large language models (LLMs), like GPT-4 and ChatGPT, has led to the development of numerous cost-effective and accessible alternatives that are created by finetuning open-access LLMs with task-specific data (e.g.,…

Computation and Language · Computer Science 2023-10-10 Zhiqiang Hu , Lei Wang , Yihuai Lan , Wanyu Xu , Ee-Peng Lim , Lidong Bing , Xing Xu , Soujanya Poria , Roy Ka-Wei Lee

Large Language Models (LLMs) can acquire deceptive behaviors through backdoor attacks, where the model executes prohibited actions whenever secret triggers appear in the input. Existing safety training methods largely fail to address this…

Cryptography and Security · Computer Science 2025-10-08 Guangyu Shen , Siyuan Cheng , Xiangzhe Xu , Yuan Zhou , Hanxi Guo , Zhuo Zhang , Xiangyu Zhang