English
Related papers

Related papers: Do as I do (Safely): Mitigating Task-Specific Fine…

200 papers

Instruction tuning improves the ability of large language models (LLMs) to follow diverse human instructions, but achieving strong performance on specific target tasks remains challenging. A critical bottleneck is selecting the most…

Machine Learning · Computer Science 2025-05-19 Da Ma , Gonghu Shang , Zhi Chen , Libo Qin , Yijie Luo , Lei Pan , Shuai Fan , Lu Chen , Kai Yu

Large language models (LLMs) have demonstrated revolutionary capabilities in understanding complex contexts and performing a wide range of tasks. However, LLMs can also answer questions that are unethical or harmful, raising concerns about…

Cryptography and Security · Computer Science 2025-04-15 Kang Yang , Guanhong Tao , Xun Chen , Jun Xu

Fine-tuning-as-a-service introduces a threat to Large Language Models' safety when service providers fine-tune their models on poisoned user-submitted datasets, a process known as harmful fine-tuning attacks. In this work, we show that by…

Machine Learning · Computer Science 2026-03-03 Quoc Minh Nguyen , Trung Le , Jing Wu , Anh Tuan Bui , Mehrtash Harandi

The rapid development of large language models (LLMs) has not only provided numerous opportunities but also presented significant challenges. This becomes particularly evident when LLMs inadvertently generate harmful or toxic content,…

Computation and Language · Computer Science 2024-02-20 Kai Chen , Chunwei Wang , Kuo Yang , Jianhua Han , Lanqing Hong , Fei Mi , Hang Xu , Zhengying Liu , Wenyong Huang , Zhenguo Li , Dit-Yan Yeung , Lifeng Shang , Xin Jiang , Qun Liu

We identify a novel phenomenon in language models: benign fine-tuning of frontier models can lead to privacy collapse. We find that diverse, subtle patterns in training data can degrade contextual privacy, including optimisation for…

Computation and Language · Computer Science 2026-04-21 Anmol Goel , Cornelius Emde , Sangdoo Yun , Seong Joon Oh , Martin Gubri

Large language models (LLMs) have achieved remarkable success across many applications, but their ability to generate harmful content raises serious safety concerns. Although safety alignment techniques are often applied during pre-training…

Machine Learning · Computer Science 2026-04-24 Chengcan Wu , Zhixin Zhang , Zeming Wei , Yihao Zhang , Xiaokun Luan , Meng Sun

Safe reinforcement learning has traditionally relied on predefined constraint functions to ensure safety in complex real-world tasks, such as autonomous driving. However, defining these functions accurately for varied tasks is a persistent…

Machine Learning · Computer Science 2025-01-31 Se-Wook Yoo , Seung-Woo Seo

As large language models (LLMs) become easily accessible nowadays, the trade-off between safety and helpfulness can significantly impact user experience. A model that prioritizes safety will cause users to feel less engaged and assisted…

Computation and Language · Computer Science 2024-04-02 Yi-Lin Tuan , Xilun Chen , Eric Michael Smith , Louis Martin , Soumya Batra , Asli Celikyilmaz , William Yang Wang , Daniel M. Bikel

Fine-tuning safety-aligned large language models (LLMs) can substantially compromise their safety. Previous approaches require many safety samples or calibration sets, which not only incur significant computational overhead during…

Machine Learning · Computer Science 2026-01-07 Jiawen Zhang , Lipeng He , Kejia Chen , Jian Lou , Jian Liu , Xiaohu Yang , Ruoxi Jia

Task semantics can be expressed by a set of input-output examples or a piece of textual instruction. Conventional machine learning approaches for natural language processing (NLP) mainly rely on the availability of large-scale sets of…

Computation and Language · Computer Science 2024-05-28 Renze Lou , Kai Zhang , Wenpeng Yin

Recent studies reveal that Large Language Models (LLMs) face challenges in balancing safety with utility, particularly when processing long texts for NLP tasks like summarization and translation. Despite defenses against malicious short…

Computation and Language · Computer Science 2024-05-27 Yu Fu , Wen Xiao , Jia Chen , Jiachen Li , Evangelos Papalexakis , Aichi Chien , Yue Dong

As a dominant paradigm, fine-tuning a pre-trained model on the target data is widely used in many deep learning applications, especially for small data sets. However, recent studies have empirically shown that training from scratch has the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Ziquan Liu , Yi Xu , Yuanhong Xu , Qi Qian , Hao Li , Xiangyang Ji , Antoni Chan , Rong Jin

Lifelong multimodal agents must continuously adapt to new tasks through post-training, but this creates a fundamental tension between acquiring capabilities and preserving safety alignment. We demonstrate that fine-tuning aligned…

Artificial Intelligence · Computer Science 2026-03-17 Idhant Gulati , Shivam Raval

Instruction tuning (IT) achieves impressive zero-shot generalization results by training large language models (LLMs) on a massive amount of diverse tasks with instructions. However, how to select new tasks to improve the performance and…

Computation and Language · Computer Science 2023-11-02 Po-Nien Kung , Fan Yin , Di Wu , Kai-Wei Chang , Nanyun Peng

Recent advancements in Large Language Models (LLMs) have sparked widespread concerns about their safety. Recent work demonstrates that safety alignment of LLMs can be easily removed by fine-tuning with a few adversarially chosen…

Computation and Language · Computer Science 2025-03-03 Samuele Poppi , Zheng-Xin Yong , Yifei He , Bobbie Chern , Han Zhao , Aobo Yang , Jianfeng Chi

Large language models (LLMs) hold the promise of solving diverse tasks when provided with appropriate natural language prompts. However, prompting often leads models to make predictions with lower accuracy compared to finetuning a model…

Computation and Language · Computer Science 2024-08-13 Chenyang Zhao , Xueying Jia , Vijay Viswanathan , Tongshuang Wu , Graham Neubig

Large language models (LLMs) are increasingly used in decision-making contexts, but when they present answers without signaling low confidence, users may unknowingly act on erroneous outputs. Prior work shows that LLMs maintain internal…

Computation and Language · Computer Science 2025-10-23 Mark Steyvers , Catarina Belem , Padhraic Smyth

Many recent studies endeavor to improve open-source language models through imitation learning, and re-training on the synthetic instruction data from state-of-the-art proprietary models like ChatGPT and GPT-4. However, the innate nature of…

Computation and Language · Computer Science 2024-04-16 Hyunsoo Cho

While most AI alignment research focuses on preventing models from generating explicitly harmful content, a more subtle risk is emerging: capability-oriented training induced exploitation. We investigate whether language models, when…

Machine Learning · Computer Science 2026-02-13 Yujun Zhou , Yue Huang , Han Bao , Kehan Guo , Zhenwen Liang , Pin-Yu Chen , Tian Gao , Werner Geyer , Nuno Moniz , Nitesh V Chawla , Xiangliang Zhang

LLMs(Large Language Models) nowadays have widespread adoption as a tool for solving issues across various domain/tasks. These models since are susceptible to produce harmful or toxic results, inference-time adversarial attacks, therefore…

Computation and Language · Computer Science 2024-10-01 Sachin Kumar