English
Related papers

Related papers: Do as I do (Safely): Mitigating Task-Specific Fine…

200 papers

Supplementary Training on Intermediate Labeled-data Tasks (STILTs) is a widely applied technique, which first fine-tunes the pretrained language models on an intermediate task before on the target task of interest. While STILTs is able to…

Computation and Language · Computer Science 2021-09-02 Ting-Yun Chang , Chi-Jen Lu

Fine-tuning large pre-trained models has become the de facto strategy for developing both task-specific and general-purpose machine learning systems, including developing models that are safe to deploy. Despite its clear importance, there…

Instruction tuning -- tuning large language models on instruction-output pairs -- is a promising technique for making models better adapted to the real world. Yet, the key factors driving the model's capability to understand and follow…

Computation and Language · Computer Science 2024-06-03 Dylan Zhang , Justin Wang , Francois Charton

Optimizing large language models (LLMs) for downstream use cases often involves the customization of pre-trained LLMs through further fine-tuning. Meta's open release of Llama models and OpenAI's APIs for fine-tuning GPT-3.5 Turbo on custom…

Computation and Language · Computer Science 2023-10-06 Xiangyu Qi , Yi Zeng , Tinghao Xie , Pin-Yu Chen , Ruoxi Jia , Prateek Mittal , Peter Henderson

Language models are trained to follow instructions, but they are also powerful pattern completers. What happens when these two objectives conflict? We construct conversations in which a user instruction to behave in a target way T (e.g.,…

Computation and Language · Computer Science 2026-05-21 Carolina Camassa , Derek Shiller

Recent advancements in large language models (LLMs) have underscored their vulnerability to safety alignment jailbreaks, particularly when subjected to downstream fine-tuning. However, existing mitigation strategies primarily focus on…

Cryptography and Security · Computer Science 2025-06-06 Lei Hsiung , Tianyu Pang , Yung-Chen Tang , Linyue Song , Tsung-Yi Ho , Pin-Yu Chen , Yaoqing Yang

Recent studies show that Large Language Models (LLMs) with safety alignment can be jail-broken by fine-tuning on a dataset mixed with harmful data. First time in the literature, we show that the jail-broken effect can be mitigated by…

Machine Learning · Computer Science 2024-10-30 Tiansheng Huang , Sihao Hu , Fatih Ilhan , Selim Furkan Tekin , Ling Liu

Recent studies have uncovered a troubling vulnerability in the fine-tuning stage of large language models (LLMs): even fine-tuning on entirely benign datasets can lead to a significant increase in the harmfulness of LLM outputs. Building on…

Machine Learning · Computer Science 2025-05-27 Zihan Guan , Mengxuan Hu , Ronghang Zhu , Sheng Li , Anil Vullikanti

Large language models achieve high performance on many but not all downstream tasks. The interaction between pretraining data and task data is commonly assumed to determine this variance: a task with data that is more similar to a model's…

Computation and Language · Computer Science 2023-11-16 Gregory Yauney , Emily Reif , David Mimno

Large Language Models (LLMs) have been adopted and deployed worldwide for a broad variety of applications. However, ensuring their safe use remains a significant challenge. Preference training and safety measures often overfit to harms…

Computation and Language · Computer Science 2024-10-15 Aakanksha , Arash Ahmadian , Seraphina Goldfarb-Tarrant , Beyza Ermis , Marzieh Fadaee , Sara Hooker

Large language models (LLMs) are vulnerable when trained on datasets containing harmful content, which leads to potential jailbreaking attacks in two scenarios: the integration of harmful texts within crowdsourced data used for pre-training…

Cryptography and Security · Computer Science 2024-06-03 Xiaoqun Liu , Jiacheng Liang , Muchao Ye , Zhaohan Xi

Large language models are typically trained on vast amounts of data during the pre-training phase, which may include some potentially harmful information. Fine-tuning attacks can exploit this by prompting the model to reveal such…

Cryptography and Security · Computer Science 2025-02-04 Zhiyuan Xu , Joseph Gardiner , Sana Belguith

Black-box finetuning is an emerging interface for adapting state-of-the-art language models to user needs. However, such access may also let malicious actors undermine model safety. To demonstrate the challenge of defending finetuning…

Cryptography and Security · Computer Science 2024-07-01 Danny Halawi , Alexander Wei , Eric Wallace , Tony T. Wang , Nika Haghtalab , Jacob Steinhardt

Fine-tuning LLMs on benign data can still degrade alignment and adversarial robustness, yet direct analysis of the role of fine-tuning objectives in shaping these safety outcomes remain limited. We present a controlled comparison of six…

Computation and Language · Computer Science 2026-01-21 Daniel Vennemeyer , Punya Syon Pandey , Phan Anh Duong , Michael Umeokoli , Samuel Ratnam

As the number of large language models (LLMs) released to the public grows, there is a pressing need to understand the safety implications associated with these models learning from third-party custom finetuning data. We explore the…

Computation and Language · Computer Science 2024-07-04 Jiachen Zhao , Zhun Deng , David Madras , James Zou , Mengye Ren

Instruction tuning commonly means finetuning a language model on instruction-response pairs. We discover two forms of adaptation (tuning) that are deficient compared to instruction tuning, yet still yield instruction following; we call this…

Computation and Language · Computer Science 2024-09-24 John Hewitt , Nelson F. Liu , Percy Liang , Christopher D. Manning

Fine-tuning large language models (LLMs) is a common practice to adapt generalist models to specialized domains. However, recent studies show that fine-tuning can erode safety alignment, causing LLMs to respond to harmful or unethical…

Computation and Language · Computer Science 2026-04-24 Aladin Djuhera , Swanand Ravindra Kadhe , Farhan Ahmed , Syed Zawad , Holger Boche

Recent work has shown that fine-tuning large language models (LLMs) on code with security vulnerabilities can result in misaligned and unsafe behaviors across broad domains. These results prompted concerns about the emergence of harmful…

Machine Learning · Computer Science 2025-07-08 Jeremiah Giordani

Fine-tuning language models is commonly believed to inevitably harm their safety, i.e., refusing to respond to harmful user requests, even when using harmless datasets, thus requiring additional safety measures. We challenge this belief…

Machine Learning · Computer Science 2025-08-19 Minseon Kim , Jin Myung Kwak , Lama Alssum , Bernard Ghanem , Philip Torr , David Krueger , Fazl Barez , Adel Bibi

Recent studies on the safety alignment of large language models (LLMs) have revealed that existing approaches often operate superficially, leaving models vulnerable to various adversarial attacks. Despite their significance, these studies…

Cryptography and Security · Computer Science 2025-06-02 Jianwei Li , Jung-Eun Kim