English
Related papers

Related papers: Analysing Safety Risks in LLMs Fine-Tuned with Pse…

200 papers

Recent studies have uncovered a troubling vulnerability in the fine-tuning stage of large language models (LLMs): even fine-tuning on entirely benign datasets can lead to a significant increase in the harmfulness of LLM outputs. Building on…

Machine Learning · Computer Science 2025-05-27 Zihan Guan , Mengxuan Hu , Ronghang Zhu , Sheng Li , Anil Vullikanti

Background: Fine-tuning is central to adapting pre-trained Large Language Models (LLMs) to downstream tasks, but its reliance on training data, parameter updates, and reusable components opens entry points for attackers. Threats have…

Cryptography and Security · Computer Science 2026-05-26 Wenjuan Li , Yitao Liu , Runze Chen , Rajkumar Buyya

As Large Language Models (LLMs) are deployed and integrated into thousands of applications, the need for scalable evaluation of how models respond to adversarial attacks grows rapidly. However, LLM security is a moving target: models…

Computation and Language · Computer Science 2024-06-18 Leon Derczynski , Erick Galinkin , Jeffrey Martin , Subho Majumdar , Nanna Inie

Large Language Models (LLMs) have gained widespread adoption across various domains, including chatbots and auto-task completion agents. However, these models are susceptible to safety vulnerabilities such as jailbreaking, prompt injection,…

Cryptography and Security · Computer Science 2024-09-10 Divyanshu Kumar , Anurakt Kumar , Sahil Agarwal , Prashanth Harshangi

When building Large Language Models (LLMs), it is paramount to bear safety in mind and protect them with guardrails. Indeed, LLMs should never generate content promoting or normalizing harmful, illegal, or unethical behavior that may…

Computation and Language · Computer Science 2024-06-25 Simone Tedeschi , Felix Friedrich , Patrick Schramowski , Kristian Kersting , Roberto Navigli , Huu Nguyen , Bo Li

The rapid advancement of Large Language Models (LLMs) has opened up new opportunities for leveraging artificial intelligence in a variety of application domains, including cybersecurity. As the volume and sophistication of cyber threats…

Cryptography and Security · Computer Science 2025-09-23 Hanxiang Xu , Shenao Wang , Ningke Li , Kailong Wang , Yanjie Zhao , Kai Chen , Ting Yu , Yang Liu , Haoyu Wang

Fine-tuning large language models (LLMs) based on human preferences, commonly achieved through reinforcement learning from human feedback (RLHF), has been effective in improving their performance. However, maintaining LLM safety throughout…

Artificial Intelligence · Computer Science 2025-02-18 Yingshui Tan , Yilei Jiang , Yanshi Li , Jiaheng Liu , Xingyuan Bu , Wenbo Su , Xiangyu Yue , Xiaoyong Zhu , Bo Zheng

Large Language Models (LLMs) are set to reshape cybersecurity by augmenting red and blue team operations. Red teams can exploit LLMs to plan attacks, craft phishing content, simulate adversaries, and generate exploit code. Conversely, blue…

Cryptography and Security · Computer Science 2025-06-17 Alsharif Abuadbba , Chris Hicks , Kristen Moore , Vasilios Mavroudis , Burak Hasircioglu , Diksha Goel , Piers Jennings

Large language models (LLMs) are increasingly deployed behind safety guardrails such as system prompts and content filters, especially in settings where product teams cannot modify model weights. In practice these guardrails are typically…

Cryptography and Security · Computer Science 2025-12-19 Perry Abdulkadir

Large language models (LLMs) are vulnerable when trained on datasets containing harmful content, which leads to potential jailbreaking attacks in two scenarios: the integration of harmful texts within crowdsourced data used for pre-training…

Cryptography and Security · Computer Science 2024-06-03 Xiaoqun Liu , Jiacheng Liang , Muchao Ye , Zhaohan Xi

Fine-tuning safety-aligned large language models (LLMs) can substantially compromise their safety. Previous approaches require many safety samples or calibration sets, which not only incur significant computational overhead during…

Machine Learning · Computer Science 2026-01-07 Jiawen Zhang , Lipeng He , Kejia Chen , Jian Lou , Jian Liu , Xiaohu Yang , Ruoxi Jia

Spurred by the recent rapid increase in the development and distribution of large language models (LLMs) across industry and academia, much recent work has drawn attention to safety- and security-related threats and vulnerabilities of LLMs,…

Computation and Language · Computer Science 2023-08-25 Maximilian Mozes , Xuanli He , Bennett Kleinberg , Lewis D. Griffin

Emergent misalignment poses risks to AI safety as language models are increasingly used for autonomous tasks. In this paper, we present a population of large language models (LLMs) fine-tuned on insecure datasets spanning 11 diverse…

Artificial Intelligence · Computer Science 2026-02-03 Abhishek Mishra , Mugilan Arulvanan , Reshma Ashok , Polina Petrova , Deepesh Suranjandass , Donnie Winkelmann

Fine-tuning large language models (LLMs) on telecom datasets is a common practice to adapt general-purpose models to the telecom domain. However, little attention has been paid to how this process may compromise model safety. Recent…

Computers and Society · Computer Science 2026-02-09 Aladin Djuhera , Swanand Ravindra Kadhe , Farhan Ahmed , Syed Zawad , Fernando Koch , Walid Saad , Holger Boche

Multi-modal large language models (MLLMs) have made significant progress, yet their safety alignment remains limited. Typically, current open-source MLLMs rely on the alignment inherited from their language module to avoid harmful…

Cryptography and Security · Computer Science 2025-04-15 Yanbo Wang , Jiyang Guan , Jian Liang , Ran He

Efforts to ensure the safety of large language models (LLMs) include safety fine-tuning, evaluation, and red teaming. However, despite the widespread use of the Retrieval-Augmented Generation (RAG) framework, AI safety work focuses on…

Computation and Language · Computer Science 2025-04-28 Bang An , Shiyue Zhang , Mark Dredze

Detecting life-threatening language is essential for safeguarding individuals in distress, promoting mental health and well-being, and preventing potential harm and loss of life. This paper presents an effective approach to identifying…

Computation and Language · Computer Science 2025-06-13 Thanh Thi Nguyen , Campbell Wilson , Janis Dalins

Larger language models (LLMs) have taken the world by storm with their massive multi-tasking capabilities simply by optimizing over a next-word prediction objective. With the emergence of their properties and encoded knowledge, the risk of…

Computation and Language · Computer Science 2023-08-31 Rishabh Bhardwaj , Soujanya Poria

While large language models (LLMs) present significant potential for supporting numerous real-world applications and delivering positive social impacts, they still face significant challenges in terms of the inherent risk of privacy…

Artificial Intelligence · Computer Science 2025-01-17 Huandong Wang , Wenjie Fu , Yingzhou Tang , Zhilong Chen , Yuxi Huang , Jinghua Piao , Chen Gao , Fengli Xu , Tao Jiang , Yong Li

The advent of Large Language Models (LLMs) has garnered significant popularity and wielded immense power across various domains within Natural Language Processing (NLP). While their capabilities are undeniably impressive, it is crucial to…

Machine Learning · Computer Science 2024-07-31 Sara Abdali , Jia He , CJ Barberan , Richard Anarfi