English
Related papers

Related papers: LLM Reinforcement in Context

200 papers

The recent surge in jailbreaking attacks has revealed significant vulnerabilities in Large Language Models (LLMs) when exposed to malicious inputs. While various defense strategies have been proposed to mitigate these threats, there has…

Computation and Language · Computer Science 2025-02-24 Tianlong Li , Zhenghua Wang , Wenhao Liu , Muling Wu , Shihan Dou , Changze Lv , Xiaohua Wang , Xiaoqing Zheng , Xuanjing Huang

Major search engine providers are rapidly incorporating Large Language Model (LLM)-generated content in response to user queries. These conversational search engines operate by loading retrieved website text into the LLM context for…

Computation and Language · Computer Science 2024-09-26 Samuel Pfrommer , Yatong Bai , Tanmay Gautam , Somayeh Sojoudi

Large Language Models (LLMs) suffer from a range of vulnerabilities that allow malicious users to solicit undesirable responses through manipulation of the input text. These so-called jailbreak prompts are designed to trick the LLM into…

Computation and Language · Computer Science 2025-10-13 John Hawkins , Aditya Pramar , Rodney Beard , Rohitash Chandra

Large language models are aligned to be safe, preventing users from generating harmful content like misinformation or instructions for illegal activities. However, previous work has shown that the alignment process is vulnerable to…

Computation and Language · Computer Science 2024-06-07 Javier Rando , Francesco Croce , Kryštof Mitka , Stepan Shabalin , Maksym Andriushchenko , Nicolas Flammarion , Florian Tramèr

With the development of Large Language Models (LLMs), numerous efforts have revealed their vulnerabilities to jailbreak attacks. Although these studies have driven the progress in LLMs' safety alignment, it remains unclear whether LLMs have…

Cryptography and Security · Computer Science 2025-09-16 Yu Yan , Sheng Sun , Zhe Wang , Yijun Lin , Zenghao Duan , zhifei zheng , Min Liu , Zhiyi yin , Jianping Zhang

Large Language Models (LLMs) are increasingly used to simulate human users in interactive settings such as therapy, education, and social role-play. While these simulations enable scalable training and evaluation of AI agents, off-the-shelf…

Computation and Language · Computer Science 2025-11-04 Marwa Abdulhai , Ryan Cheng , Donovan Clay , Tim Althoff , Sergey Levine , Natasha Jaques

The capacity of large language models (LLMs) to generate honest, harmless, and helpful responses heavily relies on the quality of user prompts. However, these prompts often tend to be brief and vague, thereby significantly limiting the full…

Computation and Language · Computer Science 2025-07-01 Xiaohua Wang , Zisu Huang , Feiran Zhang , Zhibo Xu , Cenyuan Zhang , Qi Qian , Xiaoqing Zheng , Xuanjing Huang

Large language models (LLMs) have achieved impressive performance across natural language tasks and are increasingly deployed in real-world applications. Despite extensive safety alignment efforts, recent studies show that such alignment is…

Artificial Intelligence · Computer Science 2026-02-02 Yinzhi Zhao , Ming Wang , Shi Feng , Xiaocui Yang , Daling Wang , Yifei Zhang

Large Language Models (LLMs) have demonstrated powerful capabilities that render them valuable in different applications, including conversational AI products. It is paramount to ensure the security and reliability of these products by…

Computation and Language · Computer Science 2025-01-23 Melissa Kazemi Rad , Huy Nghiem , Andy Luo , Sahil Wadhwa , Mohammad Sorower , Stephen Rawls

Large language models (LLMs) increasingly operate in multi-agent and safety-critical settings, raising open questions about how their vulnerabilities scale when models interact adversarially. This study examines whether larger models can…

Machine Learning · Computer Science 2026-01-05 Samuel Nathanson , Rebecca Williams , Cynthia Matuszek

Large Language Models (LLMs) have increasingly become pivotal in content generation with notable societal impact. These models hold the potential to generate content that could be deemed harmful.Efforts to mitigate this risk include…

Computation and Language · Computer Science 2024-08-20 Kexin Chen , Yi Liu , Dongxia Wang , Jiaying Chen , Wenhai Wang

Large Language Models (LLMs) rapidly reshape modern life, advancing fields from healthcare to education and beyond. However, alongside their remarkable capabilities lies a significant threat: the susceptibility of these models to…

Computation and Language · Computer Science 2025-05-16 Michael Fire , Yitzhak Elbazis , Adi Wasenstein , Lior Rokach

It has recently been shown that adversarial attacks on large language models (LLMs) can "jailbreak" the model into making harmful statements. In this work, we argue that the spectrum of adversarial attacks on LLMs is much larger than merely…

Machine Learning · Computer Science 2024-02-22 Jonas Geiping , Alex Stein , Manli Shu , Khalid Saifullah , Yuxin Wen , Tom Goldstein

Large Language Models (LLMs) demonstrate outstanding performance in their reservoir of knowledge and understanding capabilities, but they have also been shown to be prone to illegal or unethical reactions when subjected to jailbreak…

Artificial Intelligence · Computer Science 2025-01-08 Fengxiang Wang , Ranjie Duan , Peng Xiao , Xiaojun Jia , Shiji Zhao , Cheng Wei , YueFeng Chen , Chongwen Wang , Jialing Tao , Hang Su , Jun Zhu , Hui Xue

Large Language Models (LLMs) are increasingly being integrated into services such as ChatGPT to provide responses to user queries. To mitigate potential harm and prevent misuse, there have been concerted efforts to align the LLMs with human…

Cryptography and Security · Computer Science 2024-12-30 Xiaomeng Hu , Pin-Yu Chen , Tsung-Yi Ho

With the widespread deployment of Multimodal Large Language Models (MLLMs) for visual-reasoning tasks, improving their safety has become crucial. Recent research indicates that despite training-time safety alignment, these models remain…

Despite their superior performance on a wide range of domains, large language models (LLMs) remain vulnerable to misuse for generating harmful content, a risk that has been further amplified by various jailbreak attacks. Existing jailbreak…

Cryptography and Security · Computer Science 2025-10-27 Yukun Jiang , Mingjie Li , Michael Backes , Yang Zhang

Recent explorations with commercial Large Language Models (LLMs) have shown that non-expert users can jailbreak LLMs by simply manipulating their prompts; resulting in degenerate output behavior, privacy and security breaches, offensive…

Computation and Language · Computer Science 2024-03-28 Abhinav Rao , Sachin Vashistha , Atharva Naik , Somak Aditya , Monojit Choudhury

Large language models (LLMs) are vulnerable when trained on datasets containing harmful content, which leads to potential jailbreaking attacks in two scenarios: the integration of harmful texts within crowdsourced data used for pre-training…

Cryptography and Security · Computer Science 2024-06-03 Xiaoqun Liu , Jiacheng Liang , Muchao Ye , Zhaohan Xi

Large Language Models (LLMs) have performed exceptionally in various text-generative tasks, including question answering, translation, code completion, etc. However, the over-assistance of LLMs has raised the challenge of "jailbreaking",…

Cryptography and Security · Computer Science 2024-09-02 Sibo Yi , Yule Liu , Zhen Sun , Tianshuo Cong , Xinlei He , Jiaxing Song , Ke Xu , Qi Li