English
Related papers

Related papers: How Many Iterations to Jailbreak? Dynamic Budget A…

200 papers

Jailbreak vulnerabilities in Large Language Models (LLMs) refer to methods that extract malicious content from the model by carefully crafting prompts or suffixes, which has garnered significant attention from the research community.…

Cryptography and Security · Computer Science 2024-09-13 Lijia Lv , Weigang Zhang , Xuehai Tang , Jie Wen , Feng Liu , Jizhong Han , Songlin Hu

The adoption of large language models (LLMs) in many applications, from customer service chat bots and software development assistants to more capable agentic systems necessitates research into how to secure these systems. Attacks like…

Cryptography and Security · Computer Science 2024-12-03 Erick Galinkin , Martin Sablotny

Large language models (LLMs) have achieved remarkable capabilities but remain vulnerable to adversarial prompts known as jailbreaks, which can bypass safety alignment and elicit harmful outputs. Despite growing efforts in LLM safety…

Cryptography and Security · Computer Science 2025-05-27 Guobin Shen , Dongcheng Zhao , Linghao Feng , Xiang He , Jihang Wang , Sicheng Shen , Haibo Tong , Yiting Dong , Jindong Li , Xiang Zheng , Yi Zeng

With the rapid advancement of large language models (LLMs), the safety of LLMs has become a critical concern. Despite significant efforts in safety alignment, current LLMs remain vulnerable to jailbreaking attacks. However, the root causes…

Artificial Intelligence · Computer Science 2026-03-10 Yonghong Deng , Zhen Yang , Ping Jian , Xinyue Zhang , Zhongbin Guo , Chengzhi Li

Manufacturing industries are facing increasing product variability due to the growing demand for personalized products. Under these conditions, ensuring safety becomes challenging as frequent reconfigurations can lead to unintended…

Multiagent Systems · Computer Science 2026-04-21 Jonghan Lim , Mostafa Tavakkoli Anbarani , Rômulo Meira-Góes , Ilya Kovalenko

We introduce Tempest, a multi-turn adversarial framework that models the gradual erosion of Large Language Model (LLM) safety through a tree search perspective. Unlike single-turn jailbreaks that rely on one meticulously engineered prompt,…

Artificial Intelligence · Computer Science 2025-05-29 Andy Zhou , Ron Arel

Long-term memory (LTM) is essential for large language models (LLMs) to achieve autonomous intelligence in complex, evolving environments. Despite increasing efforts in memory-augmented and retrieval-based architectures, there remains a…

Computation and Language · Computer Science 2025-06-17 Luanbo Wan , Weizhi Ma

We present a framework in which a large language model (LLM) acts as an online adaptive controller for SIMP topology optimization, replacing conventional fixed-schedule continuation with real-time, state-conditioned parameter decisions. At…

Computational Engineering, Finance, and Science · Computer Science 2026-05-18 Shaoliang Yang , Jun Wang , Yunsheng Wang

Jailbreak attacks pose significant threats to large language models (LLMs), enabling attackers to bypass safeguards. However, existing reactive defense approaches struggle to keep up with the rapidly evolving multi-turn jailbreaks, where…

Cryptography and Security · Computer Science 2026-01-08 Siyuan Li , Xi Lin , Jun Wu , Zehao Liu , Haoyu Li , Tianjie Ju , Xiang Chen , Jianhua Li

Large language models (LLMs) are promising tools for supporting security management tasks, such as incident response planning. However, their unreliability and tendency to hallucinate remain significant challenges. In this paper, we address…

Artificial Intelligence · Computer Science 2026-02-06 Kim Hammar , Tansu Alpcan , Emil Lupu

Despite efforts to align large language models (LLMs) with human intentions, widely-used LLMs such as GPT, Llama, and Claude are susceptible to jailbreaking attacks, wherein an adversary fools a targeted LLM into generating objectionable…

Machine Learning · Computer Science 2024-06-17 Alexander Robey , Eric Wong , Hamed Hassani , George J. Pappas

Large language models (LLMs) are widely used in real-world applications, raising concerns about their safety and trustworthiness. While red-teaming with jailbreak prompts exposes the vulnerabilities of LLMs, current efforts focus primarily…

Computation and Language · Computer Science 2025-11-14 Yi Zhao , Youzhi Zhang

Despite their superior performance on a wide range of domains, large language models (LLMs) remain vulnerable to misuse for generating harmful content, a risk that has been further amplified by various jailbreak attacks. Existing jailbreak…

Cryptography and Security · Computer Science 2025-10-27 Yukun Jiang , Mingjie Li , Michael Backes , Yang Zhang

The rapid advancement of Large Language Models (LLMs) has introduced significant challenges in moderating user-model interactions. While LLMs demonstrate remarkable capabilities, they remain vulnerable to adversarial attacks, particularly…

Cryptography and Security · Computer Science 2025-02-14 Ivan Bakulin , Ilia Kopanichuk , Iaroslav Bespalov , Nikita Radchenko , Vladimir Shaposhnikov , Dmitry Dylov , Ivan Oseledets

How should we evaluate the robustness of language model defenses? Current defenses against jailbreaks and prompt injections (which aim to prevent an attacker from eliciting harmful knowledge or remotely triggering malicious actions,…

Adaptive reward design for deep reinforcement learning (DRL) in multi-beam LEO satellite scheduling is motivated by the intuition that regime-aware reward weights should outperform static ones. We systematically test this intuition and…

Artificial Intelligence · Computer Science 2026-04-07 Yuanhang Li

Large Language Models (LLMs) tend to respond correctly to prompts that align well with the data they were trained and fine-tuned on. Yet, small shifts in wording, format, or language can trigger surprisingly large failures, especially on…

Machine Learning · Computer Science 2026-05-12 Yeping Jin , Jiaming Hu , Ioannis Ch. Paschalidis

LLM-enabled robots prioritizing scarce assistance in social settings face pluralistic values and LLM behavioral variability: reasonable people can disagree about who is helped first, while LLM-mediated interaction policies vary across…

Artificial Intelligence · Computer Science 2026-03-18 Carmen Ng

Multimodal Large Language Models (MLLMs) bridge the gap between visual and textual data, enabling a range of advanced applications. However, complex internal interactions among visual elements and their alignment with text can introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Zuopeng Yang , Jiluan Fan , Anli Yan , Erdun Gao , Xin Lin , Tao Li , Kanghua Mo , Changyu Dong

Strategic decision-making in multi-agent settings is a key challenge for large language models (LLMs), particularly when coordination and negotiation must unfold over extended conversations. While recent work has explored the use of LLMs in…

Computation and Language · Computer Science 2026-01-26 Victor Conchello Vendrell , Max Ruiz Luyten , Mihaela van der Schaar