中文
相关论文

相关论文: How Many Iterations to Jailbreak? Dynamic Budget A…

200 篇论文

Jailbreak vulnerabilities in Large Language Models (LLMs) refer to methods that extract malicious content from the model by carefully crafting prompts or suffixes, which has garnered significant attention from the research community.…

密码学与安全 · 计算机科学 2024-09-13 Lijia Lv , Weigang Zhang , Xuehai Tang , Jie Wen , Feng Liu , Jizhong Han , Songlin Hu

The adoption of large language models (LLMs) in many applications, from customer service chat bots and software development assistants to more capable agentic systems necessitates research into how to secure these systems. Attacks like…

密码学与安全 · 计算机科学 2024-12-03 Erick Galinkin , Martin Sablotny

Large language models (LLMs) have achieved remarkable capabilities but remain vulnerable to adversarial prompts known as jailbreaks, which can bypass safety alignment and elicit harmful outputs. Despite growing efforts in LLM safety…

密码学与安全 · 计算机科学 2025-05-27 Guobin Shen , Dongcheng Zhao , Linghao Feng , Xiang He , Jihang Wang , Sicheng Shen , Haibo Tong , Yiting Dong , Jindong Li , Xiang Zheng , Yi Zeng

With the rapid advancement of large language models (LLMs), the safety of LLMs has become a critical concern. Despite significant efforts in safety alignment, current LLMs remain vulnerable to jailbreaking attacks. However, the root causes…

人工智能 · 计算机科学 2026-03-10 Yonghong Deng , Zhen Yang , Ping Jian , Xinyue Zhang , Zhongbin Guo , Chengzhi Li

Manufacturing industries are facing increasing product variability due to the growing demand for personalized products. Under these conditions, ensuring safety becomes challenging as frequent reconfigurations can lead to unintended…

多智能体系统 · 计算机科学 2026-04-21 Jonghan Lim , Mostafa Tavakkoli Anbarani , Rômulo Meira-Góes , Ilya Kovalenko

We introduce Tempest, a multi-turn adversarial framework that models the gradual erosion of Large Language Model (LLM) safety through a tree search perspective. Unlike single-turn jailbreaks that rely on one meticulously engineered prompt,…

人工智能 · 计算机科学 2025-05-29 Andy Zhou , Ron Arel

Long-term memory (LTM) is essential for large language models (LLMs) to achieve autonomous intelligence in complex, evolving environments. Despite increasing efforts in memory-augmented and retrieval-based architectures, there remains a…

计算与语言 · 计算机科学 2025-06-17 Luanbo Wan , Weizhi Ma

We present a framework in which a large language model (LLM) acts as an online adaptive controller for SIMP topology optimization, replacing conventional fixed-schedule continuation with real-time, state-conditioned parameter decisions. At…

计算工程、金融与科学 · 计算机科学 2026-05-18 Shaoliang Yang , Jun Wang , Yunsheng Wang

Jailbreak attacks pose significant threats to large language models (LLMs), enabling attackers to bypass safeguards. However, existing reactive defense approaches struggle to keep up with the rapidly evolving multi-turn jailbreaks, where…

密码学与安全 · 计算机科学 2026-01-08 Siyuan Li , Xi Lin , Jun Wu , Zehao Liu , Haoyu Li , Tianjie Ju , Xiang Chen , Jianhua Li

Large language models (LLMs) are promising tools for supporting security management tasks, such as incident response planning. However, their unreliability and tendency to hallucinate remain significant challenges. In this paper, we address…

人工智能 · 计算机科学 2026-02-06 Kim Hammar , Tansu Alpcan , Emil Lupu

Despite efforts to align large language models (LLMs) with human intentions, widely-used LLMs such as GPT, Llama, and Claude are susceptible to jailbreaking attacks, wherein an adversary fools a targeted LLM into generating objectionable…

机器学习 · 计算机科学 2024-06-17 Alexander Robey , Eric Wong , Hamed Hassani , George J. Pappas

Large language models (LLMs) are widely used in real-world applications, raising concerns about their safety and trustworthiness. While red-teaming with jailbreak prompts exposes the vulnerabilities of LLMs, current efforts focus primarily…

计算与语言 · 计算机科学 2025-11-14 Yi Zhao , Youzhi Zhang

Despite their superior performance on a wide range of domains, large language models (LLMs) remain vulnerable to misuse for generating harmful content, a risk that has been further amplified by various jailbreak attacks. Existing jailbreak…

密码学与安全 · 计算机科学 2025-10-27 Yukun Jiang , Mingjie Li , Michael Backes , Yang Zhang

The rapid advancement of Large Language Models (LLMs) has introduced significant challenges in moderating user-model interactions. While LLMs demonstrate remarkable capabilities, they remain vulnerable to adversarial attacks, particularly…

How should we evaluate the robustness of language model defenses? Current defenses against jailbreaks and prompt injections (which aim to prevent an attacker from eliciting harmful knowledge or remotely triggering malicious actions,…

Adaptive reward design for deep reinforcement learning (DRL) in multi-beam LEO satellite scheduling is motivated by the intuition that regime-aware reward weights should outperform static ones. We systematically test this intuition and…

人工智能 · 计算机科学 2026-04-07 Yuanhang Li

Large Language Models (LLMs) tend to respond correctly to prompts that align well with the data they were trained and fine-tuned on. Yet, small shifts in wording, format, or language can trigger surprisingly large failures, especially on…

机器学习 · 计算机科学 2026-05-12 Yeping Jin , Jiaming Hu , Ioannis Ch. Paschalidis

LLM-enabled robots prioritizing scarce assistance in social settings face pluralistic values and LLM behavioral variability: reasonable people can disagree about who is helped first, while LLM-mediated interaction policies vary across…

人工智能 · 计算机科学 2026-03-18 Carmen Ng

Multimodal Large Language Models (MLLMs) bridge the gap between visual and textual data, enabling a range of advanced applications. However, complex internal interactions among visual elements and their alignment with text can introduce…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Zuopeng Yang , Jiluan Fan , Anli Yan , Erdun Gao , Xin Lin , Tao Li , Kanghua Mo , Changyu Dong

Strategic decision-making in multi-agent settings is a key challenge for large language models (LLMs), particularly when coordination and negotiation must unfold over extended conversations. While recent work has explored the use of LLMs in…

计算与语言 · 计算机科学 2026-01-26 Victor Conchello Vendrell , Max Ruiz Luyten , Mihaela van der Schaar