中文
相关论文

相关论文: Structured Semantic Cloaking for Jailbreak Attacks…

200 篇论文

The adoption of large language models (LLMs) in many applications, from customer service chat bots and software development assistants to more capable agentic systems necessitates research into how to secure these systems. Attacks like…

密码学与安全 · 计算机科学 2024-12-03 Erick Galinkin , Martin Sablotny

Scaling test-time computation--generating and analyzing multiple or sequential outputs for a single input--has become a promising strategy for improving the reliability and quality of large language models (LLMs), as evidenced by advances…

计算与语言 · 计算机科学 2025-06-03 Sungjae Lee , Hoyoung Kim , Jeongyeon Hwang , Eunhyeok Park , Jungseul Ok

With the increasingly deep integration of large language models (LLMs) across diverse domains, the effectiveness of their safety mechanisms is encountering severe challenges. Currently, jailbreak attacks based on prompt engineering have…

密码学与安全 · 计算机科学 2025-09-23 Yu-Hang Wu , Yu-Jie Xiong , Hao Zhang , Jia-Chen Zhang , Zheng Zhou

Multimodal Large Language Models (MLLMs) excel at structural reasoning yet suffer from a sharp logical brittleness in structural consistency. We term this phenomenon Structural Cognitive Overload (SCO), a byproduct of the contention between…

人工智能 · 计算机科学 2026-05-26 Yang Luo , Xinran Liu , Tiantian Ji , Zhiyi Yin , Lingyun Peng , Shuyu Li

As Large Language Models (LLMs) are increasingly deployed in sensitive domains, traditional data privacy measures prove inadequate for protecting information that is implicit, contextual, or inferable - what we define as semantic privacy.…

密码学与安全 · 计算机科学 2025-07-17 Baihe Ma , Yanna Jiang , Xu Wang , Guangsheng Yu , Qin Wang , Caijun Sun , Chen Li , Xuelei Qi , Ying He , Wei Ni , Ren Ping Liu

Automated vulnerability detection in critical-infrastructure software confronts a fundamental barrier: industrial software is routinely deployed as stripped, symbol-free binaries that deprive conventional Software Composition Analysis of…

软件工程 · 计算机科学 2026-05-11 Bowei Ning , Xuejun Zong , Lian Lian , Kan He , Yifei Sun , Yuxiang Lei , Plamen Vasilev

Recently, Large Reasoning Models (LRMs) have demonstrated superior logical capabilities compared to traditional Large Language Models (LLMs), gaining significant attention. Despite their impressive performance, the potential for stronger…

计算与语言 · 计算机科学 2025-05-27 Viet-Anh Nguyen , Shiqian Zhao , Gia Dao , Runyi Hu , Yi Xie , Luu Anh Tuan

Defending large language models (LLMs) against jailbreak attacks is essential for their safe and reliable deployment. Existing defenses often rely on shallow pattern matching, which struggles to generalize to novel and unseen attack…

人工智能 · 计算机科学 2025-08-06 Rui Pu , Chaozhuo Li , Rui Ha , Litian Zhang , Lirong Qiu , Xi Zhang

Large language models (LLMs) have demonstrated remarkable capabilities across diverse applications, however, they remain critically vulnerable to jailbreak attacks that elicit harmful responses violating human values and safety guidelines.…

密码学与安全 · 计算机科学 2026-01-12 Zhaoqi Wang , Zijian Zhang , Daqing He , Pengtao Kou , Xin Li , Jiamou Liu , Jincheng An , Yong Liu

Decompositional jailbreaks pose a critical threat to large language models (LLMs) by allowing adversaries to fragment a malicious objective into a sequence of individually benign queries that collectively reconstruct prohibited content. In…

密码学与安全 · 计算机科学 2026-05-01 Bowen Sun , Chaozhuo Li , Yaodong Yang , Yiwei Wang , Chaowei Xiao

Large Language Models (LLMs) remain vulnerable to multi-turn jailbreak attacks. We introduce HarmNet, a modular framework comprising ThoughtNet, a hierarchical semantic network; a feedback-driven Simulator for iterative query refinement;…

密码学与安全 · 计算机科学 2025-10-22 Sidhant Narula , Javad Rafiei Asl , Mohammad Ghasemigol , Eduardo Blanco , Daniel Takabi

Despite their superb capabilities, Vision-Language Models (VLMs) have been shown to be vulnerable to jailbreak attacks. While recent jailbreaks have achieved notable progress, their effectiveness and efficiency can still be improved. In…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Yunhan Zhao , Xiang Zheng , Xingjun Ma

Large Language Models (LLMs) have demonstrated remarkable capabilities in various tasks. However, they remain exposed to jailbreak attacks, eliciting harmful responses. The nested scenario strategy has been increasingly adopted across…

密码学与安全 · 计算机科学 2025-11-18 Ning Xu , Bo Gao , Hui Dou

Large language models (LLMs) have achieved impressive performance across natural language tasks and are increasingly deployed in real-world applications. Despite extensive safety alignment efforts, recent studies show that such alignment is…

人工智能 · 计算机科学 2026-02-02 Yinzhi Zhao , Ming Wang , Shi Feng , Xiaocui Yang , Daling Wang , Yifei Zhang

Jailbreaks on large language models (LLMs) have recently received increasing attention. For a comprehensive assessment of LLM safety, it is essential to consider jailbreaks with diverse attributes, such as contextual coherence and…

机器学习 · 计算机科学 2024-06-10 Xingang Guo , Fangxu Yu , Huan Zhang , Lianhui Qin , Bin Hu

Despite extensive safety-tuning, large language models (LLMs) remain vulnerable to jailbreak attacks via adversarially crafted instructions, reflecting a persistent trade-off between safety and task performance. In this work, we propose…

密码学与安全 · 计算机科学 2025-08-26 Wei Jie Yeo , Ranjan Satapathy , Erik Cambria

Ensuring the safety and alignment of large language models (LLMs) with human values is crucial for generating responses that are beneficial to humanity. While LLMs have the capability to identify and avoid harmful queries, they remain…

计算与语言 · 计算机科学 2024-10-22 Yihua Zhou , Xiaochuan Shi

As large language models (LLMs) grow more capable, they face growing vulnerability to sophisticated jailbreak attacks. While developers invest heavily in alignment finetuning and safety guardrails, researchers continue publishing novel…

密码学与安全 · 计算机科学 2025-08-14 Boyuan Chen , Minghao Shao , Abdul Basit , Siddharth Garg , Muhammad Shafique

Large Language Models (LLMs) are increasingly integrated into real-world applications, from virtual assistants to autonomous agents. However, their flexibility also introduces new attack vectors-particularly Prompt Injection (PI), where…

密码学与安全 · 计算机科学 2025-09-17 Mengxiao Wang , Yuxuan Zhang , Guofei Gu

As Large Language Models (LLMs) are widely applied in various domains, the safety of LLMs is increasingly attracting attention to avoid their powerful capabilities being misused. Existing jailbreak methods create a forced…

计算与语言 · 计算机科学 2025-06-02 Yuting Huang , Chengyuan Liu , Yifeng Feng , Yiquan Wu , Chao Wu , Fei Wu , Kun Kuang