中文
相关论文

相关论文: Segment-Level Coherence for Robust Harmful Intent …

200 篇论文

Large language models (LLMs) increasingly operate in multi-agent and safety-critical settings, raising open questions about how their vulnerabilities scale when models interact adversarially. This study examines whether larger models can…

机器学习 · 计算机科学 2026-01-05 Samuel Nathanson , Rebecca Williams , Cynthia Matuszek

Ensuring the safety and alignment of Large Language Models is a significant challenge with their growing integration into critical applications and societal functions. While prior research has primarily focused on jailbreak attacks, less…

机器学习 · 计算机科学 2026-04-28 Jiawei Chen , Zhengwei Fang , Yu Tian , Jiawei Du , Chao Yu , Zhaoxia Yin , Hang Su

Multimodal large language models (MLLMs) exhibit remarkable capabilities but remain susceptible to jailbreak attacks exploiting cross-modal vulnerabilities. In this work, we introduce a novel method that leverages sequential comic-style…

密码学与安全 · 计算机科学 2025-10-20 Deyue Zhang , Dongdong Yang , Junjie Mu , Quancheng Zou , Zonghao Ying , Wenzhuo Xu , Zhao Liu , Xuan Wang , Xiangzheng Zhang

In deployment and application, large language models (LLMs) typically undergo safety alignment to prevent illegal and unethical outputs. However, the continuous advancement of jailbreak attack techniques, designed to bypass safety…

密码学与安全 · 计算机科学 2025-09-05 Chuhan Zhang , Ye Zhang , Bowen Shi , Yuyou Gan , Tianyu Du , Shouling Ji , Dazhan Deng , Yingcai Wu

The growing integration of Large Language Models (LLMs) into critical societal domains has raised concerns about embedded biases that can perpetuate stereotypes and undermine fairness. Such biases may stem from historical inequalities in…

计算与语言 · 计算机科学 2025-10-17 Riccardo Cantini , Alessio Orsino , Massimo Ruggiero , Domenico Talia

As large language models (LLMs) are increasingly deployed in critical applications, ensuring their robustness and safety alignment remains a major challenge. Despite the overall success of alignment techniques such as reinforcement learning…

机器学习 · 计算机科学 2025-08-21 Sajib Biswas , Mao Nishino , Samuel Jacob Chacko , Xiuwen Liu

Malware is becoming increasingly complex and widespread, making it essential to develop more effective and timely detection methods. Traditional static analysis often fails to defend against modern threats that employ code obfuscation,…

机器学习 · 计算机科学 2025-09-19 Wadduwage Shanika Perera , Haodi Jiang

As Large Language Models (LLMs) become ubiquitous, the challenge of securing them against adversarial "jailbreaking" attacks has intensified. Current defense strategies often rely on computationally expensive external classifiers or brittle…

机器学习 · 计算机科学 2025-12-17 Md. Hasib Ur Rahman

Large language models remain vulnerable to jailbreak attacks, yet we still lack a systematic understanding of how jailbreak success scales with attacker effort across methods, model families, and harm types. We initiate a scaling-law…

机器学习 · 计算机科学 2026-03-20 Xiangwen Wang , Ananth Balashankar , Varun Chandrasekaran

Large language models(LLMs) excel at text generation and knowledge question-answering tasks, but they are prone to generating hallucinated content, severely limiting their application in high-risk domains. Current hallucination detection…

计算与语言 · 计算机科学 2025-12-25 Shize Liang , Hongzhi Wang

Jailbreak attacks pose a serious threat to Large Language Models (LLMs) by bypassing their safety mechanisms. A truly advanced jailbreak is defined not only by its effectiveness but, more critically, by its stealthiness. However, existing…

密码学与安全 · 计算机科学 2026-03-13 Jianing Geng , Biao Yi , Zekun Fei , Ruiqi He , Lihai Nie , Tong Li , Zheli Liu

Large Language Models (LLMs) have achieved remarkable success across diverse tasks, yet they remain vulnerable to adversarial attacks, notably the well-known jailbreak attack. In particular, the Greedy Coordinate Gradient (GCG) attack has…

机器学习 · 计算机科学 2025-03-04 Yihao Zhang , Zeming Wei

Recently, Large Reasoning Models (LRMs) have demonstrated superior logical capabilities compared to traditional Large Language Models (LLMs), gaining significant attention. Despite their impressive performance, the potential for stronger…

计算与语言 · 计算机科学 2025-05-27 Viet-Anh Nguyen , Shiqian Zhao , Gia Dao , Runyi Hu , Yi Xie , Luu Anh Tuan

The rapid advancement of large language models (LLMs) has brought significant benefits to various domains while introducing substantial risks. Despite being fine-tuned through reinforcement learning, LLMs lack the capability to discern…

计算与语言 · 计算机科学 2025-04-15 Weilong Dong , Peiguang Li , Yu Tian , Xinyi Zeng , Fengdi Li , Sirui Wang

Ensuring robust safety measures across a wide range of scenarios is crucial for user-facing systems. While Large Language Models (LLMs) can generate valuable data for safety measures, they often exhibit distributional biases, focusing on…

计算与语言 · 计算机科学 2024-10-16 Sabit Hassan , Anthony Sicilia , Malihe Alikhani

Large Language Models (LLMs) have achieved remarkable success in various domains but remain vulnerable to adversarial jailbreak attacks. Existing prompt-defense strategies, including parameter-modifying and parameter-free approaches, face…

密码学与安全 · 计算机科学 2025-02-20 Ziyi Ni , Hao Wang , Huacan Wang

We address the challenge of generating diverse attack prompts for large language models (LLMs) that elicit harmful behaviors (e.g., insults, sexual content) and are used for safety fine-tuning. Rather than relying on manual prompt…

机器学习 · 计算机科学 2025-10-07 Taeyoung Yun , Pierre-Luc St-Charles , Jinkyoo Park , Yoshua Bengio , Minsu Kim

As large language models (LLMs) become more integral to society and technology, ensuring their safety becomes essential. Jailbreak attacks exploit vulnerabilities to bypass safety guardrails, posing a significant threat. However, the…

密码学与安全 · 计算机科学 2025-07-08 Xiaomeng Hu , Pin-Yu Chen , Tsung-Yi Ho

Safety evaluations of large language models (LLMs) typically report binary outcomes, i.e. attack success rate (ASR), refusal rate, or harmful versus safe classification, which hide how risk changes between prompt and response. We present a…

计算与语言 · 计算机科学 2026-05-21 Mengya Hu , Qiong Wei , Sandeep Atluri

Large Language Models (LLMs) have demonstrated exceptional performance across various tasks, but their security vulnerabilities can be exploited by attackers to generate harmful content, causing adverse impacts across various societal…

密码学与安全 · 计算机科学 2025-12-17 Fan Yang