中文
相关论文

相关论文: Same Model, Different Weakness: How Language and M…

200 篇论文

Despite inheriting security measures from underlying language models, Vision-Language Models (VLMs) may still be vulnerable to safety alignment issues. Through empirical analysis, we uncover two critical findings: scenario-matched images…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Shuyang Hao , Bryan Hooi , Jun Liu , Kai-Wei Chang , Zi Huang , Yujun Cai

Large Language Models (LLMs) are increasingly integrated into consumer and enterprise applications. Despite their capabilities, they remain susceptible to adversarial attacks such as prompt injection and jailbreaks that override alignment…

密码学与安全 · 计算机科学 2025-05-14 Chetan Pathade

Large Vision-Language Models (LVLMs) demonstrate exceptional performance across multimodal tasks, yet remain vulnerable to jailbreak attacks that bypass built-in safety mechanisms to elicit restricted content generation. Existing black-box…

计算与语言 · 计算机科学 2025-06-23 Lei Jiang , Zixun Zhang , Zizhou Wang , Xiaobing Sun , Zhen Li , Liangli Zhen , Xiaohua Xu

Jailbreak attacks cause large language models (LLMs) to generate harmful, unethical, or otherwise objectionable content. Evaluating these attacks presents a number of challenges, which the current collection of benchmarks and evaluation…

Large language models (LLMs) excel in diverse applications but face dual challenges: generating harmful content under jailbreak attacks and over-refusal of benign queries due to rigid safety mechanisms. These issues are further complicated…

人工智能 · 计算机科学 2025-11-04 Yifan Xia , Guorui Chen , Wenqian Yu , Zhijiang Li , Philip Torr , Jindong Gu

Large Multimodal Models (LMMs) have demonstrated the ability to interact with humans under real-world conditions by combining Large Language Models (LLMs) and modality encoders to align multimodal information (visual and auditory) with…

计算与语言 · 计算机科学 2024-11-01 Hao Yang , Lizhen Qu , Ehsan Shareghi , Gholamreza Haffari

The integration of new modalities into frontier AI systems offers exciting capabilities, but also increases the possibility such systems can be adversarially manipulated in undesirable ways. In this work, we focus on a popular class of…

Security alignment enables the Large Language Model (LLM) to gain the protection against malicious queries, but various jailbreak attack methods reveal the vulnerability of this security mechanism. Previous studies have isolated LLM…

密码学与安全 · 计算机科学 2025-08-07 Xiaohu Li , Yunfeng Ning , Zepeng Bao , Mayi Xu , Jianhao Chen , Tieyun Qian

The vulnerability of Vision Large Language Models (VLLMs) to jailbreak attacks appears as no surprise. However, recent defense mechanisms against these attacks have reached near-saturation performance on benchmark evaluations, often with…

密码学与安全 · 计算机科学 2025-03-07 Yangyang Guo , Fangkai Jiao , Liqiang Nie , Mohan Kankanhalli

Large Language Models (LLMs) demonstrate complex responses to threat-based manipulations, revealing both vulnerabilities and unexpected performance enhancement opportunities. This study presents a comprehensive analysis of 3,390…

密码学与安全 · 计算机科学 2025-07-30 Atil Samancioglu

Although safely enhanced Large Language Models (LLMs) have achieved remarkable success in tackling various complex tasks in a zero-shot manner, they remain susceptible to jailbreak attacks, particularly the unknown jailbreak attack. To…

计算与语言 · 计算机科学 2024-06-12 Fan Liu , Zhao Xu , Hao Liu

Large language models (LLMs) have demonstrated remarkable capabilities across various applications, highlighting the urgent need for comprehensive safety evaluations. In particular, the enhanced Chinese language proficiency of LLMs,…

计算与语言 · 计算机科学 2025-02-27 Shuyi Liu , Simiao Cui , Haoran Bu , Yuming Shang , Xi Zhang

Large Language Models (LLMs) have gained considerable popularity and protected by increasingly sophisticated safety mechanisms. However, jailbreak attacks continue to pose a critical security threat by inducing models to generate…

密码学与安全 · 计算机科学 2025-12-23 Zehao Liu , Xi Lin

Prompt injection attacks exploit vulnerabilities in large language models (LLMs) to manipulate the model into unintended actions or generate malicious content. As LLM integrated applications gain wider adoption, they face growing…

密码学与安全 · 计算机科学 2024-01-03 Daniel Wankit Yip , Aysan Esmradi , Chun Fai Chan

Large language models (LLMs) are rapidly evolving from single-modal systems to multimodal LLMs and intelligent agents, significantly expanding their capabilities while introducing increasingly severe security risks. This paper presents a…

密码学与安全 · 计算机科学 2025-08-04 Yanxu Mao , Tiehan Cui , Peipei Liu , Datao You , Hongsong Zhu

Alignment tuning has enabled large language models to excel in reasoning, instruction-following, and minimizing harmful generations. However, despite their widespread deployment, these models exhibit a monolingual bias, raising concerns…

计算与语言 · 计算机科学 2025-04-04 Nikhil Verma , Manasa Bharadwaj

Large Language Models (LLMs) are susceptible to malicious influence by cyber attackers through intrusions such as adversarial, backdoor, and embedding inversion attacks. In response, the burgeoning field of LLM Security aims to study and…

计算与语言 · 计算机科学 2024-12-17 Yiyi Chen , Russa Biswas , Heather Lent , Johannes Bjerva

Large Language Models (LLMs) have demonstrated remarkable instruction-following capabilities across various applications. However, their performance in multilingual settings lacks systematic investigation, with existing evaluations lacking…

计算与语言 · 计算机科学 2025-11-04 Zhenyu Li , Kehai Chen , Yunfei Long , Xuefeng Bai , Yaoyin Zhang , Xuchen Wei , Juntao Li , Min Zhang

The rapid spread of multilingual misinformation requires robust automated fact verification systems capable of handling fine-grained veracity assessments across diverse languages. While large language models have shown remarkable…

计算与语言 · 计算机科学 2025-07-29 Hanna Shcharbakova , Tatiana Anikina , Natalia Skachkova , Josef van Genabith

This study evaluates the resilience of large language models (LLMs) against adversarial attacks, specifically focusing on Flan-T5, BERT, and RoBERTa-Base. Using systematically designed adversarial tests through TextFooler and BERTAttack, we…

密码学与安全 · 计算机科学 2025-09-15 Taniya Gidatkar , Oluwaseun Ajao , Matthew Shardlow