English
Related papers

Related papers: Spot Risks Before Speaking! Unraveling Safety Atte…

200 papers

The rapid advancement of Large Vision-Language Models (LVLMs) has enhanced capabilities offering potential applications from content creation to productivity enhancement. Despite their innovative potential, LVLMs exhibit vulnerabilities,…

Cryptography and Security · Computer Science 2025-01-17 Abdulkadir Erol , Trilok Padhi , Agnik Saha , Ugur Kursuncu , Mehmet Emin Aktas

Large Vision-Language Models (LVLMs) unlock powerful multimodal reasoning but also expand the attack surface, particularly through adversarial inputs that conceal harmful goals in benign prompts. We propose SHIELD, a lightweight,…

Computation and Language · Computer Science 2025-10-16 Juan Ren , Mark Dras , Usman Naseem

The proliferation of Large Language Models (LLMs) has introduced critical security challenges, where adversarial actors can manipulate input prompts to cause significant harm and circumvent safety alignments. These prompt-based attacks…

While Multimodal Large Language Models (MLLMs) have made remarkable progress in vision-language reasoning, they are also more susceptible to producing harmful content compared to models that focus solely on text. Existing defensive…

Computation and Language · Computer Science 2024-12-30 Yilei Jiang , Yingshui Tan , Xiangyu Yue

Despite the impressive capabilities of Large Language Models (LLMs) in various tasks, their vulnerability to unsafe prompts remains a critical issue. These prompts can lead LLMs to generate responses on illegal or sensitive topics, posing a…

Computation and Language · Computer Science 2024-07-10 Jinseok Kim , Jaewon Jung , Sangyeop Kim , Sohyung Park , Sungzoon Cho

Large language models (LLMs) exhibit exceptional capabilities across various tasks but also pose risks by generating harmful content. Existing safety mechanisms, while improving model safety, often lead to overly cautious behavior and fail…

Machine Learning · Computer Science 2025-09-16 Peixuan Han , Cheng Qian , Xiusi Chen , Yuji Zhang , Heng Ji , Denghui Zhang

High-risk industries like nuclear and aviation use real-time monitoring to detect dangerous system conditions. Similarly, Large Language Models (LLMs) need monitoring safeguards. We propose a real-time framework to predict harmful AI…

Artificial Intelligence · Computer Science 2025-05-21 Maheep Chaudhary , Fazl Barez

Large Language Models face security threats from jailbreak attacks. Existing research has predominantly focused on prompt-level attacks while largely ignoring the underexplored attack surface of user-controlled response prefilling. This…

Cryptography and Security · Computer Science 2025-08-27 Yakai Li , Jiekang Hu , Weiduan Sang , Luping Ma , Dongsheng Nie , Weijuan Zhang , Aimin Yu , Yi Su , Qingjia Huang , Qihang Zhou

Large Language Models (LLMs) presents significant priority in text understanding and generation. However, LLMs suffer from the risk of generating harmful contents especially while being employed to applications. There are several black-box…

Computation and Language · Computer Science 2023-12-11 Chengyuan Liu , Fubang Zhao , Lizhi Qing , Yangyang Kang , Changlong Sun , Kun Kuang , Fei Wu

Large Language Models (LLMs) are vulnerable to attacks like prompt injection, backdoor attacks, and adversarial attacks, which manipulate prompts or models to generate harmful outputs. In this paper, departing from traditional deep learning…

Computation and Language · Computer Science 2025-02-19 Huawei Lin , Yingjie Lao , Tong Geng , Tan Yu , Weijie Zhao

Large Language Models (LLMs) are vulnerable to adversarial prompt based injects. These injects could jailbreak or exploit vulnerabilities within these models with explicit prompt requests leading to undesired responses. In the context of…

Cryptography and Security · Computer Science 2025-02-18 Jonathan Pan , Swee Liang Wong , Yidi Yuan , Xin Wei Chia

Large Language Models (LLMs) have seen rapid adoption in recent years, with industries increasingly relying on them to maintain a competitive advantage. These models excel at interpreting user instructions and generating human-like…

Cryptography and Security · Computer Science 2025-09-09 Andrew Yeo , Daeseon Choi

Vision-Language Models (VLMs) face significant safety vulnerabilities from malicious prompt attacks due to weakened alignment during visual integration. Existing defenses suffer from efficiency and robustness. To address these challenges,…

Machine Learning · Computer Science 2026-04-09 Peigui Qi , Kunsheng Tang , Yanpu Yu , Jialin Wu , Yide Song , Wenbo Zhou , Zhicong Huang , Cheng Hong , Weiming Zhang , Nenghai Yu

Large vision-language models (LVLMs) have achieved remarkable progress in vision-language reasoning tasks, yet ensuring their safety remains a critical challenge. Recent input-side defenses detect unsafe images with CLIP and prepend safety…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xingyu Zhu , Beier Zhu , Junfeng Fang , Shuo Wang , Yin Zhang , Xiang Wang , Xiangnan He

The recent emergence of multimodal large language models (LLMs) has introduced new opportunities for improving visual hazard recognition on construction sites. Unlike traditional computer vision models that rely on domain-specific training…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Nishi Chaudhary , S M Jamil Uddin , Sathvik Sharath Chandra , Anto Ovid , Alex Albert

Large Reasoning Models (LRMs) introduce a new generation paradigm of explicitly reasoning before answering, leading to remarkable improvements in complex tasks. However, they pose great safety risks against harmful queries and adversarial…

Artificial Intelligence · Computer Science 2025-11-18 Kaiwen Zhou , Xuandong Zhao , Gaowen Liu , Jayanth Srinivasa , Aosong Feng , Dawn Song , Xin Eric Wang

Large language models (LLMs) have demonstrated immense utility across various industries. However, as LLMs advance, the risk of harmful outputs increases due to incorrect or malicious instruction prompts. While current methods effectively…

Computation and Language · Computer Science 2025-06-19 Xinyi Zeng , Yuying Shang , Jiawei Chen , Jingyuan Zhang , Yu Tian

Safety evaluations of large language models (LLMs) typically report binary outcomes, i.e. attack success rate (ASR), refusal rate, or harmful versus safe classification, which hide how risk changes between prompt and response. We present a…

Computation and Language · Computer Science 2026-05-21 Mengya Hu , Qiong Wei , Sandeep Atluri

The emerging capabilities of large language models (LLMs) have sparked concerns about their immediate potential for harmful misuse. The core approach to mitigate these concerns is the detection of harmful queries to the model. Current…

Computation and Language · Computer Science 2025-12-10 Sahil Verma , Keegan Hines , Jeff Bilmes , Charlotte Siska , Luke Zettlemoyer , Hila Gonen , Chandan Singh

While the widespread deployment of Large Language Models (LLMs) holds great potential for society, their vulnerabilities to adversarial manipulation and exploitation can pose serious safety, security, and ethical risks. As new threats…

Cryptography and Security · Computer Science 2025-09-29 Charankumar Akiri , Harrison Simpson , Kshitiz Aryal , Aarav Khanna , Maanak Gupta