English
Related papers

Related papers: Red Teaming Multimodal Language Models: Evaluating…

200 papers

Many publicly available language models have been safety tuned to reduce the likelihood of toxic or liability-inducing text. To redteam or jailbreak these models for compliance with toxic requests, users and security analysts have developed…

Computation and Language · Computer Science 2024-10-02 T. Ben Thompson , Michael Sklar

Large language models (LLMs) are now deployed at unprecedented scale, assisting millions of users in daily tasks. However, the risk of these models assisting unlawful activities remains underexplored. In this study, we define this high-risk…

Computers and Society · Computer Science 2025-11-27 Xing Wang , Huiyuan Xie , Yiyan Wang , Chaojun Xiao , Huimin Chen , Holli Sargeant , Felix Steffek , Jie Shao , Zhiyuan Liu , Maosong Sun

Humans are prone to cognitive distortions -- biased thinking patterns that lead to exaggerated responses to specific stimuli, albeit in very different contexts. This paper demonstrates that advanced Multimodal Large Language Models (MLLMs)…

Computation and Language · Computer Science 2024-06-27 Xirui Li , Hengguang Zhou , Ruochen Wang , Tianyi Zhou , Minhao Cheng , Cho-Jui Hsieh

Large Language Models (LLMs) are increasingly used in intelligent systems that perform reasoning, summarization, and code generation. Their ability to follow natural-language instructions, while powerful, also makes them vulnerable to a new…

Cryptography and Security · Computer Science 2025-11-13 Daniyal Ganiuly , Assel Smaiyl

The remarkable advancements in Multimodal Large Language Models (MLLMs) have not rendered them immune to challenges, particularly in the context of handling deceptive information in prompts, thus producing hallucinated responses under such…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Yusu Qian , Haotian Zhang , Yinfei Yang , Zhe Gan

Large Language Models (LLMs) have gained increasing attention for their remarkable capacity, alongside concerns about safety arising from their potential to produce harmful content. Red teaming aims to find prompts that could elicit harmful…

Computation and Language · Computer Science 2025-02-25 Rui Li , Peiyi Wang , Jingyuan Ma , Di Zhang , Lei Sha , Zhifang Sui

Since Multimodal Large Language Models (MLLMs) are increasingly being integrated into everyday tools and intelligent agents, growing concerns have arisen regarding their possible output of unsafe contents, ranging from toxic language and…

Machine Learning · Computer Science 2026-04-08 Yuping Yan , Yuhan Xie , Yuanshuai Li , Yingchao Yu , Lingjuan Lyu , Yaochu Jin

Vision Large Language Models (VLLMs) represent a significant advancement in artificial intelligence by integrating image-processing capabilities with textual understanding, thereby enhancing user interactions and expanding application…

Computation and Language · Computer Science 2025-05-09 Madhur Jindal , Saurabh Deshpande

Large Multimodal Models (LMMs) have achieved great success recently, demonstrating a strong capability to understand multimodal information and to interact with human users. Despite the progress made, the challenge of detecting high-risk…

Computation and Language · Computer Science 2024-06-26 Hao Yang , Lizhen Qu , Ehsan Shareghi , Gholamreza Haffari

In recent years, Large Language Models have attracted growing interest for their significant potential, though concerns have rapidly emerged regarding unsafe behaviors stemming from inherent stereotypes and biases. Most research on…

Computation and Language · Computer Science 2025-03-06 Akito Nakanishi , Yukie Sano , Geng Liu , Francesco Pierri

Multimodal large language models (MLLMs) have become the cornerstone of today's generative AI ecosystem, sparking intense competition among tech giants and startups. In particular, an MLLM generates a text response given a prompt consisting…

Cryptography and Security · Computer Science 2024-09-09 Zedian Shao , Hongbin Liu , Yuepeng Hu , Neil Zhenqiang Gong

Safety lies at the core of developing and deploying large language models (LLMs). However, previous safety benchmarks only concern the safety in one language, e.g. the majority language in the pretraining data such as English. In this work,…

Computation and Language · Computer Science 2024-06-21 Wenxuan Wang , Zhaopeng Tu , Chang Chen , Youliang Yuan , Jen-tse Huang , Wenxiang Jiao , Michael R. Lyu

Large Language Models (LLMs) are integral to modern AI applications, but their safety alignment mechanisms can be bypassed through adversarial prompt engineering. This study investigates emoji-based jailbreaking, where emoji sequences are…

Cryptography and Security · Computer Science 2026-01-06 M P V S Gopinadh , S Mahaboob Hussain

Large Language Models (LLMs) become the start-of-the-art solutions for a variety of natural language tasks and are integrated into real-world applications. However, LLMs can be potentially harmful in manifesting undesirable safety issues…

Artificial Intelligence · Computer Science 2024-03-05 Zhuoer Xu , Jianping Zhang , Shiwen Cui , Changhua Meng , Weiqiang Wang

While large language models (LLMs) exhibit remarkable capabilities across a wide range of tasks, they pose potential safety concerns, such as the ``jailbreak'' problem, wherein malicious instructions can manipulate LLMs to exhibit…

Computation and Language · Computer Science 2024-03-05 Yue Deng , Wenxuan Zhang , Sinno Jialin Pan , Lidong Bing

Large language models (LLMs) are susceptible to red teaming attacks, which can induce LLMs to generate harmful content. Previous research constructs attack prompts via manual or automatic methods, which have their own limitations on…

Computation and Language · Computer Science 2023-10-20 Boyi Deng , Wenjie Wang , Fuli Feng , Yang Deng , Qifan Wang , Xiangnan He

Multimodal Large Language Models (MLLMs) extend text-only LLMs with visual reasoning, but also introduce new safety failure modes under visually grounded instructions. We study comic-template jailbreaks that embed harmful goals inside…

Cryptography and Security · Computer Science 2026-04-24 Rui Yang Tan , Yujia Hu , Roy Ka-Wei Lee

Large language models (LLMs) are being integrated into socially assistive robots (SARs) and other conversational agents providing mental health and well-being support. These agents are often designed to sound empathic and supportive in…

Human-Computer Interaction · Computer Science 2026-02-05 Himanshi Lalwani , Hanan Salam

Large Language Model (LLM) safety guardrail models have emerged as a primary defense mechanism against harmful content generation, yet their robustness against sophisticated adversarial attacks remains poorly characterized. This study…

Cryptography and Security · Computer Science 2025-12-01 Richard J. Young

Large language models (LLMs) have been used in many application domains, including cyber security. The application of LLMs in the cyber security domain presents significant opportunities, such as for enhancing threat analysis and malware…

Cryptography and Security · Computer Science 2025-09-18 Adel ElZemity , Budi Arief , Shujun Li