English
Related papers

Related papers: Red Teaming Multimodal Language Models: Evaluating…

200 papers

Nowadays, developers increasingly rely on solutions powered by Large Language Models (LLM) to assist them with their coding tasks. This makes it crucial to align these tools with human values to prevent malicious misuse. In this paper, we…

Software Engineering · Computer Science 2025-04-03 Ali Al-Kaswan , Sebastian Deatc , Begüm Koç , Arie van Deursen , Maliheh Izadi

Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to an LLMs can realize Vision Language Models (VLMs). However, existing research shows that the visual modality of VLMs…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhendong Liu , Yuanbi Nie , Yingshui Tan , Xiangyu Yue , Qiushi Cui , Chongjun Wang , Xiaoyong Zhu , Bo Zheng

With the rapid development of multimodal large language models (MLLMs), they are increasingly deployed as autonomous computer-use agents capable of accomplishing complex computer tasks. However, a pressing issue arises: Can the safety risk…

Artificial Intelligence · Computer Science 2025-06-23 Jingyi Yang , Shuai Shao , Dongrui Liu , Jing Shao

Large language models (LLMs) have profoundly transformed natural language applications, with a growing reliance on instruction-based definitions for designing chatbots. However, post-deployment the chatbot definitions are fixed and are…

Machine Learning · Computer Science 2024-02-20 Reshabh K Sharma , Vinayak Gupta , Dan Grossman

Multimodal Large Language Models (MLLMs) are susceptible to the implicit reasoning risk, wherein innocuous unimodal inputs synergistically assemble into risky multimodal data that produce harmful outputs. We attribute this vulnerability to…

Artificial Intelligence · Computer Science 2025-09-17 Wei Cai , Shujuan Liu , Jian Zhao , Ziyan Shi , Yusheng Zhao , Yuchen Yuan , Tianle Zhang , Chi Zhang , Xuelong Li

Large language models (LLMs) hold great potential for many natural language applications but risk generating incorrect or toxic content. To probe when an LLM generates unwanted content, the current paradigm is to recruit a \textit{red team}…

Embodied agents powered by large language models (LLMs) inherit advanced planning capabilities; however, their direct interaction with the physical world exposes them to safety vulnerabilities. In this work, we identify four key reasoning…

Artificial Intelligence · Computer Science 2025-10-01 Ruolin Chen , Yinqian Sun , Jihang Wang , Mingyang Lv , Qian Zhang , Yi Zeng

In this work, we designed unbiased prompts to systematically evaluate the psychological safety of large language models (LLMs). First, we tested five different LLMs by using two personality tests: Short Dark Triad (SD-3) and Big Five…

Computation and Language · Computer Science 2024-03-01 Xingxuan Li , Yutong Li , Lin Qiu , Shafiq Joty , Lidong Bing

As vision-language models (VLMs) gain prominence, their multimodal interfaces also introduce new safety vulnerabilities, making the safety evaluation challenging and critical. Existing red-teaming efforts are either restricted to a narrow…

Artificial Intelligence · Computer Science 2025-10-06 Zhaorun Chen , Xun Liu , Mintong Kang , Jiawei Zhang , Minzhou Pan , Shuang Yang , Bo Li

As large language models (LLMs) become integral to safety-critical applications, ensuring their robustness against adversarial prompts is paramount. However, existing red teaming datasets suffer from inconsistent risk categorizations,…

Computation and Language · Computer Science 2026-04-20 Quy-Anh Dang , Chris Ngo , Truong-Son Hy

While multimodal large language models (MLLMs) have achieved remarkable success in recent advancements, their susceptibility to jailbreak attacks has come to light. In such attacks, adversaries exploit carefully crafted prompts to coerce…

Cryptography and Security · Computer Science 2025-02-04 Ziyi Yin , Yuanpu Cao , Han Liu , Ting Wang , Jinghui Chen , Fenhlong Ma

Large language models (LLMs) are increasingly deployed behind safety guardrails such as system prompts and content filters, especially in settings where product teams cannot modify model weights. In practice these guardrails are typically…

Cryptography and Security · Computer Science 2025-12-19 Perry Abdulkadir

Short-video platforms have become major channels for misinformation, where deceptive claims frequently leverage visual experiments and social cues. While Multimodal Large Language Models (MLLMs) have demonstrated impressive reasoning…

Computation and Language · Computer Science 2026-05-19 Jen-tse Huang , Chang Chen , Shiyang Lai , Wenxuan Wang , Michelle R. Kaufman , Mark Dredze

Large Language Model (LLM) safety is one of the most pressing challenges for enabling wide-scale deployment. While most studies and global discussions focus on generic harms, such as models assisting users in harming themselves or others,…

Artificial Intelligence · Computer Science 2026-03-16 Jingdi Lei , Varun Gumma , Rishabh Bhardwaj , Seok Min Lim , Chuan Li , Amir Zadeh , Soujanya Poria

As the application of large language models continues to expand in various fields, it poses higher challenges to the effectiveness of identifying harmful content generation and guardrail mechanisms. This research aims to evaluate the…

Cryptography and Security · Computer Science 2025-03-21 Libo Wang

Large language models (LLMs), known for their capability in understanding and following instructions, are vulnerable to adversarial attacks. Researchers have found that current commercial LLMs either fail to be "harmless" by presenting…

Cryptography and Security · Computer Science 2023-10-05 Bocheng Chen , Advait Paliwal , Qiben Yan

Mitigating explicit and implicit biases in Large Language Models (LLMs) has become a critical focus in the field of natural language processing. However, many current methodologies evaluate scenarios in isolation, without considering the…

Computation and Language · Computer Science 2025-02-04 Robert Morabito , Sangmitra Madhusudan , Tyler McDonald , Ali Emami

This paper examines the efficacy of utilizing large language models (LLMs) to detect public threats posted online. Amid rising concerns over the spread of threatening rhetoric and advance notices of violence, automated content analysis…

Computation and Language · Computer Science 2025-01-07 Taeksoo Kwon , Connor Kim

Automated methods for red teaming LLMs are an important tool to identify LLM vulnerabilities that may not be covered in static benchmarks, allowing for more thorough probing. They can also adapt to each specific LLM to discover weaknesses…

Cryptography and Security · Computer Science 2026-04-28 Aishwarya Padmakumar , Leon Derczynski , Traian Rebedea , Christopher Parisien

As Vision-Language Models (VLMs) move into interactive, multi-turn use, safety concerns intensify for multimodal multi-turn dialogue, which is characterized by concealment of malicious intent, contextual risk accumulation, and cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Guolei Huang , Qinzhi Peng , Gan Xu , Yao Huang , Yuxuan Lu , Yongjun Shen
‹ Prev 1 8 9 10 Next ›