English
Related papers

Related papers: Arondight: Red Teaming Large Vision Language Model…

200 papers

Large Multimodal Models (LMMs) have demonstrated the ability to interact with humans under real-world conditions by combining Large Language Models (LLMs) and modality encoders to align multimodal information (visual and auditory) with…

Computation and Language · Computer Science 2024-11-01 Hao Yang , Lizhen Qu , Ehsan Shareghi , Gholamreza Haffari

The rapid progress of Large Language Models (LLMs) has opened up new opportunities across various domains and applications; yet it also presents challenges related to potential misuse. To mitigate such risks, red teaming has been employed…

Cryptography and Security · Computer Science 2025-06-10 Yifan Jiang , Kriti Aggarwal , Tanmay Laud , Kashif Munir , Jay Pujara , Subhabrata Mukherjee

Large Language Models (LLMs) are increasingly integrated into high-stakes applications, making robust safety guarantees a central practical and commercial concern. Existing safety evaluations predominantly rely on fixed collections of…

Computation and Language · Computer Science 2026-03-23 Zafir Shamsi , Nikhil Chekuru , Zachary Guzman , Shivank Garg

Large Language Models (LLMs), especially their compact efficiency-oriented variants, remain susceptible to jailbreak attacks that can elicit harmful outputs despite extensive alignment efforts. Existing adversarial prompt generation…

Large Language Models (LLMs) exhibit remarkable capabilities but are susceptible to adversarial prompts that exploit vulnerabilities to produce unsafe or biased outputs. Existing red-teaming methods often face scalability challenges,…

Computation and Language · Computer Science 2026-01-21 Quy-Anh Dang , Chris Ngo , Truong-Son Hy

With the significant development of large models in recent years, Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities across a wide range of multimodal understanding and reasoning tasks. Compared to traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Daizong Liu , Mingyu Yang , Xiaoye Qu , Pan Zhou , Yu Cheng , Wei Hu

Considerable research efforts have been devoted to ensuring that large language models (LLMs) align with human values and generate safe text. However, an excessive focus on sensitivity to certain topics can compromise the model's robustness…

Computation and Language · Computer Science 2023-08-29 Huachuan Qiu , Shuai Zhang , Anqi Li , Hongliang He , Zhenzhong Lan

Large Language Model (LLM) safeguards, which implement request refusals, have become a widely adopted mitigation strategy against misuse. At the intersection of adversarial machine learning and AI safety, safeguard red teaming has…

Cryptography and Security · Computer Science 2025-06-10 Zifan Wang , Christina Q. Knight , Jeremy Kritz , Willow E. Primack , Julian Michael

Large Language Models (LLMs) are increasingly vulnerable to adversarial prompts that exploit semantic ambiguities to bypass safety mechanisms, resulting in harmful or inappropriate outputs. Such attacks, including jailbreaking and prompt…

Cryptography and Security · Computer Science 2026-05-28 Xiang Fang , Wanlong Fang

Large Language Models (LLMs) have transformed task automation and content generation across various domains while incorporating safety filters to prevent misuse. We introduce a novel jailbreaking framework that employs distributed prompt…

Cryptography and Security · Computer Science 2025-04-01 Johan Wahréus , Ahmed Hussain , Panos Papadimitratos

Recent advances in Large Language Models (LLMs) have spurred transformative applications in various domains, ranging from open-source to proprietary LLMs. However, jailbreak attacks, which aim to break safety alignment and user compliance…

Artificial Intelligence · Computer Science 2025-12-09 Chen Xiong , Pin-Yu Chen , Tsung-Yi Ho

Vision-Language Models (VLMs) have remarkable abilities in generating multimodal reasoning tasks. However, potential misuse or safety alignment concerns of VLMs have increased significantly due to different categories of attack vectors.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Md Jueal Mia , M. Hadi Amini

Multi-modal Large Language Models (MLLMs) excel in vision-language tasks but remain vulnerable to visual adversarial perturbations that can induce hallucinations, manipulate responses, or bypass safety mechanisms. Existing methods seek to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Hashmat Shadab Malik , Fahad Shamshad , Muzammal Naseer , Karthik Nandakumar , Fahad Khan , Salman Khan

Despite being empowered with alignment mechanisms, large language models (LLMs) are increasingly vulnerable to emerging jailbreak attacks that can compromise their alignment mechanisms. This vulnerability poses significant risks to…

Computation and Language · Computer Science 2025-04-15 Shaoqing Zhang , Zhuosheng Zhang , Kehai Chen , Rongxiang Weng , Muyun Yang , Tiejun Zhao , Min Zhang

The proliferation of Large Language Models (LLMs) in real-world applications poses unprecedented risks of generating harmful, biased, or misleading information to vulnerable populations including LGBTQ+ individuals, single parents, and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Tung Vu , Lam Nguyen , Quynh Dao

Recently, Large Language Models (LLMs) have garnered significant attention for their exceptional natural language processing capabilities. However, concerns about their trustworthiness remain unresolved, particularly in addressing…

Computation and Language · Computer Science 2025-01-29 Yue Huang , Jingyu Tang , Dongping Chen , Bingda Tang , Yao Wan , Lichao Sun , Philip S. Yu , Xiangliang Zhang

The safety of Large Language Models (LLMs) is crucial for the development of trustworthy AI applications. Existing red teaming methods often rely on seed instructions, which limits the semantic diversity of the synthesized adversarial…

Computation and Language · Computer Science 2025-10-10 Muxi Diao , Yutao Mou , Keqing He , Hanbo Song , Lulu Zhao , Shikun Zhang , Wei Ye , Kongming Liang , Zhanyu Ma

The increasing integration of Visual Language Models (VLMs) into AI systems necessitates robust model alignment, especially when handling multimodal content that combines text and images. Existing evaluation datasets heavily lean towards…

Computation and Language · Computer Science 2026-03-05 Gabriel Downer , Sean Craven , Damian Ruck , Jake Thomas

Vision-language models (VLMs) have become central to tasks such as visual question answering, image captioning, and text-to-image generation. However, their outputs are highly sensitive to prompt variations, which can reveal vulnerabilities…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Aarush Noheria , Yuguang Yao

Large vision-language models (LVLMs) have demonstrated remarkable capabilities by integrating pre-trained vision encoders with large language models (LLMs). Similar to single-modal LLMs, chain-of-thought (CoT) prompting has been adapted for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Shin'ya Yamaguchi , Kosuke Nishida , Daiki Chijiwa
‹ Prev 1 3 4 5 6 7 10 Next ›