English
Related papers

Related papers: Benchmarking Vision-Language Models under Contradi…

200 papers

Vision-Language Models (VLMs) have shown capabilities in interpreting visual content, but their reliability in safety-critical scenarios remains insufficiently explored. We introduce VERI, a diagnostic benchmark comprising 200 synthetic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Dasol Choi , Seunghyun Lee , Youngsook Song

Augmented Reality (AR) enriches human perception by overlaying virtual elements onto the physical world. However, this tight coupling between virtual and real content makes AR vulnerable to cognitive attacks: manipulations that distort…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Rongqian Chen , Allison Andreyev , Yanming Xiu , Joshua Chilukuri , Shunav Sen , Mahdi Imani , Bin Li , Maria Gorlatova , Gang Tan , Tian Lan

Recent advances in biometric systems have significantly improved the detection and prevention of fraudulent activities. However, as detection methods improve, attack techniques become increasingly sophisticated. Attacks on face recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Lazaro Janier Gonzalez-Soler , Maciej Salwowski , Christoph Busch

Augmented reality (AR) enhances user interaction with the real world but also presents vulnerabilities, particularly through Visual Information Manipulation (VIM) attacks. These attacks alter important real-world visual cues, leading to…

Human-Computer Interaction · Computer Science 2025-09-04 Yanming Xiu , Maria Gorlatova

The robust safety of Vision-Language Large Models (VLLMs) against joint multilingual and multimodal threats remains severely underexplored. Current benchmarks typically isolate these dimensions, being either multilingual but text-only, or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Enyi Shi , Pengyang Shao , Yanxin Zhang , Chenhang Cui , Jiayi Lyu , Xiaobo Xia , Fei Shen , Tat-Seng Chua

Augmented reality (AR) requires the seamless integration of visual, auditory, and linguistic channels for optimized human-computer interaction. While auditory and visual inputs facilitate real-time and contextual user guidance, the…

Computation and Language · Computer Science 2023-10-19 Jing Bi , Nguyen Manh Nguyen , Ali Vosoughi , Chenliang Xu

We introduce the Adversarial Confusion Attack, a new class of threats against multimodal large language models (MLLMs). Unlike jailbreaks or targeted misclassification, the goal is to induce systematic disruption that makes the model…

Computation and Language · Computer Science 2025-12-02 Jakub Hoscilowicz , Artur Janicki

Vision-Language Models (VLMs) are increasingly susceptible to sophisticated adversarial attacks, including adaptive strategies specifically designed to bypass existing defenses. To address this vulnerability, we propose MirrorCheck, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Samar Fares , Klea Ziu , Toluwani Aremu , Nikita Durasov , Martin Takáč , Pascal Fua , Ivan Laptev , Karthik Nandakumar

The emergence of vision-language-action models (VLAs) for end-to-end control is reshaping the field of robotics by enabling the fusion of multimodal sensory inputs at the billion-parameter scale. The capabilities of VLAs stem primarily from…

Vision-Language Models (VLMs) have witnessed a surge in both research and real-world applications. However, as they are becoming increasingly prevalent, ensuring their robustness against adversarial attacks is paramount. This work…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Rishika Bhagwatkar , Shravan Nayak , Reza Bayat , Alexis Roger , Daniel Z Kaplan , Pouya Bashivan , Irina Rish

Recent advances in vision-language models (VLMs) trained on web-scale image-text pairs have enabled impressive zero-shot transfer across a diverse range of visual tasks. However, comprehensive and independent evaluation beyond standard…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jia Chengyu , AprilPyone MaungMaung , Huy H. Nguyen , Jinyin Chen , Isao Echizen

With the wide application of large language models (LLMs), the problems of bias and value inconsistency in sensitive domains have gradually emerged, especially in terms of race, society and politics. In this paper, we propose an adversarial…

Computation and Language · Computer Science 2026-01-23 Yuan Gao , Zhigang Liu , Xinyu Yao , Bo Chen , Xiaobing Zhao

Social Virtual Reality (VR) platforms provide immersive social experiences but also expose users to serious risks of online harassment. Existing safety measures are largely reactive, while proactive solutions that detect harassment behavior…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Junhee Lee , Minseok Kim , Hwanjo Heo , Seungwon Woo , Jinwoo Kim

Vision Language Models (VLMs) extend remarkable capabilities of text-only large language models and vision-only models, and are able to learn from and process multi-modal vision-text input. While modern VLMs perform well on a number of…

Computation and Language · Computer Science 2025-07-22 Hannah Sterz , Jonas Pfeiffer , Ivan Vulić

Vision-language models (VLMs) achieve strong performance on standard, high-quality datasets, but we still do not fully understand how they perform under real-world image distortions. We present VLM-RobustBench, a benchmark spanning 49…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Rohit Saxena , Alessandro Suglia , Pasquale Minervini

Engaging in smooth conversations with others is a crucial social skill. However, differences in knowledge between conversation participants can sometimes hinder effective communication. To tackle this issue, this study proposes a real-time…

Human-Computer Interaction · Computer Science 2025-06-23 Yuichiro Fujimoto

Large vision-language models (LVLMs) integrate visual information into large language models, showcasing remarkable multi-modal conversational capabilities. However, the visual modules introduces new challenges in terms of robustness for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yubo Wang , Chaohu Liu , Yanqiu Qu , Haoyu Cao , Deqiang Jiang , Linli Xu

Large Language Models (LLMs) have exploded a new heatwave of AI for their ability to engage end-users in human-level conversations with detailed and articulate answers across many knowledge domains. In response to their fast adoption in…

Vision-Language Models (VLMs) often yield inconsistent descriptions of the same object across viewpoints, hindering the ability of embodied agents to construct consistent semantic representations over time. Previous methods resolved…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Tommaso Galliena , Stefano Rosa , Tommaso Apicella , Pietro Morerio , Alessio Del Bue , Lorenzo Natale

Recent advances in generative artificial intelligence have enabled the creation of highly realistic image forgeries, raising significant concerns about digital media authenticity. While existing detection methods demonstrate promising…

Multimedia · Computer Science 2025-04-15 Junhao Xu , Jingjing Chen , Yang Jiao , Jiacheng Zhang , Zhiyu Tan , Hao Li , Yu-Gang Jiang