English
Related papers

Related papers: Document Screenshot Retrievers are Vulnerable to P…

200 papers

Multimodal Large Language Models (MLLMs) have transformed text-to-image workflows, allowing designers to create novel visual concepts with unprecedented speed. This progress has given rise to a thriving prompt trading market, where curated…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Xiaotian Zou

Fine-grained image retrieval, which aims to find images containing specific object components and assess their detailed states, is critical in fields like security and industrial inspection. However, conventional methods face significant…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Kehan Wang , Tingqiong Cui , Yang Zhang , Yu Chen , Shifeng Wu , Zhenzhang Li

As Vision-Language Models (VLMs) demonstrate increasing capabilities across real-world applications such as code generation and chatbot assistance, ensuring their safety has become paramount. Unlike traditional Large Language Models (LLMs),…

Artificial Intelligence · Computer Science 2025-06-23 Peiyuan Tang , Haojie Xin , Xiaodong Zhang , Jun Sun , Qin Xia , Zijiang Yang

Recent research has revealed that the output of Deep Neural Networks (DNN) can be easily altered by adding relatively small perturbations to the input vector. In this paper, we analyze an attack in an extremely limited scenario where only…

Machine Learning · Computer Science 2019-10-18 Jiawei Su , Danilo Vasconcellos Vargas , Sakurai Kouichi

The increasing sophistication of large vision-language models (LVLMs) has been accompanied by advances in safety alignment mechanisms designed to prevent harmful content generation. However, these defenses remain vulnerable to sophisticated…

Cryptography and Security · Computer Science 2026-04-09 Quanchen Zou , Zonghao Ying , Moyang Chen , Wenzhuo Xu , Yisong Xiao , Yakai Li , Deyue Zhang , Dongdong Yang , Zhao Liu , Xiangzheng Zhang

Despite the strong multimodal performance, large vision-language models (LVLMs) are vulnerable during fine-tuning to backdoor attacks, where adversaries insert trigger-embedded samples into the training data to implant behaviors that can be…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Zhifang Zhang , Bojun Yang , Shuo He , Weitong Chen , Wei Emma Zhang , Olaf Maennel , Lei Feng , Miao Xu

Deep hiding, embedding images into another using deep neural networks, has shown its great power in increasing the message capacity and robustness. In this paper, we conduct an in-depth study of state-of-the-art deep hiding schemes and…

Cryptography and Security · Computer Science 2021-06-08 Tao Xiang , Hangcheng Liu , Shangwei Guo , Tianwei Zhang

Vision Large Language Models (VLLMs) represent a significant advancement in artificial intelligence by integrating image-processing capabilities with textual understanding, thereby enhancing user interactions and expanding application…

Computation and Language · Computer Science 2025-05-09 Madhur Jindal , Saurabh Deshpande

Slide decks, serving as digital reports that bridge the gap between presentation slides and written documents, are a prevalent medium for conveying information in both academic and corporate settings. Their multimodal nature, combining…

Computation and Language · Computer Science 2025-09-19 Petros Stylianos Giouroukis , Dimitris Dimitriadis , Dimitrios Papadopoulos , Zhenwen Shao , Grigorios Tsoumakas

Evidence-enhanced detectors present remarkable abilities in identifying malicious social text. However, the rise of large language models (LLMs) brings potential risks of evidence pollution to confuse detectors. This paper explores…

Computation and Language · Computer Science 2025-05-30 Herun Wan , Minnan Luo , Zhixiong Su , Guang Dai , Xiang Zhao

Diffusion Models have emerged as powerful generative models for high-quality image synthesis, with many subsequent image editing techniques based on them. However, the ease of text-based image editing introduces significant risks, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Chun-Yen Shih , Li-Xuan Peng , Jia-Wei Liao , Ernie Chu , Cheng-Fu Chou , Jun-Cheng Chen

Phishing, a continuously growing cyber threat, aims to obtain innocent users' credentials by deceiving them via presenting fake web pages which mimic their legitimate targets. To date, various attempts have been carried out in order to…

Cryptography and Security · Computer Science 2019-05-21 Firat Coskun Dalgic , Ahmet Selman Bozkir , Murat Aydos

Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to an LLMs can realize Vision Language Models (VLMs). However, existing research shows that the visual modality of VLMs…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhendong Liu , Yuanbi Nie , Yingshui Tan , Xiangyu Yue , Qiushi Cui , Chongjun Wang , Xiaoyong Zhu , Bo Zheng

The robust safety of Vision-Language Large Models (VLLMs) against joint multilingual and multimodal threats remains severely underexplored. Current benchmarks typically isolate these dimensions, being either multilingual but text-only, or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Enyi Shi , Pengyang Shao , Yanxin Zhang , Chenhang Cui , Jiayi Lyu , Xiaobo Xia , Fei Shen , Tat-Seng Chua

Handwriting Verification is a critical in document forensics. Deep learning based approaches often face skepticism from forensic document examiners due to their lack of explainability and reliance on extensive training data and handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Mihir Chauhan , Abhishek Satbhai , Mohammad Abuzar Hashemi , Mir Basheer Ali , Bina Ramamurthy , Mingchen Gao , Siwei Lyu , Sargur Srihari

Large vision-language models (LVLMs) have demonstrated outstanding performance in many downstream tasks. However, LVLMs are trained on large-scale datasets, which can pose privacy risks if training images contain sensitive information.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Zongyu Wu , Minhua Lin , Zhiwei Zhang , Fali Wang , Xianren Zhang , Xiang Zhang , Suhang Wang

Multimodal retrieval-augmented generation (RAG) enhances the visual reasoning capability of vision-language models (VLMs) by dynamically accessing information from external knowledge bases. In this work, we introduce \textit{Poisoned-MRAG},…

Cryptography and Security · Computer Science 2025-03-17 Yinuo Liu , Zenghui Yuan , Guiyao Tie , Jiawen Shi , Pan Zhou , Lichao Sun , Neil Zhenqiang Gong

Semantic segmentation models are widely deployed in safety-critical applications such as autonomous driving, yet their vulnerability to backdoor attacks remains largely underexplored. Prior segmentation backdoor studies transfer threat…

Cryptography and Security · Computer Science 2026-03-18 Guangsheng Zhang , Huan Tian , Leo Zhang , Tianqing Zhu , Ming Ding , Wanlei Zhou , Bo Liu

With the rapid development of the Vision-Language Model (VLM), significant progress has been made in Visual Question Answering (VQA) tasks. However, existing VLM often generate inaccurate answers due to a lack of up-to-date knowledge. To…

Cryptography and Security · Computer Science 2025-06-02 Lei Yu , Yechao Zhang , Ziqi Zhou , Yang Wu , Wei Wan , Minghui Li , Shengshan Hu , Pei Xiaobing , Jing Wang

Model inversion (MI) attacks pose significant privacy risks by reconstructing private training data from trained neural networks. While prior studies have primarily examined unimodal deep networks, the vulnerability of vision-language…

Machine Learning · Computer Science 2026-03-03 Ngoc-Bao Nguyen , Sy-Tuyen Ho , Koh Jun Hao , Ngai-Man Cheung