English
Related papers

Related papers: Exposing Vulnerabilities in Visible-Infrared VLMs:…

200 papers

Infrared object detection is crucial for perception in autonomous driving and surveillance but remains vulnerable to physical adversarial attacks. Unlike in the RGB domain, where attacks rely on color texture, infrared attacks must…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yixing Yong , Jian Wang , Ming Lei , Lijun He , Fan Li

Autonomous agentic AI systems powered by vision-language models (VLMs) are rapidly advancing toward real-world deployment, yet their cross-modal reasoning capabilities introduce new attack surfaces for adversarial manipulation that exploit…

Artificial Intelligence · Computer Science 2025-11-25 Hangoo Kang , Jehyeok Yeon , Gagandeep Singh

Large Vision-Language Models (LVLMs), trained on multimodal big datasets, have significantly advanced AI by excelling in vision-language tasks. However, these models remain vulnerable to adversarial attacks, particularly jailbreak attacks,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Md Zarif Hossain , Ahmed Imteaj

Large-scale Video Foundation Models (VFMs) has significantly advanced various video-related tasks, either through task-specific models or Multi-modal Large Language Models (MLLMs). However, the open accessibility of VFMs also introduces…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hui Lu , Yi Yu , Song Xia , Yiming Yang , Deepu Rajan , Boon Poh Ng , Alex Kot , Xudong Jiang

Vision-Language Models (VLMs) face significant safety vulnerabilities from malicious prompt attacks due to weakened alignment during visual integration. Existing defenses suffer from efficiency and robustness. To address these challenges,…

Machine Learning · Computer Science 2026-04-09 Peigui Qi , Kunsheng Tang , Yanpu Yu , Jialin Wu , Yide Song , Wenbo Zhou , Zhicong Huang , Cheng Hong , Weiming Zhang , Nenghai Yu

Vision-Language Models (VLMs) have achieved remarkable success in various tasks, yet their robustness to real-world illumination variations remains largely unexplored. To bridge this gap, we propose \textbf{I}llumination…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Hanqing Liu , Shouwei Ruan , Yao Huang , Shiji Zhao , Xingxing Wei

Existing Infrared and Visible Image Fusion (IVIF) methods typically assume high-quality inputs. However, when handing degraded images, these methods heavily rely on manually switching between different pre-processing techniques. This…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Tianpei Zhang , Jufeng Zhao , Yiming Zhu , Guangmang Cui

Face Recognition Systems (FRS) are increasingly vulnerable to face-morphing attacks, prompting the development of Morphing Attack Detection (MAD) algorithms. However, a key challenge in MAD lies in its limited generalizability to unseen…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Haoyu Zhang , Raghavendra Ramachandra , Kiran Raja , Christoph Busch

With the emergence of large language models (LLMs) and vision foundation models, how to combine the intelligence and capacity of these open-sourced or API-available models to achieve open-world visual perception remains an open question. In…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Chris Kelly , Luhui Hu , Bang Yang , Yu Tian , Deshun Yang , Cindy Yang , Zaoshan Huang , Zihao Li , Jiayin Hu , Yuexian Zou

In this paper, we delve into the susceptibility of federated medical image analysis systems to adversarial attacks. Our analysis uncovers a novel exploitation avenue: using gradient information from prior global model updates, adversaries…

Machine Learning · Computer Science 2023-10-24 Erfan Darzi , Florian Dubost , Nanna. M. Sijtsema , P. M. A van Ooijen

The widespread use of Vision Language Models (VLMs, e.g. CLIP) has raised concerns about their vulnerability to sophisticated and imperceptible adversarial attacks. These attacks could compromise model performance and system security in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Xiaowei Fu , Lei Zhang

Recent advances in the industrial inspection of textured surfaces-in the form of visual inspection-have made such inspections possible for efficient, flexible manufacturing systems. We propose an unsupervised feature memory rearrangement…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Haiming Yao , Wenyong Yu , Xue Wang

Vision-Language Models (VLMs) have garnered significant attention for their remarkable ability to interpret and generate multimodal content. However, securing these models against jailbreak attacks continues to be a substantial challenge.…

Cryptography and Security · Computer Science 2025-10-14 Aofan Liu , Lulu Tang

Aligning visual features with language embeddings is a key challenge in vision-language models (VLMs). The performance of such models hinges on having a good connector that maps visual features generated by a vision encoder to a shared…

Language-vision understanding has driven the development of advanced perception systems, most notably the emerging paradigm of Referring Multi-Object Tracking (RMOT). By leveraging natural-language queries, RMOT systems can selectively…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Halima Bouzidi , Haoyu Liu , Mohammad Abdullah Al Faruque

General 3D foundation models have started to lead the trend of unifying diverse vision tasks, yet most assume RGB-only inputs and ignore readily available geometric cues (e.g., camera intrinsics, poses, and depth maps). To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Haosong Peng , Hao Li , Yalun Dai , Yushi Lan , Yihang Luo , Tianyu Qi , Zhengshen Zhang , Yufeng Zhan , Junfei Zhang , Wenchao Xu , Ziwei Liu

Vision foundation models are increasingly employed in autonomous driving systems due to their advanced capabilities. However, these models are susceptible to adversarial attacks, posing significant risks to the reliability and safety of…

Multimedia · Computer Science 2024-07-19 Jiyuan Fu , Zhaoyu Chen , Kaixun Jiang , Haijing Guo , Shuyong Gao , Wenqiang Zhang

Medical reports with substantial information can be naturally complementary to medical images for computer vision tasks, and the modality gap between vision and language can be solved by vision-language matching (VLM). However, current…

Image and Video Processing · Electrical Eng. & Systems 2023-05-23 Chen Wenting , Liu Jie , Yuan Yixuan

Large vision-language models (LVLMs) have shown remarkable capabilities in interpreting visual content. While existing works demonstrate these models' vulnerability to deliberately placed adversarial texts, such texts are often easily…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Yue Cao , Yun Xing , Jie Zhang , Di Lin , Tianwei Zhang , Ivor Tsang , Yang Liu , Qing Guo

Recent studies have shown that Adversarial Patches (APs) can effectively manipulate object detection models. However, the conspicuous patterns often associated with these patches tend to attract human attention, posing a significant…

Cryptography and Security · Computer Science 2024-10-28 Zheng Zhou , Hongbo Zhao , Ju Liu , Qiaosheng Zhang , Liwei Geng , Shuchang Lyu , Wenquan Feng