English
Related papers

Related papers: H2VLR: Heterogeneous Hypergraph Vision-Language Re…

200 papers

Fine-grained supervision based on object annotations has been widely used for vision and language pre-training (VLP). However, in real-world application scenarios, aligned multi-modal data is usually in the image-caption format, which only…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Lisai Zhang , Qingcai Chen , Zhijian Chen , Yunpeng Han , Zhonghua Li , Zhao Cao

Visual Language Models (VLMs) have demonstrated impressive capabilities in visual grounding tasks. However, their effectiveness in the medical domain, particularly for abnormality detection and localization within medical images, remains…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Jun Li , Che Liu , Wenjia Bai , Rossella Arcucci , Cosmin I. Bercea , Julia A. Schnabel

This paper evaluates the use of vision-language models (VLMs) for zero-shot detection and association of hardhats to enhance construction safety. Given the significant risk of head injuries in construction, proper enforcement of hardhat use…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Lucas Choi , Ross Greer

Integrating image and text data through multi-modal learning has emerged as a new approach in medical imaging research, following its successful deployment in computer vision. While considerable efforts have been dedicated to establishing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Fereshteh Shakeri , Yunshi Huang , Julio Silva-Rodríguez , Houda Bahig , An Tang , Jose Dolz , Ismail Ben Ayed

In recent years, Visual Anomaly Detection (VAD) has gained significant attention due to its ability to identify defects using only normal images during training. Many VAD models work without supervision but are still able to provide visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Arianna Stropeni , Valentina Zaccaria , Francesco Borsatti , Davide Dalle Pezze , Manuel Barusco , Gian Antonio Susto

The autonomous driving community is increasingly focused on addressing the challenges posed by out-of-distribution (OOD) driving scenarios. A dominant research trend seeks to enhance end-to-end (E2E) driving systems by integrating…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Yingzi Ma , Yulong Cao , Wenhao Ding , Shuibai Zhang , Yan Wang , Boris Ivanovic , Ming Jiang , Marco Pavone , Chaowei Xiao

Built upon language and vision foundation models with strong generalization ability and trained on large-scale robotic data, Vision-Language-Action (VLA) models have recently emerged as a promising approach to learning generalist robotic…

Robotics · Computer Science 2025-10-07 Zheng Xiong , Kang Li , Zilin Wang , Matthew Jackson , Jakob Foerster , Shimon Whiteson

Anomaly detection (AD) is a task that distinguishes normal and abnormal data, which is important for applying automation technologies of the manufacturing facilities. For MVTec dataset that is a representative AD dataset for industrial…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Jongyub Seok , Chanjin Kang

Autonomous driving systems remain critically vulnerable to the long-tail of rare, out-of-distribution semantic anomalies. While VLMs have emerged as promising tools for perception, their application in anomaly detection remains largely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Roberto Brusnicki , David Pop , Yuan Gao , Mattia Piccinini , Johannes Betz

Vision--language models (VLMs) achieve strong performance on many multimodal benchmarks but remain brittle on spatial reasoning tasks that require aligning abstract overhead representations with egocentric views. We introduce m2sv, a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Yosub Shin , Michael Buriek , Igor Molybog

Pre-trained Vision-Language Models (VLMs) struggle with Zero-Shot Anomaly Detection (ZSAD) due to a critical adaptation gap: they lack the local inductive biases required for dense prediction and employ inflexible feature fusion paradigms.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Ke Ma , Jun Long , Hongxiao Fei , Liujie Hua , Zhen Dai , Yueyi Luo

While Vision-Language Models (VLMs) show significant promise for end-to-end autonomous driving by leveraging the common sense embedded in language models, their reliance on 2D image cues for complex scene understanding and decision-making…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Weijie Wei , Zhipeng Luo , Ling Feng , Venice Erin Liong

Zero-shot learning (ZSL) tackles the unseen class recognition problem, transferring semantic knowledge from seen classes to unseen ones. Typically, to guarantee desirable knowledge transfer, a common (latent) space is adopted for…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Shiming Chen , Guo-Sen Xie , Yang Liu , Qinmu Peng , Baigui Sun , Hao Li , Xinge You , Ling Shao

Few-shot learning (FSL) has attracted considerable attention recently. Among existing approaches, the metric-based method aims to train an embedding network that can make similar samples close while dissimilar samples as far as possible and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Bin Xiao , Chien-Liang Liu , Wen-Hoar Hsaio

Single-vehicle Vision-Language Models (VLMs) are fundamentally constrained by sensor occlusions. While Vehicle-to-Everything (V2X) systems mitigate this, current benchmarks lack the cooperative reasoning required for resolving ambiguities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Kevin Richard , Alphin Varghese , Colin Pham , David Oh , Srijan Das

While end-to-end Vision-Language-Action (VLA) models offer a promising paradigm for robotic manipulation, fine-tuning them on narrow control data often compromises the profound reasoning capabilities inherited from their base…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Tianshuo Yang , Guanyu Chen , Yutian Chen , Zhixuan Liang , Yitian Liu , Zanxin Chen , Chunpu Xu , Haotian Liang , Jiangmiao Pang , Yao Mu , Ping Luo

The collection and detection of video anomaly data has long been a challenging problem due to its rare occurrence and spatio-temporal scarcity. Existing video anomaly detection (VAD) methods under perform in open-world scenarios. Key…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zunkai Dai , Ke Li , Jiajia Liu , Jie Yang , Yuanyuan Qiao

Image-based inspection systems have been widely deployed in manufacturing production lines. Due to the scarcity of defective samples, unsupervised anomaly detection that only leverages normal samples during training to detect various…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Chengyu Tao , Hao Xu , Juan Du

Industrial anomaly detection is a critical component of modern manufacturing, yet the scarcity of defective samples restricts traditional detection methods to scenario-specific applications. Although Vision-Language Models (VLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Yanhui Li , Yunkang Cao , Chengliang Liu , Yuan Xiong , Xinghui Dong , Chao Huang

In recent years, the task of weakly supervised audio-visual violence detection has gained considerable attention. The goal of this task is to identify violent segments within multimodal data based on video-level labels. Despite advances in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Xiaogang Peng , Hao Wen , Yikai Luo , Xiao Zhou , Keyang Yu , Ping Yang , Zizhao Wu