中文
相关论文

相关论文: Vision-Language Feature Alignment for Road Anomaly…

200 篇论文

Autonomous vehicles (AVs) require reliable traffic sign recognition and robust lane detection capabilities to ensure safe navigation in complex and dynamic environments. This paper introduces an integrated approach combining advanced deep…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Chandan Kumar Sah , Ankit Kumar Shaw , Xiaoli Lian , Arsalan Shahid Baig , Tuopu Wen , Kun Jiang , Mengmeng Yang , Diange Yang

Unsupervised visual anomaly detection from multi-view images presents a significant challenge: distinguishing genuine defects from benign appearance variations caused by viewpoint changes. Existing methods, often designed for single-view…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Xintao Chen , Xiaohao Xu , Bozhong Zheng , Yun Liu , Yingna Wu

Vision-Language Models (VLMs) demonstrate impressive capabilities across multimodal tasks, yet exhibit systematic spatial reasoning failures, achieving only 49% (CLIP) to 54% (BLIP-2) accuracy on basic directional relationships. For safe…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Muhammad Imran , Yugyung Lee

Video anomaly detection (VAD) holds immense importance across diverse domains such as surveillance, healthcare, and environmental monitoring. While numerous surveys focus on conventional VAD methods, they often lack depth in exploring…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Moshira Abdalla , Sajid Javed , Muaz Al Radi , Anwaar Ulhaq , Naoufel Werghi

Vision-language models (VLMs) have recently emerged as a promising paradigm for video anomaly detection (VAD) due to their strong visual reasoning ability and natural language-based explainability. In this paper, we aim to address a key…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Mitchell Piehl , Muchao Ye

Large Vision-Language Models (VLMs) rely on effective multimodal alignment between pre-trained vision encoders and Large Language Models (LLMs) to integrate visual and textual information. This paper presents a comprehensive analysis of…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Shweta Mahajan , Hoang Le , Hyojin Park , Farzad Farhadzadeh , Munawar Hayat , Fatih Porikli

Ensuring safe decision-making in autonomous vehicles remains a fundamental challenge despite rapid advances in end-to-end learning approaches. Traditional reinforcement learning (RL) methods rely on manually engineered rewards or sparse…

机器人学 · 计算机科学 2026-03-20 Zilin Huang , Zihao Sheng , Zhengyang Wan , Yansong Qu , Junwei You , Sicong Jiang , Sikai Chen

With the growing deployment of autonomous driving agents, the detection and segmentation of road obstacles have become critical to ensure safe autonomous navigation. However, existing road-obstacle segmentation methods are applied on…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Shyam Nandan Rai , Shyamgopal Karthik , Mariana-Iuliana Georgescu , Barbara Caputo , Carlo Masone , Zeynep Akata

Expressway video anomaly detection is essential for safety management. However, identifying anomalies across diverse scenes remains challenging, particularly for far-field targets exhibiting subtle abnormal vehicle motions. While…

计算机视觉与模式识别 · 计算机科学 2026-04-29 Xiaowei Mao , Bowen Sui , Weijie Zhang , Yawen Yang , Shengnan Guo , Shilong Zhao , Jiaqi Lin , Tingrui Wu , Youfang Lin , Huaiyu Wa

Vision-Language Model (VLM) have gained widespread adoption in Open-Vocabulary (OV) object detection and segmentation tasks. Despite they have shown promise on OV-related tasks, their effectiveness in conventional vision tasks has thus far…

State-of-the-art semantic or instance segmentation deep neural networks (DNNs) are usually trained on a closed set of semantic classes. As such, they are ill-equipped to handle previously-unseen objects. However, detecting and localizing…

计算机视觉与模式识别 · 计算机科学 2021-11-10 Robin Chan , Krzysztof Lis , Svenja Uhlemeyer , Hermann Blum , Sina Honari , Roland Siegwart , Pascal Fua , Mathieu Salzmann , Matthias Rottmann

Semantic anomalies-context-dependent hazards that pixel-level detectors cannot reason about-pose a critical safety risk in autonomous driving. We propose a \emph{semantic observer layer}: a quantized vision-language model (VLM) running at…

机器人学 · 计算机科学 2026-04-01 Kunal Runwal , Swaraj Gajare , Daniel Adejumo , Omkar Ankalkope , Siddhant Baroth , Aliasghar Arab

Audio-visual segmentation is a challenging task that aims to predict pixel-level masks for sound sources in a video. Previous work applied a comprehensive manually designed architecture with countless pixel-wise accurate masks as…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Shentong Mo , Bhiksha Raj

In this paper, we propose a novel framework for enhancing visual comprehension in autonomous driving systems by integrating visual language models (VLMs) with additional visual perception module specialised in object detection. We extend…

计算机视觉与模式识别 · 计算机科学 2024-11-12 Linfeng He , Yiming Sun , Sihao Wu , Jiaxu Liu , Xiaowei Huang

A visual-language model (VLM) pre-trained on natural images and text pairs poses a significant barrier when applied to medical contexts due to domain shift. Yet, adapting or fine-tuning these VLMs for medical use presents considerable…

计算机视觉与模式识别 · 计算机科学 2024-05-31 Aisha Urooj Khan , John Garrett , Tyler Bradshaw , Lonie Salkowski , Jiwoong Jason Jeong , Amara Tariq , Imon Banerjee

Audio-Visual Segmentation (AVS) aims to precisely outline audible objects in a visual scene at the pixel level. Existing AVS methods require fine-grained annotations of audio-mask pairs in supervised learning fashion. This limits their…

计算机视觉与模式识别 · 计算机科学 2023-09-14 Swapnil Bhosale , Haosen Yang , Diptesh Kanojia , Xiatian Zhu

Anomaly recognition plays a vital role in surveillance, transportation, healthcare, and public safety. However, most existing approaches rely solely on visual data, making them unreliable under challenging conditions such as occlusion, low…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Amjid Ali , Zulfiqar Ahmad Khan , Altaf Hussain , Muhammad Munsif , Adnan Hussain , Sung Wook Baik

Vision-Language Models (VLMs) are powerful open-set reasoners, yet their direct use as anomaly detectors in video surveillance is fragile: without calibrated anomaly priors, they alternate between missed detections and hallucinated false…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Mohamed Eltahir , Ahmed O. Ibrahim , Obada Siralkhatim , Tabarak Abdallah , Sondos Mohamed

Open-Vocabulary Camouflaged Object Segmentation (OVCOS) seeks to segment and classify camouflaged objects from arbitrary categories, presenting unique challenges due to visual ambiguity and unseen categories.Recent approaches typically…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Kai Zhao , Wubang Yuan , Zheng Wang , Guanyi Li , Xiaoqiang Zhu , Deng-ping Fan , Dan Zeng

Medical reports with substantial information can be naturally complementary to medical images for computer vision tasks, and the modality gap between vision and language can be solved by vision-language matching (VLM). However, current…

图像与视频处理 · 电气工程与系统科学 2023-05-23 Chen Wenting , Liu Jie , Yuan Yixuan