English
Related papers

Related papers: Weather-Robust Scene Semantics with Vision-Aligned…

200 papers

Simultaneous Localization and Mapping (SLAM) is moving towards a robust perception age. However, LiDAR- and visual- SLAM may easily fail in adverse conditions (rain, snow, smoke and fog, etc.). In comparison, SLAM based on 4D Radar, thermal…

Infrared and visible image fusion aims to integrate complementary multi-modal information into a single fused result. However, existing methods 1) fail to account for the degradation visible images under adverse weather conditions, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Jing Li , Yifan Wang , Jiafeng Yan , Renlong Zhang , Bin Yang

Many image restoration (IR) tasks require both pixel-level fidelity and high-level semantic understanding to recover realistic photos with fine-grained details. However, previous approaches often struggle to effectively leverage both the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Cuixin Yang , Rongkang Dong , Kin-Man Lam

Vision-and-language navigation (VLN) requires an embodied agent to ground natural-language instructions into executable navigation actions in unseen environments. Existing zero-shot methods typically rely on additional waypoint prediction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Kai Sheng , Liuyi Wang , Haojie Dai , Jinlong Li , Yongrui Qin , Zongtao He , Chengju Liu , Qijun Chen

Situational awareness applications rely heavily on real-time processing of visual and textual data to provide actionable insights. Vision language models (VLMs) have become essential tools for interpreting complex environments by connecting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Md Azim Khan , Aryya Gangopadhyay , Jianwu Wang , Robert F. Erbacher

Vision language models (VLM) demonstrate sophisticated multimodal reasoning yet are prone to hallucination when confronted with knowledge conflicts, impeding their deployment in information-sensitive contexts. While existing research…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Peter Carragher , Nikitha Rao , Abhinand Jha , R Raghav , Kathleen M. Carley

We introduce a method to train vision-language models for remote-sensing images without using any textual annotations. Our key insight is to use co-located internet imagery taken on the ground as an intermediary for connecting…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Utkarsh Mall , Cheng Perng Phoo , Meilin Kelsey Liu , Carl Vondrick , Bharath Hariharan , Kavita Bala

Scene understanding plays an essential role in enabling autonomous driving and maintaining high standards of performance and safety. To address this task, cameras and laser scanners (LiDARs) have been the most commonly used sensors, with…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Yahia Dalbah , Jean Lahoud , Hisham Cholakkal

We introduce V-SONAR, a vision-language embedding space extended from the text-only embedding space SONAR (Omnilingual Embeddings Team et al., 2026), which supports 1500 text languages and 177 speech languages. To construct V-SONAR, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yifu Qiu , Paul-Ambroise Duquenne , Holger Schwenk

Vision-Language Models (VLMs) are powerful open-set reasoners, yet their direct use as anomaly detectors in video surveillance is fragile: without calibrated anomaly priors, they alternate between missed detections and hallucinated false…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Mohamed Eltahir , Ahmed O. Ibrahim , Obada Siralkhatim , Tabarak Abdallah , Sondos Mohamed

Robotic scene understanding increasingly relies on Vision-Language Models (VLMs) to generate natural language descriptions of the environment. In this work, we systematically evaluate single-view object captioning for tabletop scenes…

Robotics · Computer Science 2026-04-24 Federico Tavella , Amber Drinkwater , Angelo Cangelosi

Vision-and-language navigation (VLN) stands as a key research problem of Embodied AI, aiming at enabling agents to navigate in unseen environments following linguistic instructions. In this field, generalization is a long-standing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Jiazhao Zhang , Kunyu Wang , Rongtao Xu , Gengze Zhou , Yicong Hong , Xiaomeng Fang , Qi Wu , Zhizheng Zhang , He Wang

The performance of perception systems developed for autonomous driving vehicles has seen significant improvements over the last few years. This improvement was associated with the increasing use of LiDAR sensors and point cloud data to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yahia Dalbah , Jean Lahoud , Hisham Cholakkal

The development of safe and reliable autonomous unmanned aerial vehicles relies on the ability of the system to recognise and adapt to changes in the local environment based on sensor inputs. State-of-the-art local tracking and trajectory…

Robotics · Computer Science 2025-02-12 Andrea Albanese , Yanran Wang , Davide Brunelli , David Boyle

Vision-and-language navigation (VLN) is a challenging task that requires an agent to navigate in real-world environments by understanding natural language instructions and visual information received in real-time. Prior works have…

Robotics · Computer Science 2021-01-20 Ting Wang , Zongkai Wu , Donglin Wang

Vision-language models (VLMs) have recently emerged as powerful representation learning systems that align visual observations with natural language concepts, offering new opportunities for semantic reasoning in safety-critical autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ross Greer , Maitrayee Keskar , Angel Martinez-Sanchez , Parthib Roy , Shashank Shriram , Mohan Trivedi

Unlike RGB cameras that use visible light bands (384$\sim$769 THz) and Lidars that use infrared bands (361$\sim$331 THz), Radars use relatively longer wavelength radio bands (77$\sim$81 GHz), resulting in robust measurements in adverse…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Dong-Hee Paek , Seung-Hyun Kong , Kevin Tirta Wijaya

Vision-language models (VLMs) often fail under low illumination because their visual grounding is learned predominantly from RGB imagery, whereas thermal infrared preserves complementary scene structure when visible cues degrade. We present…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Rusiru Thushara , Yasiru Ranasinghe , Jay Paranjape , Vishal M. Patel

Automotive scene understanding under adverse weather conditions raises a realistic and challenging problem attributable to poor outdoor scene visibility (e.g. foggy weather). However, because most contemporary scene understanding approaches…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Naif Alshammari , Samet Akcay , Toby P. Breckon

A realistic view of the vehicle's surroundings is generally offered by camera sensors, which is crucial for environmental perception. Affordable radar sensors, on the other hand, are becoming invaluable due to their robustness in variable…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Kavin Chandrasekaran , Sorin Grigorescu , Gijs Dubbelman , Pavol Jancura