English
Related papers

Related papers: Robust Pedestrian Detection with Uncertain Modalit…

200 papers

Pedestrian detection is a critical task in robot perception. Multispectral modalities (visible light and thermal) can boost pedestrian detection performance by providing complementary visual information. Several gaps remain with…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Asiegbu Miracle Kanu-Asiegbu , Nitin Jotwani , Xiaoxiao Du

Change detection in optical remote sensing imagery is susceptible to illumination fluctuations, seasonal changes, and variations in surface land-cover materials. Relying solely on RGB imagery often produces pseudo-changes and leads to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Ye Wang , Wei Lu , Zhihui You , Keyan Chen , Tongfei Liu , Kaiyu Li , Hongruixuan Chen , Qingling Shu , Sibao Chen

The Visible-Infrared Person Re-identification (VI ReID) aims to match visible and infrared images of the same pedestrians across non-overlapped camera views. These two input modalities contain both invariant information, such as shape, and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Ruiqi Wu , Bingliang Jiao , Wenxuan Wang , Meng Liu , Peng Wang

Multispectral images of color-thermal pairs have shown more effective than a single color channel for pedestrian detection, especially under challenging illumination conditions. However, there is still a lack of studies on how to fuse the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Chengyang Li , Dan Song , Ruofeng Tong , Min Tang

Recent years have witnessed increasing research attention towards pedestrian detection by taking the advantages of different sensor modalities (e.g. RGB, IR, Depth, LiDAR and Event). However, designing a unified generalist model that can…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yi Zhang , Wang Zeng , Sheng Jin , Chen Qian , Ping Luo , Wentao Liu

Multispectral pedestrian detection has attracted increasing attention from the research community due to its crucial competence for many around-the-clock applications (e.g., video surveillance and autonomous driving), especially under…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Chengyang Li , Dan Song , Ruofeng Tong , Min Tang

The high performance of RGB-D based road segmentation methods contrasts with their rare application in commercial autonomous driving, which is owing to two reasons: 1) the prior methods cannot achieve high inference speed and high accuracy…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Yicong Chang , Feng Xue , Fei Sheng , Wenteng Liang , Anlong Ming

To tackle the challenge of vehicle re-identification (Re-ID) in complex lighting environments and diverse scenes, multi-spectral sources like visible and infrared information are taken into consideration due to their excellent complementary…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Aihua Zheng , Xianpeng Zhu , Zhiqi Ma , Chenglong Li , Jin Tang , Jixin Ma

Multi-modal learning focuses on training models by equally combining multiple input data modalities during the prediction process. However, this equal combination can be detrimental to the prediction accuracy because different modalities…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Hu Wang , Jianpeng Zhang , Yuanhong Chen , Congbo Ma , Jodie Avery , Louise Hull , Gustavo Carneiro

Multispectral object detection, utilizing RGB and TIR (thermal infrared) modalities, is widely recognized as a challenging task. It requires not only the effective extraction of features from both modalities and robust fusion strategies,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Chen Zhou , Peng Cheng , Junfeng Fang , Yifan Zhang , Yibo Yan , Xiaojun Jia , Yanyan Xu , Kun Wang , Xiaochun Cao

Multispectral pedestrian detection is essential to various tasks especially autonomous driving, for which both the accuracy and computational cost are of paramount importance. Most existing approaches treat RGB and infrared modalities…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Xingjian Wang , Li Chai , Jiming Chen , Zhiguo Shi

Unsupervised visible infrared person re-identification (USVI-ReID) is a challenging retrieval task that aims to retrieve cross-modality pedestrian images without using any label information. In this task, the large cross-modality variance…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Zhizhong Zhang , Jiangming Wang , Xin Tan , Yanyun Qu , Junping Wang , Yong Xie , Yuan Xie

Accurate and efficient pedestrian detection is crucial for the intelligent transportation system regarding pedestrian safety and mobility, e.g., Advanced Driver Assistance Systems, and smart pedestrian crosswalk systems. Among all…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Yifan Zhuang , Ziyuan Pu , Jia Hu , Yinhai Wang

RGBT multispectral pedestrian detection has emerged as a promising solution for safety-critical applications that require day/night operations. However, the modality bias problem remains unsolved as multispectral pedestrian detectors learn…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Taeheon Kim , Sebin Shin , Youngjoon Yu , Hak Gu Kim , Yong Man Ro

Thanks for the cross-modal retrieval techniques, visible-infrared (RGB-IR) person re-identification (Re-ID) is achieved by projecting them into a common space, allowing person Re-ID in 24-hour surveillance systems. However, with respect to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Xinyu Lin , Jinxing Li , Zeyu Ma , Huafeng Li , Shuang Li , Kaixiong Xu , Guangming Lu , David Zhang

Unsupervised visible-infrared person re-identification (USL-VI-ReID) endeavors to retrieve pedestrian images of the same identity from different modalities without annotations. While prior work focuses on establishing cross-modality…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Lingfeng He , De Cheng , Nannan Wang , Xinbo Gao

Existing multi-modal object tracking approaches primarily focus on dual-modal paradigms, such as RGB-Depth or RGB-Thermal, yet remain challenged in complex scenarios due to limited input modalities. To address this gap, this work introduces…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xue-Feng Zhu , Tianyang Xu , Yifan Pan , Jinjie Gu , Xi Li , Jiwen Lu , Xiao-Jun Wu , Josef Kittler

Depth estimation in complex real-world scenarios is a challenging task, especially when relying solely on a single modality such as visible light or thermal infrared (THR) imagery. This paper proposes a novel multimodal depth estimation…

Image and Video Processing · Electrical Eng. & Systems 2025-04-30 Zelin Meng , Takanori Fukao

Pedestrian crossing intention prediction is essential for the deployment of autonomous vehicles (AVs) in urban environments. Ideal prediction provides AVs with critical environmental cues, thereby reducing the risk of pedestrian-related…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yuanzhe Li , Steffen Müller

Pedestrian detection in intelligent transportation systems has made significant progress but faces two critical challenges: (1) insufficient fusion of complementary information between visible and infrared spectra, particularly in complex…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Rui Zhao , Zeyu Zhang , Yi Xu , Yi Yao , Yan Huang , Wenxin Zhang , Zirui Song , Xiuying Chen , Yang Zhao