English
Related papers

Related papers: When Pedestrian Detection Meets Multi-Modal Learni…

200 papers

Many vision-related tasks benefit from reasoning over multiple modalities to leverage complementary views of data in an attempt to learn robust embedding spaces. Most deep learning-based methods rely on a late fusion technique whereby…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Austin Reiter , Menglin Jia , Pu Yang , Ser-Nam Lim

RGBT multispectral pedestrian detection has emerged as a promising solution for safety-critical applications that require day/night operations. However, the modality bias problem remains unsolved as multispectral pedestrian detectors learn…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Taeheon Kim , Sebin Shin , Youngjoon Yu , Hak Gu Kim , Yong Man Ro

Developing effective path representations has become increasingly essential across various fields within intelligent transportation. Although pre-trained path representation learning models have shown improved performance, they…

Machine Learning · Computer Science 2025-01-03 Ronghui Xu , Hanyin Cheng , Chenjuan Guo , Hongfan Gao , Jilin Hu , Sean Bin Yang , Bin Yang

Pedestrian behavior prediction is one of the major challenges for intelligent driving systems in urban environments. Pedestrians often exhibit a wide range of behaviors and adequate interpretations of those depend on various sources of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Amir Rasouli , Tiffany Yau , Mohsen Rohani , Jun Luo

Pedestrian detection plays a critical role in computer vision as it contributes to ensuring traffic safety. Existing methods that rely solely on RGB images suffer from performance degradation under low-light conditions due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Xue Zhang , Xiaohan Zhang , Jiangtao Wang , Jiacheng Ying , Zehua Sheng , Heng Yu , Chunguang Li , Hui-Liang Shen

Pedestrian detection is an initial step to perform outdoor scene analysis, which plays an essential role in many real-world applications. Although having enjoyed the merits of deep learning frameworks from the generic object detectors,…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Jialiang Zhang , Lixiang Lin , Yang Li , Yun-chen Chen , Jianke Zhu , Yao Hu , Steven C. H. Hoi

Existing pedestrian attribute recognition methods are generally developed based on RGB frame cameras. However, these approaches are constrained by the limitations of RGB cameras, such as sensitivity to lighting conditions and motion blur,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Xiao Wang , Haiyang Wang , Shiao Wang , Qiang Chen , Jiandong Jin , Haoyu Song , Bo Jiang , Chenglong Li

Multimodal object detection improves robustness in chal- lenging conditions by leveraging complementary cues from multiple sensor modalities. We introduce Filtered Multi- Modal Cross Attention Fusion (FMCAF), a preprocess- ing architecture…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Jad Berjawi , Yoann Dupas , Christophe C'erin

In this paper, we present an efficient pedestrian detection system, designed by fusion of multiple deep neural network (DNN) systems. Pedestrian candidates are first generated by a single shot convolutional multi-box detector at different…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Xianzhi Du , Mostafa El-Khamy , Vlad I. Morariu , Jungwon Lee , Larry Davis

The combined use of multiple modalities enables accurate pedestrian detection under poor lighting conditions by using the high visibility areas from these modalities together. The vital assumption for the combination use is that there is no…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Napat Wanchaitanawong , Masayuki Tanaka , Takashi Shibata , Masatoshi Okutomi

Pedestrian detection is a popular research topic due to its paramount importance for a number of applications, especially in the fields of automotive, surveillance and robotics. Despite the significant improvements, pedestrian detection is…

Computer Vision and Pattern Recognition · Computer Science 2017-04-27 Denis Tomè , Federico Monti , Luca Baroffio , Luca Bondi , Marco Tagliasacchi , Stefano Tubaro

With rapid urbanization in the modern era, traffic signals from various sensors have been playing a significant role in monitoring the states of cities, which provides a strong foundation in ensuring safe travel, reducing traffic congestion…

Artificial Intelligence · Computer Science 2025-11-18 Haolong Xiang , Peisi Wang , Xiaolong Xu , Kun Yi , Xuyun Zhang , Quanzheng Sheng , Amin Beheshti , Wei Fan

Recent advancements in 3D object detection have benefited from multi-modal information from the multi-view cameras and LiDAR sensors. However, the inherent disparities between the modalities pose substantial challenges. We observe that…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Juhan Cha , Minseok Joo , Jihwan Park , Sanghyeok Lee , Injae Kim , Hyunwoo J. Kim

In this paper, we study a novel problem in egocentric action recognition, which we term as "Multimodal Generalization" (MMG). MMG aims to study how systems can generalize when data from certain modalities is limited or even completely…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Xinyu Gong , Sreyas Mohan , Naina Dhingra , Jean-Charles Bazin , Yilei Li , Zhangyang Wang , Rakesh Ranjan

Infrared-visible object detection aims to achieve robust object detection by leveraging the complementary information of infrared and visible image pairs. However, the commonly existing modality misalignment problem presents two challenges:…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Junjie Guo , Chenqiang Gao , Fangcen Liu , Deyu Meng

Multi-modal learning has achieved remarkable success by integrating information from various modalities, achieving superior performance in tasks like recognition and retrieval compared to uni-modal approaches. However, real-world scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xiaohao Liu , Xiaobo Xia , Zhuo Huang , See-Kiong Ng , Tat-Seng Chua

In the current worldwide situation, pedestrian detection has reemerged as a pivotal tool for intelligent video-based systems aiming to solve tasks such as pedestrian tracking, social distancing monitoring or pedestrian mass counting.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Alejandro López-Cifuentes , Marcos Escudero-Viñolo , Jesús Bescós , Pablo Carballeira

In recent years, multi-modal fusion has attracted a lot of research interest, both in academia, and in industry. Multimodal fusion entails the combination of information from a set of different types of sensors. Exploiting complementary…

Machine Learning · Computer Science 2020-08-27 Siddharth Roheda , Hamid Krim , Benjamin S. Riggan

Multi-sensor perception is crucial to ensure the reliability and accuracy in autonomous driving system, while multi-object tracking (MOT) improves that by tracing sequential movement of dynamic objects. Most current approaches for…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Wenwei Zhang , Hui Zhou , Shuyang Sun , Zhe Wang , Jianping Shi , Chen Change Loy

Pedestrian tracking has long been considered an important problem, especially in security applications. Previously,many approaches have been proposed with various types of sensors. One popular method is Pedestrian Dead Reckoning(PDR) [1]…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Mahdi Elhousni , Xinming Huang