English
Related papers

Related papers: Multi-Modal Fusion for Sensorimotor Coordination i…

200 papers

Indoor semantic segmentation is fundamental to computer vision and robotics, supporting applications such as autonomous navigation, augmented reality, and smart environments. Although RGB-D fusion leverages complementary appearance and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yan Gong , Jianli Lu , Yongsheng Gao , Jie Zhao , Xiaojuan Zhang , Susanto Rahardja

An autonomous system's perception engine must provide an accurate understanding of the environment for it to make decisions. Deep learning based object detection networks experience degradation in the performance and robustness for small…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Hemant Kumawat , Saibal Mukhopadhyay

Object detection in autonomous driving is frequently compromised by complex illumination. While event cameras offer a robust solution, they are susceptible to sudden contrast changes such as reflections which often trigger dense, misleading…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Mingjie Liu , Hanqing Liu , Luoping Cui , Chuang Zhu

As an alternative sensing paradigm, dynamic vision sensors (DVS) have been recently explored to tackle scenarios where conventional sensors result in high data rate and processing time. This paper presents a hybrid event-frame approach for…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Vivek Mohan , Deepak Singla , Tarun Pulluri , Andres Ussa , Pradeep Kumar Gopalakrishnan , Pao-Sheng Sun , Bharath Ramesh , Arindam Basu

Existing RGB-Event detection methods process the low-information regions of both modalities (background in images and non-event regions in event data) uniformly during feature extraction and fusion, resulting in high computational costs and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Nan Yang , Yang Wang , Zhanwen Liu , Yuchao Dai , Yang Liu , Xiangmo Zhao

LiDAR has become a standard sensor for autonomous driving applications as they provide highly precise 3D point clouds. LiDAR is also robust for low-light scenarios at night-time or due to shadows where the performance of cameras is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Khaled El Madawy , Hazem Rashed , Ahmad El Sallab , Omar Nasr , Hanan Kamel , Senthil Yogamani

Hybrid Event-Based Vision Sensor (HybridEVS) is a novel sensor integrating traditional frame-based and event-based sensors, offering substantial benefits for applications requiring low-light, high dynamic range, and low-latency…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Senyan Xu , Zhijing Sun , Jiaying Zhu , Yurui Zhu , Xueyang Fu , Zheng-Jun Zha

In the last decade, the computer vision field has seen significant progress in multimodal data fusion and learning, where multiple sensors, including depth, infrared, and visual, are used to capture the environment across diverse spectral…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Martin Brenner , Napoleon H. Reyes , Teo Susnjak , Andre L. C. Barczak

Pedestrian Detection is the most critical module of an Autonomous Driving system. Although a camera is commonly used for this purpose, its quality degrades severely in low-light night time driving scenarios. On the other hand, the quality…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Kinjal Dasgupta , Arindam Das , Sudip Das , Ujjwal Bhattacharya , Senthil Yogamani

Mapping and localization are essential capabilities of robotic systems. Although the majority of mapping systems focus on static environments, the deployment in real-world situations requires them to handle dynamic objects. In this paper,…

Robotics · Computer Science 2019-08-30 Emanuele Palazzolo , Jens Behley , Philipp Lottes , Philippe Giguère , Cyrill Stachniss

Providing machines with the ability to recognize objects like humans has always been one of the primary goals of machine vision. The introduction of RGB-D cameras has paved the way for a significant leap forward in this direction thanks to…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Mohammad Reza Loghmani , Mirco Planamente , Barbara Caputo , Markus Vincze

Event cameras differ from conventional RGB cameras in that they produce asynchronous data sequences. While RGB cameras capture every frame at a fixed rate, event cameras only capture changes in the scene, resulting in sparse and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Dan Yang , Mehmet Yamac

Complete and textured 3D reconstruction of dynamic scenes has been facilitated by mapped RGB and depth information acquired by RGB-D cameras based multi-view systems. One of the most critical steps in such multi-view systems is to determine…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Hassan Afzal , Djamila Aouada , Michel Antunes , David Fofi , Bruno Mirbach , Björn Ottersten

Focus based methods have shown promising results for the task of depth estimation. However, most existing focus based depth estimation approaches depend on maximal sharpness of the focal stack. Out of focus information in the focal stack…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Yongri Piao , Yukun Zhang , Miao Zhang , Xinxin Ji

In this paper, we propose a novel approach to address the problem of camera and radar sensor fusion for 3D object detection in autonomous vehicle perception systems. Our approach builds on recent advances in deep learning and leverages the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Daniel Dworak , Mateusz Komorkiewicz , Paweł Skruch , Jerzy Baranowski

The broad scope of obstacle avoidance has led to many kinds of computer vision-based approaches. Despite its popularity, it is not a solved problem. Traditional computer vision techniques using cameras and depth sensors often focus on…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Celyn Walters , Simon Hadfield

Reliable perception is essential for autonomous driving systems to operate safely under diverse real-world traffic conditions. However, camera- and LiDAR-based perception systems suffer from performance degradation under adverse weather and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yue Sun , Yeqiang Qian , Zhe Wang , Tianhui Li , Chunxiang Wang , Ming Yang

Spacecraft pose estimation is crucial for autonomous in-space operations, such as rendezvous, docking and on-orbit servicing. Vision-based pose estimation methods, which typically employ RGB imaging sensors, is a compelling solution for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Mohsi Jawaid , Marcus Märtens , Tat-Jun Chin

The RGB complementary metal-oxidesemiconductor (CMOS) sensor works within the visible light spectrum. Therefore it is very sensitive to environmental light conditions. On the contrary, a long-wave infrared (LWIR) sensor operating in 8-14…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Mohsen Vadidar , Ali Kariminezhad , Christian Mayr , Laurent Kloeker , Lutz Eckstein

Beam prediction is critical for reducing beam-training overhead in millimeter-wave (mmWave) systems, especially in high-mobility vehicular scenarios. This paper presents a BEV-Fusion based framework that unifies camera, LiDAR, radar, and…

Signal Processing · Electrical Eng. & Systems 2026-04-08 Jiaming Zeng , Cunhua Pan , Haoyang Weng , Ruijing Liu , Hong Ren , Jiangzhou Wang