English
Related papers

Related papers: MSMDFusion: Fusing LiDAR and Camera at Multiple Sc…

200 papers

Multi-modal salient object detection (MSOD) aims to boost saliency detection performance by integrating visible sources with depth or thermal infrared ones. Existing methods generally design different fusion schemes to handle certain issues…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Kunpeng Wang , Zhengzheng Tu , Chenglong Li , Cheng Zhang , Bin Luo

Effectively summarizing dense 3D point cloud data and extracting motion information of moving objects (moving object segmentation, MOS) is crucial to autonomous driving and robotics applications. How to effectively utilize motion and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Jintao Cheng , Xingming Chen , Jinxin Liang , Xiaoyu Tang , Xieyuanli Chen , Dachuan Li

Multi-modal image fusion (MMIF) integrates valuable information from different modality images into a fused one. However, the fusion of multiple visible images with different focal regions and infrared images is a unprecedented challenge in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Xilai Li , Xiaosong Li , Tao Ye , Xiaoqi Cheng , Wuyang Liu , Haishu Tan

With the advent of advanced multi-sensor fusion models, there has been a notable enhancement in the performance of perception tasks within in terms of autonomous driving. Despite these advancements, the challenges persist, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Wei Jong Yang , Guan Cheng Lee

LiDAR and cameras are complementary sensors for 3D object detection in autonomous driving. However, it is challenging to explore the unnatural interaction between point clouds and images, and the critical factor is how to conduct feature…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Ziying Song , Haiyue Wei , Lin Bai , Lei Yang , Caiyan Jia

This paper presents a new approach to boost a single-modality (LiDAR) 3D object detector by teaching it to simulate features and responses that follow a multi-modality (LiDAR-image) detector. The approach needs LiDAR-image data only when…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Wu Zheng , Mingxuan Hong , Li Jiang , Chi-Wing Fu

Modern autonomous vehicles rely heavily on mechanical LiDARs for perception. Current perception methods generally require 360{\deg} point clouds, collected sequentially as the LiDAR scans the azimuth and acquires consecutive wedge-shaped…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Mazen Abdelfattah , Kaiwen Yuan , Z. Jane Wang , Rabab Ward

Geometric navigation is nowadays a well-established field of robotics and the research focus is shifting towards higher-level scene understanding, such as Semantic Mapping. When a robot needs to interact with its environment, it must be…

Robotics · Computer Science 2023-11-23 Federico Rollo , Gennaro Raiola , Andrea Zunino , Nikolaos Tsagarakis , Arash Ajoudani

LiDAR-camera fusion enhances 3D panoptic segmentation by leveraging camera images to complement sparse LiDAR scans, but it also introduces a critical failure mode. Under adverse conditions, degradation or failure of the camera sensor can…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Rohit Mohan , Florian Drews , Yakov Miron , Daniele Cattaneo , Abhinav Valada

High-definition (HD) map construction methods are crucial for providing precise and comprehensive static environmental information, which is essential for autonomous driving systems. While Camera-LiDAR fusion techniques have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Xiaoshuai Hao , Yuting Zhao , Yuheng Ji , Luanyuan Dai , Peng Hao , Dingzhe Li , Shuai Cheng , Rong Yin

With the rapid proliferation of autonomous driving, there has been a heightened focus on the research of lidar-based 3D semantic segmentation and object detection methodologies, aiming to ensure the safety of traffic participants. In recent…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Jiahua Xu , Si Zuo , Chenfeng Wei , Wei Zhou

High-definition (HD) semantic mapping of complex intersections poses significant challenges for traditional vehicle-based approaches due to occlusions and limited perspectives. This paper introduces a novel camera-LiDAR fusion framework…

Robotics · Computer Science 2025-07-15 Zhongzhang Chen , Miao Fan , Shengtong Xu , Mengmeng Yang , Kun Jiang , Xiangzeng Liu , Haoyi Xiong

We present a new way to detect 3D objects from multimodal inputs, leveraging both LiDAR and RGB cameras in a hybrid late-cascade scheme, that combines an RGB detection network and a 3D LiDAR detector. We exploit late fusion principles to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Carlo Sgaravatti , Roberto Basla , Riccardo Pieroni , Matteo Corno , Sergio M. Savaresi , Luca Magri , Giacomo Boracchi

LiDAR-based vision systems are integral for 3D object detection, which is crucial for autonomous navigation. However, they suffer from performance degradation in adverse weather conditions due to the quality deterioration of LiDAR point…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Xun Huang , Ziyu Xu , Hai Wu , Jinlong Wang , Qiming Xia , Yan Xia , Jonathan Li , Kyle Gao , Chenglu Wen , Cheng Wang

In this paper, we propose a novel 3D object detector that can exploit both LIDAR as well as cameras to perform very accurate localization. Towards this goal, we design an end-to-end learnable architecture that exploits continuous…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Ming Liang , Bin Yang , Shenlong Wang , Raquel Urtasun

Although significant progress has been made, achieving place recognition in environments with perspective changes, seasonal variations, and scene transformations remains challenging. Relying solely on perception information from a single…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yan Pan , Jiapeng Xie , Jiajie Wu , Bo Zhou

Object detection in Remote Sensing Images (RSI) is a critical task for numerous applications in Earth Observation (EO). Differing from object detection in natural images, object detection in remote sensing images faces challenges of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Bissmella Bahaduri , Zuheng Ming , Fangchen Feng , Anissa Mokraou

Driven by deep learning techniques, perception technology in autonomous driving has developed rapidly in recent years, enabling vehicles to accurately detect and interpret surrounding environment for safe and efficient navigation. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Shanliang Yao , Runwei Guan , Xiaoyu Huang , Zhuoxiao Li , Xiangyu Sha , Yong Yue , Eng Gee Lim , Hyungjoon Seo , Ka Lok Man , Xiaohui Zhu , Yutao Yue

Monocular image-based 3D perception has become an active research area in recent years owing to its applications in autonomous driving. Approaches to monocular 3D perception including detection and tracking, however, often yield inferior…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Longlong Jing , Ruichi Yu , Henrik Kretzschmar , Kang Li , Charles R. Qi , Hang Zhao , Alper Ayvaci , Xu Chen , Dillon Cower , Yingwei Li , Yurong You , Han Deng , Congcong Li , Dragomir Anguelov

Fully autonomous driving systems require fast detection and recognition of sensitive objects in the environment. In this context, intelligent vehicles should share their sensor data with computing platforms and/or other vehicles, to detect…

Networking and Internet Architecture · Computer Science 2021-04-27 Valentina Rossi , Paolo Testolina , Marco Giordani , Michele Zorzi