English
Related papers

Related papers: SSLFusion: Scale & Space Aligned Latent Fusion Mod…

200 papers

There is a trend to fuse multi-modal information for 3D object detection (3OD). However, the challenging problems of low lightweightness, poor flexibility of plug-and-play, and inaccurate alignment of features are still not well-solved,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Lipeng Gu , Xuefeng Yan , Peng Cui , Lina Gong , Haoran Xie , Fu Lee Wang , Jin Qin , Mingqiang Wei

The combination of LiDAR and camera modalities is proven to be necessary and typical for 3D object detection according to recent studies. Existing fusion strategies tend to overly rely on the LiDAR modal in essence, which exploits the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Yang Yang , Weijie Ma , Hao Chen , Linlin Ou , Xinyi Yu

Multimodal sensor fusion is an essential capability for autonomous robots, enabling object detection and decision-making in the presence of failing or uncertain inputs. While recent fusion methods excel in normal environmental conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Edoardo Palladin , Roland Dietze , Praveen Narayanan , Mario Bijelic , Felix Heide

In this paper, we present an extension to LaserNet, an efficient and state-of-the-art LiDAR based 3D object detector. We propose a method for fusing image data with the LiDAR data and show that this sensor fusion method improves the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Gregory P. Meyer , Jake Charland , Darshan Hegde , Ankit Laddha , Carlos Vallespi-Gonzalez

The ability to accurately detect and localize objects is recognized as being the most important for the perception of self-driving cars. From 2D to 3D object detection, the most difficult is to determine the distance from the ego-vehicle to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Nguyen Anh Minh Mai , Pierre Duthon , Louahdi Khoudour , Alain Crouzil , Sergio A. Velastin

3D object detection based on LiDAR-camera fusion is becoming an emerging research theme for autonomous driving. However, it has been surprisingly difficult to effectively fuse both modalities without information loss and interference. To…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Guojun Wang , Bin Tian , Yachen Zhang , Long Chen , Dongpu Cao , Jian Wu

LiDAR-camera fusion methods have shown impressive performance in 3D object detection. Recent advanced multi-modal methods mainly perform global fusion, where image features and point cloud features are fused across the whole scene. Such…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Xin Li , Tao Ma , Yuenan Hou , Botian Shi , Yuchen Yang , Youquan Liu , Xingjiao Wu , Qin Chen , Yikang Li , Yu Qiao , Liang He

Unmanned aerial vehicle (UAV) object detection plays a vital role in applications such as environmental monitoring and urban security. To improve robustness, recent studies have explored multimodal detection by fusing visible (RGB) and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Liu Zongzhen , Luo Hui , Wang Zhixing , Wei Yuxing , Zuo Haorui , Zhang Jianlin

Small objects detection is a challenging task in computer vision due to its limited resolution and information. In order to solve this problem, the majority of existing methods sacrifice speed for improvement in accuracy. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Guimei Cao , Xuemei Xie , Wenzhe Yang , Quan Liao , Guangming Shi , Jinjian Wu

As a critical task in autonomous driving perception systems, 3D object detection is used to identify and track key objects, such as vehicles and pedestrians. However, detecting distant, small, or occluded objects (hard instances) remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Feiyang Jia , Caiyan Jia , Ailin Liu , Shaoqing Xu , Qiming Xia , Lin Liu , Lei Yang , Yan Gong , Ziying Song

Multi-sensor fusion is crucial for accurate 3D object detection in autonomous driving, with cameras and LiDAR being the most commonly used sensors. However, existing methods perform sensor fusion in a single view by projecting features from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Rohit Mohan , Daniele Cattaneo , Florian Drews , Abhinav Valada

Recent years have witnessed the remarkable progress of 3D multi-modality object detection methods based on the Bird's-Eye-View (BEV) perspective. However, most of them overlook the complementary interaction and guidance between LiDAR and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Xiaotian Li , Baojie Fan , Jiandong Tian , Huijie Fan

In autonomous driving, 3D object detection is essential for accurate perception and reliable decision-making. However, object motion and ego-motion often induce cross-frame spatiotemporal inconsistencies in BEV-based detectors, leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Wenxuan Li , Qin Zou , Shoubing Chen , Chi Chen , Yingyi Yang , Shoubing Chen , Qingxiang Meng

3D object detection in point cloud data remains a challenging task due to the sparsity and lack of global structure inherent in the input. In this work, we propose a novel Multi-Scale Attention (MSA) mechanism integrated into the 3DETR…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Mustaqeem Khan , Aidana Nurakhmetova , Wail Gueaieb , Abdulmotaleb El Saddik

Multi-modal 3D object detection has exhibited significant progress in recent years. However, most existing methods can hardly scale to long-range scenarios due to their reliance on dense 3D features, which substantially escalate…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Yiheng Li , Hongyang Li , Zehao Huang , Hong Chang , Naiyan Wang

Autonomous driving necessitates advanced object detection techniques that integrate information from multiple modalities to overcome the limitations associated with single-modal approaches. The challenges of aligning diverse data in early…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Qihang Yang , Yang Zhao , Hong Cheng

Multi-modal salient object detection (MSOD) aims to boost saliency detection performance by integrating visible sources with depth or thermal infrared ones. Existing methods generally design different fusion schemes to handle certain issues…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Kunpeng Wang , Zhengzheng Tu , Chenglong Li , Cheng Zhang , Bin Luo

3D object detection with multi-sensors is essential for an accurate and reliable perception system of autonomous driving and robotics. Existing 3D detectors significantly improve the accuracy by adopting a two-stage paradigm which merely…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Xinli Xu , Shaocong Dong , Lihe Ding , Jie Wang , Tingfa Xu , Jianan Li

Aiming at highly accurate object detection for connected and automated vehicles (CAVs), this paper presents a Deep Neural Network based 3D object detection model that leverages a three-stage feature extractor by developing a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Yiming Hou , Mahdi Rezaei , Richard Romano

Effective deep feature extraction via feature-level fusion is crucial for multimodal object detection. However, previous studies often involve complex training processes that integrate modality-specific features by stacking multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Lei Hao , Lina Xu , Chang Liu , Yanni Dong