English
Related papers

Related papers: Homogeneous Multi-modal Feature Fusion and Interac…

200 papers

Millimeter-wave radar plays a vital role in 3D object detection for autonomous driving due to its all-weather and all-lighting-condition capabilities for perception. However, radar point clouds suffer from pronounced sparsity and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zijian Gu , Jianwei Ma , Yan Huang , Honghao Wei , Zhanye Chen , Hui Zhang , Wei Hong

Multi-modal image fusion (MMIF) integrates valuable information from different modality images into a fused one. However, the fusion of multiple visible images with different focal regions and infrared images is a unprecedented challenge in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Xilai Li , Xiaosong Li , Tao Ye , Xiaoqi Cheng , Wuyang Liu , Haishu Tan

Effective point cloud processing is crucial to LiDARbased autonomous driving systems. The capability to understand features at multiple scales is required for object detection of intelligent vehicles, where road users may appear in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Weihao Lu , Dezong Zhao , Cristiano Premebida , Li Zhang , Wenjing Zhao , Daxin Tian

The enhancement of 3D object detection is pivotal for precise environmental perception and improved task execution capabilities in autonomous driving. LiDAR point clouds, offering accurate depth information, serve as a crucial information…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Leichao Cui , Xiuxian Li , Min Meng , Guangyu Jia

In this paper, we investigate the combination of voxel-based methods and point-based methods, and propose a novel end-to-end two-stage 3D object detector named SGNet for point clouds scenes. The voxel-based methods voxelize the scene to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Hao Peng , Guofeng Tong , Zheng Li , Yaqi Wang , Yuyuan Shao

Current multispectral object detection methods often retain extraneous background or noise during feature fusion, limiting perceptual performance. To address this, we propose an innovative feature fusion framework based on cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Jifeng Shen , Haibo Zhan , Xin Zuo , Heng Fan , Xiaohui Yuan , Jun Li , Wankou Yang

LiDAR datasets for autonomous driving exhibit biases in properties such as point cloud density, range, and object dimensions. As a result, object detection networks trained and evaluated in different environments often experience…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Deepti Hegde , Suhas Lohit , Kuan-Chuan Peng , Michael J. Jones , Vishal M. Patel

Three-dimensional Object Detection from multi-view cameras and LiDAR is a crucial component for autonomous driving and smart transportation. However, in the process of basic feature extraction, perspective transformation, and feature…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhongyu Xia , Hansong Yang , Yongtao Wang

In cooperative perception studies, there is often a trade-off between communication bandwidth and perception performance. While current feature fusion solutions are known for their excellent object detection performance, transmitting the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Deyuan Qu , Qi Chen , Yongqi Zhu , Yihao Zhu , Sergei S. Avedisov , Song Fu , Qing Yang

LiDAR-based 3D object detectors often struggle to detect far-field objects due to the sparsity of point clouds at long ranges, which limits the availability of reliable geometric cues. To address this, prior approaches augment LiDAR data…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Veerain Sood , Bnalin , Gaurav Pandey

Monocular 3D Object Detection represents a challenging Computer Vision task due to the nature of the input used, which is a single 2D image, lacking in any depth cues and placing the depth estimation problem as an ill-posed one. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Diana-Alexandra Sas , Florin Oniga

Real-time 3D object detection is crucial for autonomous cars. Achieving promising performance with high efficiency, voxel-based approaches have received considerable attention. However, previous methods model the input space with features…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Jun Wang , Shiyi Lan , Mingfei Gao , Larry S. Davis

Lidars and cameras are critical sensors that provide complementary information for 3D detection in autonomous driving. While prevalent multi-modal methods simply decorate raw lidar point clouds with camera features and feed them directly to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Yingwei Li , Adams Wei Yu , Tianjian Meng , Ben Caine , Jiquan Ngiam , Daiyi Peng , Junyang Shen , Bo Wu , Yifeng Lu , Denny Zhou , Quoc V. Le , Alan Yuille , Mingxing Tan

3D object detection with multi-sensors is essential for an accurate and reliable perception system of autonomous driving and robotics. Existing 3D detectors significantly improve the accuracy by adopting a two-stage paradigm which merely…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Xinli Xu , Shaocong Dong , Lihe Ding , Jie Wang , Tingfa Xu , Jianan Li

In autonomous driving, camera-radar fusion offers complementary sensing and low deployment cost. Existing methods perform fusion through input mixing, feature map mixing, or query-based feature sampling. We propose a new fusion paradigm,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jialong Wu , Yihan Wang , Matthias Rottmann

Multi-view radar-camera fused 3D object detection provides a farther detection range and more helpful features for autonomous driving, especially under adverse weather. The current radar-camera fusion methods deliver kinds of designs to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Zizhang Wu , Guilian Chen , Yuanzhu Gan , Lei Wang , Jian Pu

Monocular image-based 3D perception has become an active research area in recent years owing to its applications in autonomous driving. Approaches to monocular 3D perception including detection and tracking, however, often yield inferior…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Longlong Jing , Ruichi Yu , Henrik Kretzschmar , Kang Li , Charles R. Qi , Hang Zhao , Alper Ayvaci , Xu Chen , Dillon Cower , Yingwei Li , Yurong You , Han Deng , Congcong Li , Dragomir Anguelov

Radars, due to their robustness to adverse weather conditions and ability to measure object motions, have served in autonomous driving and intelligent agents for years. However, Radar-based perception suffers from its unintuitive sensing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Liu Liu , Shuaifeng Zhi , Zhenhua Du , Li Liu , Xinyu Zhang , Kai Huo , Weidong Jiang

LiDAR and cameras are complementary sensors for 3D object detection in autonomous driving. However, it is challenging to explore the unnatural interaction between point clouds and images, and the critical factor is how to conduct feature…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Ziying Song , Haiyue Wei , Lin Bai , Lei Yang , Caiyan Jia

Multi-modal 3D object detection has received growing attention as the information from different sensors like LiDAR and cameras are complementary. Most fusion methods for 3D detection rely on an accurate alignment and calibration between 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Zhe Liu , Xiaoqing Ye , Zhikang Zou , Xinwei He , Xiao Tan , Errui Ding , Jingdong Wang , Xiang Bai