English
Related papers

Related papers: DPFT: Dual Perspective Fusion Transformer for Came…

200 papers

Lidars and cameras play essential roles in autonomous driving, offering complementary information for 3D detection. The state-of-the-art fusion methods integrate them at the feature level, but they mostly rely on the learned soft…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Zixuan Yin , Han Sun , Ningzhong Liu , Huiyu Zhou , Jiaquan Shen

We propose LiRaFusion to tackle LiDAR-radar fusion for 3D object detection to fill the performance gap of existing LiDAR-radar detectors. To improve the feature extraction capabilities from these two modalities, we design an early fusion…

Robotics · Computer Science 2024-02-20 Jingyu Song , Lingjun Zhao , Katherine A. Skinner

Simultaneous Localization and Mapping (SLAM) is an essential technology for the efficiency and reliability of unmanned robotic exploration missions. While the onboard computational capability and communication bandwidth are critically…

Robotics · Computer Science 2026-01-09 Riku Suzuki , Ayumi Umemura , Shreya Santra , Kentaro Uno , Kazuya Yoshida

In this work, we propose a new approach that combines data from multiple sensors for reliable obstacle avoidance. The sensors include two depth cameras and a LiDAR arranged so that they can capture the whole 3D area in front of the robot…

Robotics · Computer Science 2022-12-27 Thanh Nguyen Canh , Truong Son Nguyen , Cong Hoang Quach , Xiem HoangVan , Manh Duong Phung

Autonomous vehicles are conceived to provide safe and secure services by validating the safety standards as indicated by SOTIF-ISO/PAS-21448 (Safety of the intended functionality). Keeping in this context, the perception of the environment…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Shoaib Azam , Farzeen Munir , Moongu Jeon

The millimeter-wave radar sensor maintains stable performance under adverse environmental conditions, making it a promising solution for all-weather perception tasks, such as outdoor mobile robotics. However, the radar point clouds are…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Kai Luan , Chenghao Shi , Neng Wang , Yuwei Cheng , Huimin Lu , Xieyuanli Chen

As a fundamental problem in ubiquitous computing and machine learning, sensor-based human activity recognition (HAR) has drawn extensive attention and made great progress in recent years. HAR aims to recognize human activities based on the…

Signal Processing · Electrical Eng. & Systems 2022-03-01 Yimu Wang , Kun Yu , Yan Wang , Hui Xue

In the field of 3D object detection for autonomous driving, LiDAR-Camera (LC) fusion is the top-performing sensor configuration. Still, LiDAR is relatively high cost, which hinders adoption of this technology for consumer automobiles.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Lingjun Zhao , Jingyu Song , Katherine A. Skinner

In this paper, we present a parallel architecture for a sensor fusion detection system that combines a camera and 1D light detection and ranging (lidar) sensor for object detection. The system contains two object detection methods, one…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 I-Hsi Kao , Ya-Zhu Yian , Jian-An Su , Yi-Horng Lai , Jau-Woei Perng , Tung-Li Hsieh , Yi-Shueh Tsai , Min-Shiu Hsieh

Recently, transformer networks have outperformed traditional deep neural networks in natural language processing and show a large potential in many computer vision tasks compared to convolutional backbones. In the original transformer,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Chen-Chou Lo , Patrick Vandewalle

Multimodal sensor fusion has demonstrated remarkable performance improvements over unimodal approaches in 3D object detection for autonomous vehicles. Typically, existing methods transform multimodal data from independent sensors, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Markus Essl , Marta Moscati , Mubashir Noman , Muhammad Zaigham Zaheer , Usman Naseem , Shah Nawaz , Markus Schedl

In this paper, we developed the solution of roadside LiDAR object detection using a combination of two unsupervised learning algorithms. The 3D point clouds are firstly converted into spherical coordinates and filled into the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Tianya Zhang , Peter J. Jin

With autonomous driving developing in a booming stage, accurate object detection in complex scenarios attract wide attention to ensure the safety of autonomous driving. Millimeter wave (mmWave) radar and vision fusion is a mainstream…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Zhiqing Wei , Fengkai Zhang , Shuo Chang , Yangyang Liu , Huici Wu , Zhiyong Feng

3D object detection with multi-sensors is essential for an accurate and reliable perception system of autonomous driving and robotics. Existing 3D detectors significantly improve the accuracy by adopting a two-stage paradigm which merely…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Xinli Xu , Shaocong Dong , Lihe Ding , Jie Wang , Tingfa Xu , Jianan Li

Scene understanding plays an essential role in enabling autonomous driving and maintaining high standards of performance and safety. To address this task, cameras and laser scanners (LiDARs) have been the most commonly used sensors, with…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Yahia Dalbah , Jean Lahoud , Hisham Cholakkal

Existing LiDAR-Camera fusion methods have achieved strong results in 3D object detection. To address the sparsity of point clouds, previous approaches typically construct spatial pseudo point clouds via depth completion as auxiliary input…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Jijun Wang , Yan Wu , Yujian Mo , Junqiao Zhao , Jun Yan , Yinghao Hu

Distributed radar sensors enable robust human activity recognition. However, scaling the number of coordinated nodes introduces challenges in feature extraction from large datasets, and transparent data fusion. We propose an end-to-end…

Signal Processing · Electrical Eng. & Systems 2026-01-07 Mina Shahbazifar , Zolfa Zeinalpour-Yazdi , Matthias Hollick , Arash Asadi , Vahid Jamali

The detection of multiple extended targets in complex environments using high-resolution automotive radar is considered. A data-driven approach is proposed where unlabeled synchronized lidar data is used as ground truth to train a neural…

Signal Processing · Electrical Eng. & Systems 2024-11-14 Ignacio Roldan , Andras Palffy , Julian F. P. Kooij , Dariu M. Gavrila , Francesco Fioranelli , Alexander Yarovoy

One-shot object detection aims at detecting novel objects according to merely one given instance. With extreme data scarcity, current approaches explore various feature fusions to obtain directly transferable meta-knowledge. Yet, their…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yizhou Zhao , Xun Guo , Yan Lu

Accurate and robust environmental perception is crucial for robot autonomous navigation. While current methods typically adopt optical sensors (e.g., camera, LiDAR) as primary sensing modalities, their susceptibility to visual occlusion…

Robotics · Computer Science 2025-09-04 Ruibin Zhang , Fei Gao