中文
相关论文

相关论文: A Novel Vision Transformer for Camera-LiDAR Fusion…

200 篇论文

Action recognition from multi-modal and multi-view observations holds significant potential for applications in surveillance, robotics, and smart environments. However, existing methods often fall short of addressing real-world challenges…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Trung Thanh Nguyen , Yasutomo Kawanishi , Vijay John , Takahiro Komamizu , Ichiro Ide

The awareness about moving objects in the surroundings of a self-driving vehicle is essential for safe and reliable autonomous navigation. The interpretation of LiDAR and camera data achieves exceptional results but typically requires to…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Matthias Zeller , Vardeep S. Sandhu , Benedikt Mersch , Jens Behley , Michael Heidingsfeld , Cyrill Stachniss

Lidars and cameras are critical sensors that provide complementary information for 3D detection in autonomous driving. While prevalent multi-modal methods simply decorate raw lidar point clouds with camera features and feed them directly to…

计算机视觉与模式识别 · 计算机科学 2022-03-17 Yingwei Li , Adams Wei Yu , Tianjian Meng , Ben Caine , Jiquan Ngiam , Daiyi Peng , Junyang Shen , Bo Wu , Yifeng Lu , Denny Zhou , Quoc V. Le , Alan Yuille , Mingxing Tan

The combination of LiDAR and camera modalities is proven to be necessary and typical for 3D object detection according to recent studies. Existing fusion strategies tend to overly rely on the LiDAR modal in essence, which exploits the…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Yang Yang , Weijie Ma , Hao Chen , Linlin Ou , Xinyi Yu

To enable self-driving vehicles accurate detection and tracking of surrounding objects is essential. While Light Detection and Ranging (LiDAR) sensors have set the benchmark for high-performance systems, the appeal of camera-only solutions…

计算机视觉与模式识别 · 计算机科学 2024-08-07 Nicolas Baumann , Michael Baumgartner , Edoardo Ghignone , Jonas Kühne , Tobias Fischer , Yung-Hsu Yang , Marc Pollefeys , Michele Magno

In end-to-end autonomous driving, the utilization of existing sensor fusion techniques and navigational control methods for imitation learning proves inadequate in challenging situations that involve numerous dynamic agents. To address this…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Pedram Agand , Mohammad Mahdavian , Manolis Savva , Mo Chen

Integrating LiDAR and Camera information into Bird's-Eye-View (BEV) has become an essential topic for 3D object detection in autonomous driving. Existing methods mostly adopt an independent dual-branch framework to generate LiDAR and camera…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Hongxiang Cai , Zeyuan Zhang , Zhenyu Zhou , Ziyin Li , Wenbo Ding , Jiuhua Zhao

In this study, we present a novel LiDAR-based semantic segmentation framework tailored for autonomous forklifts operating in complex outdoor environments. Central to our approach is the integration of a dual LiDAR system, which combines…

机器人学 · 计算机科学 2025-05-29 Benjamin Serfling , Hannes Reichert , Lorenzo Bayerlein , Konrad Doll , Kati Radkhah-Lens

This paper tackles the 3D object detection problem, which is of vital importance for applications such as autonomous driving. Our framework uses a Machine Learning (ML) pipeline on a combination of monocular camera and LiDAR data to detect…

计算机视觉与模式识别 · 计算机科学 2021-05-25 Gustavo A. Salazar-Gomez , Miguel A. Saavedra-Ruiz , Victor A. Romero-Cano

The use of intelligent automation is growing significantly in the automotive industry, as it assists drivers and fleet management companies, thus increasing their productivity. Dash cams are now been used for this purpose which enables the…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Osama Mustafa , Khizer Ali , Anam Bibi , Imran Siddiqi , Momina Moetesum

Road terrains play a crucial role in ensuring the driving safety of autonomous vehicles (AVs). However, existing sensors of AVs, including cameras and Lidars, are susceptible to variations in lighting and weather conditions, making it…

人工智能 · 计算机科学 2025-05-19 Rui Wang , Shichun Yang , Yuyi Chen , Zhuoyang Li , Zexiang Tong , Jianyi Xu , Jiayi Lu , Xinjie Feng , Yaoguang Cao

In self-driving applications, LiDAR data provides accurate information about distances in 3D but lacks the semantic richness of camera data. Therefore, state-of-the-art methods for perception in urban scenes fuse data from both sensor…

计算机视觉与模式识别 · 计算机科学 2023-06-13 Royden Wagner , Marvin Klemp , Carlos Fernandez Lopez

In this paper, we propose a novel 3D object detector that can exploit both LIDAR as well as cameras to perform very accurate localization. Towards this goal, we design an end-to-end learnable architecture that exploits continuous…

计算机视觉与模式识别 · 计算机科学 2020-12-22 Ming Liang , Bin Yang , Shenlong Wang , Raquel Urtasun

Motion estimation approaches typically employ sensor fusion techniques, such as the Kalman Filter, to handle individual sensor failures. More recently, deep learning-based fusion approaches have been proposed, increasing the performance and…

计算机视觉与模式识别 · 计算机科学 2022-09-19 Nimet Kaygusuz , Oscar Mendez , Richard Bowden

Cameras and LiDARs are both important sensors for autonomous driving, playing critical roles in 3D object detection. Camera-LiDAR Fusion has been a prevalent solution for robust and accurate driving perception. In contrast to the vast…

机器人学 · 计算机科学 2024-03-05 Ye Li , Hanjiang Hu , Zuxin Liu , Xiaohao Xu , Xiaonan Huang , Ding Zhao

We present a new way to detect 3D objects from multimodal inputs, leveraging both LiDAR and RGB cameras in a hybrid late-cascade scheme, that combines an RGB detection network and a 3D LiDAR detector. We exploit late fusion principles to…

计算机视觉与模式识别 · 计算机科学 2026-01-15 Carlo Sgaravatti , Roberto Basla , Riccardo Pieroni , Matteo Corno , Sergio M. Savaresi , Luca Magri , Giacomo Boracchi

We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different view…

计算机视觉与模式识别 · 计算机科学 2021-10-20 Sudeep Fadadu , Shreyash Pandey , Darshan Hegde , Yi Shi , Fang-Chieh Chou , Nemanja Djuric , Carlos Vallespi-Gonzalez

With information from multiple input modalities, sensor fusion-based algorithms usually out-perform their single-modality counterparts in robotics. Camera and LIDAR, with complementary semantic and depth information, are the typical choices…

计算机视觉与模式识别 · 计算机科学 2022-07-11 Akio Kodaira , Yiyang Zhou , Pengwei Zang , Wei Zhan , Masayoshi Tomizuka

In this paper, we study the problem of jointly estimating the optical flow and scene flow from synchronized 2D and 3D data. Previous methods either employ a complex pipeline that splits the joint task into independent stages, or fuse 2D and…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Haisong Liu , Tao Lu , Yihui Xu , Jia Liu , Limin Wang

4D millimeter-wave (mmWave) radar has been widely adopted in autonomous driving and robot perception due to its low cost and all-weather robustness. However, point-cloud-based radar representations suffer from information loss due to…

计算机视觉与模式识别 · 计算机科学 2026-01-16 Runwei Guan , Jianan Liu , Shaofeng Liang , Fangqiang Ding , Shanliang Yao , Xiaokai Bai , Daizong Liu , Tao Huang , Guoqiang Mao , Hui Xiong