English
Related papers

Related papers: Multi-Task Multi-Sensor Fusion for 3D Object Detec…

200 papers

While numerous 3D detection works leverage the complementary relationship between RGB images and point clouds, developments in the broader framework of semi-supervised object recognition remain uninfluenced by multi-modal fusion. Current…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Jinhyung Park , Chenfeng Xu , Yiyang Zhou , Masayoshi Tomizuka , Wei Zhan

Directly learning multiple 3D objects motion from sequential images is difficult, while the geometric bundle adjustment lacks the ability to localize the invisible object centroid. To benefit from both the powerful object understanding…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Peiliang Li , Jieqi Shi , Shaojie Shen

360 cameras capture the entire surrounding environment with a large FoV, exhibiting comprehensive visual information to directly infer the 3D structures, e.g., depth and surface normal, and semantic information simultaneously. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Hao Ai , Lin Wang

We propose a new method for fusing a LIDAR point cloud and camera-captured images in the deep convolutional neural network (CNN). The proposed method constructs a new layer called non-homogeneous pooling layer to transform features between…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Zining Wang , Wei Zhan , Masayoshi Tomizuka

We propose to jointly learn multi-view geometry and warping between views of the same object instances for robust cross-view object detection. What makes multi-view object instance detection difficult are strong changes in viewpoint,…

Machine Learning · Computer Science 2019-07-26 Ahmed Samy Nassar , Sebastien Lefevre , Jan D. Wegner

Object detection through either RGB images or the LiDAR point clouds has been extensively explored in autonomous driving. However, it remains challenging to make these two data sources complementary and beneficial to each other. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Zehui Chen , Zhenyu Li , Shiquan Zhang , Liangji Fang , Qinghong Jiang , Feng Zhao , Bolei Zhou , Hang Zhao

In autonomous driving, 3D object detection provides more precise information for downstream tasks, including path planning and motion estimation, compared to 2D object detection. In this paper, we propose SeSame: a method aimed at enhancing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Hayeon O , Chanuk Yang , Kunsoo Huh

While LiDAR sensors have been successfully applied to 3D object detection, the affordability of radar and camera sensors has led to a growing interest in fusing radars and cameras for 3D object detection. However, previous radar-camera…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Jisong Kim , Minjae Seong , Geonho Bang , Dongsuk Kum , Jun Won Choi

Combining LiDAR and Camera-view data has become a common approach for 3D Object Detection. However, previous approaches combine the two input streams at a point-level, throwing away semantic information derived from camera features. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Pranav Gupta , Rishabh Rengarajan , Viren Bankapur , Vedansh Mannem , Lakshit Ahuja , Surya Vijay , Kevin Wang

The recent trend in 2D multiple object tracking (MOT) is jointly solving detection and tracking, where object detection and appearance feature (or motion) are learned simultaneously. Despite competitive performance, in crowded scenes, joint…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Weihong Ren , Denglu Wu , Hui Cao , Xi'ai Chen , Zhi Han , Honghai Liu

3D object detection has achieved remarkable progress by taking point clouds as the only input. However, point clouds often suffer from incomplete geometric structures and the lack of semantic information, which makes detectors hard to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Hao Yang , Chen Shi , Yihong Chen , Liwei Wang

In autonomous driving, 3D object detection based on multi-modal data has become an indispensable approach when facing complex environments around the vehicle. During multi-modal detection, LiDAR and camera are simultaneously applied for…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Rui Wan , Tianyun Zhao , Wei Zhao

Recent camera-based 3D object detection methods have introduced sequential frames to improve the detection performance hoping that multiple frames would mitigate the large depth estimation error. Despite improved detection performance,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanmin Kim , Youngseok Kim , In-Jae Lee , Dongsuk Kum

Growing customer demand for smart solutions in robotics and augmented reality has attracted considerable attention to 3D object detection from point clouds. Yet, existing indoor datasets taken individually are too small and insufficiently…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Maksim Kolodiazhnyi , Anna Vorontsova , Matvey Skripkin , Danila Rukhovich , Anton Konushin

In this paper, we propose a novel approach to address the problem of camera and radar sensor fusion for 3D object detection in autonomous vehicle perception systems. Our approach builds on recent advances in deep learning and leverages the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Daniel Dworak , Mateusz Komorkiewicz , Paweł Skruch , Jerzy Baranowski

Though 3D object detection from point clouds has achieved rapid progress in recent years, the lack of flexible and high-performance proposal refinement remains a great hurdle for existing state-of-the-art two-stage detectors. Previous works…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Hualian Sheng , Sijia Cai , Yuan Liu , Bing Deng , Jianqiang Huang , Xian-Sheng Hua , Min-Jian Zhao

With the rapid advancement of hardware and software technologies, research in autonomous driving has seen significant growth. The prevailing framework for multi-sensor autonomous driving encompasses sensor installation, perception, path…

Robotics · Computer Science 2024-03-07 Chuanyu Luo , Nuo Cheng , Ren Zhong , Haipeng Jiang , Wenyu Chen , Aoli Wang , Pu Li

With the development of computer vision, 3D object detection has become increasingly important in many real-world applications. Limited by the computing power of sensor-side hardware, the detection task is sometimes deployed on remote…

Image and Video Processing · Electrical Eng. & Systems 2025-02-19 Zijian Cao , Hua Zhang , Le Liang , Haotian Wang , Shi Jin , Geoffrey Ye Li

Accurate and robust 3D object detection is a critical component in autonomous vehicles and robotics. While recent radar-camera fusion methods have made significant progress by fusing information in the bird's-eye view (BEV) representation,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Jisong Kim , Minjae Seong , Jun Won Choi

We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different view…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Sudeep Fadadu , Shreyash Pandey , Darshan Hegde , Yi Shi , Fang-Chieh Chou , Nemanja Djuric , Carlos Vallespi-Gonzalez