English
Related papers

Related papers: Viewpoint Equivariance for Multi-View 3D Object De…

200 papers

Realizing unified 3D object detection, including both indoor and outdoor scenes, holds great importance in applications like robot navigation. However, involving various scenarios of data to train models poses challenges due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zhuoling Li , Xiaogang Xu , SerNam Lim , Hengshuang Zhao

Sparse query-based paradigms have achieved significant success in multi-view 3D detection for autonomous vehicles. Current research faces challenges in balancing between enlarging receptive fields and reducing interference when aggregating…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Jiasen Wang , Zhenglin Li , Ke Sun , Xianyuan Liu , Yang Zhou

Perceiving the surrounding environment is a fundamental task in autonomous driving. To obtain highly accurate perception results, modern autonomous driving systems typically employ multi-modal sensors to collect comprehensive environmental…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zhiwei Lin , Zhe Liu , Yongtao Wang , Le Zhang , Ce Zhu

Input aggregation is a simple technique used by state-of-the-art LiDAR 3D object detectors to improve detection. However, increasing aggregation is known to have diminishing returns and even performance degradation, due to objects…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Chengjie Huang , Vahdat Abdelzad , Sean Sedwards , Krzysztof Czarnecki

In this paper, we address the problem of detecting 3D objects from multi-view images. Current query-based methods rely on global 3D position embeddings (PE) to learn the geometric correspondence between images and 3D space. We claim that…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Kaixin Xiong , Shi Gong , Xiaoqing Ye , Xiao Tan , Ji Wan , Errui Ding , Jingdong Wang , Xiang Bai

3D object detection from multiple image views is a fundamental and challenging task for visual scene understanding. Owing to its low cost and high efficiency, multi-view 3D object detection has demonstrated promising application prospects.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Zehui Chen , Zhenyu Li , Shiquan Zhang , Liangji Fang , Qinhong Jiang , Feng Zhao

In the field of autonomous driving, accurate and comprehensive perception of the 3D environment is crucial. Bird's Eye View (BEV) based methods have emerged as a promising solution for 3D object detection using multi-view images as input.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Qiu Zhou , Jinming Cao , Hanchao Leng , Yifang Yin , Yu Kun , Roger Zimmermann

Multi-view 3D object detection (MV3D-Det) in Bird-Eye-View (BEV) has drawn extensive attention due to its low cost and high efficiency. Although new algorithms for camera-only 3D object detection have been continuously proposed, most of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Shuo Wang , Xinhai Zhao , Hai-Ming Xu , Zehui Chen , Dameng Yu , Jiahao Chang , Zhen Yang , Feng Zhao

3D object detection in Bird's-Eye-View (BEV) space has recently emerged as a prevalent approach in the field of autonomous driving. Despite the demonstrated improvements in accuracy and velocity estimation compared to perspective view…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yuxin Li , Qiang Han , Mengying Yu , Yuxin Jiang , Chaikiat Yeo , Yiheng Li , Zihang Huang , Nini Liu , Hsuanhan Chen , Xiaojun Wu

For 3D object detection, both camera and lidar have been demonstrated to be useful sensory devices for providing complementary information about the same scenery with data representations in different modalities, e.g., 2D RGB image vs 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Xinhao Xiang , Jiawei Zhang

3D object detection received increasing attention in autonomous driving recently. Objects in 3D scenes are distributed with diverse orientations. Ordinary detectors do not explicitly model the variations of rotation and reflection…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Hai Wu , Chenglu Wen , Wei Li , Xin Li , Ruigang Yang , Cheng Wang

The past few years have witnessed the rapid development of vision-centric 3D perception in autonomous driving. Although the 3D perception models share many structural and conceptual similarities, there still exist gaps in their feature…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Yu Hong , Qian Liu , Huayuan Cheng , Danjiao Ma , Hang Dai , Yu Wang , Guangzhi Cao , Yong Ding

Vision-centric Bird's Eye View (BEV) perception holds considerable promise for autonomous driving. Recent studies have prioritized efficiency or accuracy enhancements, yet the issue of domain shift has been overlooked, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Rongyu Zhang , Jiaming Liu , Xiaoqi Li , Xiaowei Chi , Dan Wang , Li Du , Yuan Du , Shanghang Zhang

3D visual perception tasks based on multi-camera images are essential for autonomous driving systems. Latest work in this field performs 3D object detection by leveraging multi-view images as an input and iteratively enhancing object…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Jongwoo Park , Apoorv Singh , Varun Bankiti

The Bird's-Eye-View (BEV) representation is a critical factor that directly impacts the 3D object detection performance, but the traditional BEV grid representation induces quadratic computational cost as the spatial resolution grows. To…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zhili Chen , Shuangjie Xu , Maosheng Ye , Zian Qian , Xiaoyi Zou , Dit-Yan Yeung , Qifeng Chen

Recently, the rise of query-based Transformer decoders is reshaping camera-based 3D object detection. These query-based decoders are surpassing the traditional dense BEV (Bird's Eye View)-based methods. However, we argue that dense BEV…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Zhenxin Li , Shiyi Lan , Jose M. Alvarez , Zuxuan Wu

This paper aims at high-accuracy 3D object detection in autonomous driving scenario. We propose Multi-View 3D networks (MV3D), a sensory-fusion framework that takes both LIDAR point cloud and RGB images as input and predicts oriented 3D…

Computer Vision and Pattern Recognition · Computer Science 2017-06-23 Xiaozhi Chen , Huimin Ma , Ji Wan , Bo Li , Tian Xia

3D object detection algorithms for autonomous driving reason about 3D obstacles either from 3D birds-eye view or perspective view or both. Recent works attempt to improve the detection performance via mining and fusing from multiple…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Liang Xie , Guodong Xu , Deng Cai , Xiaofei He

We introduce a framework for multi-camera 3D object detection. In contrast to existing works, which estimate 3D bounding boxes directly from monocular images or use depth prediction networks to generate input for 3D object detection from 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Yue Wang , Vitor Guizilini , Tianyuan Zhang , Yilun Wang , Hang Zhao , Justin Solomon

Detecting unseen instances based on multi-view templates is a challenging problem due to its open-world nature. Traditional methodologies, which primarily rely on 2D representations and matching techniques, are often inadequate in handling…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Bowen Li , Jiashun Wang , Yaoyu Hu , Chen Wang , Sebastian Scherer