English
Related papers

Related papers: Towards Domain Generalization for Multi-view 3D Ob…

200 papers

Vision-based Bird's Eye View (BEV) representation is an emerging perception formulation for autonomous driving. The core challenge is to construct BEV space with multi-camera features, which is a one-to-many ill-posed problem. Diving into…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Yiming Wu , Ruixiang Li , Zequn Qin , Xinhai Zhao , Xi Li

Perceiving 3D objects from monocular inputs is crucial for robotic systems, given its economy compared to multi-sensor settings. It is notably difficult as a single image can not provide any clues for predicting absolute depth values.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Tai Wang , Jiangmiao Pang , Dahua Lin

Recently, the rise of query-based Transformer decoders is reshaping camera-based 3D object detection. These query-based decoders are surpassing the traditional dense BEV (Bird's Eye View)-based methods. However, we argue that dense BEV…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Zhenxin Li , Shiyi Lan , Jose M. Alvarez , Zuxuan Wu

Incorporating multiple camera views for detection alleviates the impact of occlusions in crowded scenes. In a multiview system, we need to answer two important questions when dealing with ambiguities that arise from occlusions. First, how…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Yunzhong Hou , Liang Zheng , Stephen Gould

The performance of domain adaptation technologies has not yet reached an ideal level in the current 3D object detection field for autonomous driving, which is mainly due to significant differences in the size of vehicles, as well as the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Ruixiao Zhang , Yihong Wu , Juheon Lee , Adam Prugel-Bennett , Xiaohao Cai

3D lane detection which plays a crucial role in vehicle routing, has recently been a rapidly developing topic in autonomous driving. Previous works struggle with practicality due to their complicated spatial transformations and inflexible…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Ruihao Wang , Jian Qin , Kaiying Li , Yaochen Li , Dong Cao , Jintao Xu

4D radar has received significant attention in autonomous driving thanks to its robustness under adverse weathers. Due to the sparse points and noisy measurements of the 4D radar, most of the research finish the 3D object detection task by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hanzhi Zhong , Zhiyu Xiang , Ruoyu Xu , Jingyun Fu , Peng Xu , Shaohong Wang , Zhihao Yang , Tianyu Pu , Eryun Liu

We propose Radar-Camera fusion transformer (RaCFormer) to boost the accuracy of 3D object detection by the following insight. The Radar-Camera fusion in outdoor 3D scene perception is capped by the image-to-BEV transformation--if the depth…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xiaomeng Chu , Jiajun Deng , Guoliang You , Yifan Duan , Houqiang Li , Yanyong Zhang

Multi-camera 3D object detection for autonomous driving is a challenging problem that has garnered notable attention from both academia and industry. An obstacle encountered in vision-based techniques involves the precise extraction of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Linyan Huang , Huijie Wang , Jia Zeng , Shengchuan Zhang , Liujuan Cao , Junchi Yan , Hongyang Li

Autonomous vehicles (AV) require that neural networks used for perception be robust to different viewpoints if they are to be deployed across many types of vehicles without the repeated cost of data collection and labeling for each. AV…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Tzofi Klinghoffer , Jonah Philion , Wenzheng Chen , Or Litany , Zan Gojcic , Jungseock Joo , Ramesh Raskar , Sanja Fidler , Jose M. Alvarez

The advancement of vision-only Bird's-Eye-View (BEV) perception, a core paradigm for cost-effective autonomous driving, is hindered by the long-standing fundamental trade-off between perception accuracy and on-device deployment efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yuanpeng Chen , Hui Song , Sheng Yang , Wei Tao , Shanhui Mo , Shuang Zhang , Xiao Hua , Tiankun Zhao

In this paper, we propose an anchor-free single-stage LiDAR-based 3D object detector -- RangeDet. The most notable difference with previous works is that our method is purely based on the range view representation. Compared with the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Lue Fan , Xuan Xiong , Feng Wang , Naiyan Wang , Zhaoxiang Zhang

Multi-view 3D object detection is becoming popular in autonomous driving due to its high effectiveness and low cost. Most of the current state-of-the-art detectors follow the query-based bird's-eye-view (BEV) paradigm, which benefits from…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Zhangyang Qi , Jiaqi Wang , Xiaoyang Wu , Hengshuang Zhao

3D object detection is an essential task for computer vision applications in autonomous vehicles and robotics. However, models often struggle to quantify detection reliability, leading to poor performance on unfamiliar scenes. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Nikita Durasov , Rafid Mahmood , Jiwoong Choi , Marc T. Law , James Lucas , Pascal Fua , Jose M. Alvarez

Cross-view image matching for geo-localisation is a challenging problem due to the significant visual difference between aerial and ground-level viewpoints. The method provides localisation capabilities from geo-referenced images,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Tavis Shore , Simon Hadfield , Oscar Mendez

Accurate environment perception is essential for automated driving. When using monocular cameras, the distance estimation of elements in the environment poses a major challenge. Distances can be more easily estimated when the camera…

Computer Vision and Pattern Recognition · Computer Science 2020-05-11 Lennart Reiher , Bastian Lampe , Lutz Eckstein

Recent camera-based 3D object detection methods have introduced sequential frames to improve the detection performance hoping that multiple frames would mitigate the large depth estimation error. Despite improved detection performance,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanmin Kim , Youngseok Kim , In-Jae Lee , Dongsuk Kum

Identifying moving objects is an essential capability for autonomous systems, as it provides critical information for pose estimation, navigation, collision avoidance, and static map construction. In this paper, we present MotionBEV, a fast…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Bo Zhou , Jiapeng Xie , Yan Pan , Jiajie Wu , Chuanzhao Lu

Accurate and robust multimodal multi-task perception is crucial for modern autonomous driving systems. However, current multimodal perception research follows independent paradigms designed for specific perception tasks, leading to a lack…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Xiao Zhao , Xukun Zhang , Dingkang Yang , Mingyang Sun , Mingcheng Li , Shunli Wang , Lihua Zhang

This paper addresses the problem of estimating the 3-DoF camera pose for a ground-level image with respect to a satellite image that encompasses the local surroundings. We propose a novel end-to-end approach that leverages the learning of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Zhenbo Song , Xianghui Ze , Jianfeng Lu , Yujiao Shi