English
Related papers

Related papers: FOMO-3D: Using Vision Foundation Models for Long-T…

200 papers

Modern autonomous vehicles rely heavily on mechanical LiDARs for perception. Current perception methods generally require 360{\deg} point clouds, collected sequentially as the LiDAR scans the azimuth and acquires consecutive wedge-shaped…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Mazen Abdelfattah , Kaiwen Yuan , Z. Jane Wang , Rabab Ward

Existing vehicle detectors are usually obtained by training a typical detector (e.g., YOLO, RCNN, DETR series) on vehicle images based on a pre-trained backbone (e.g., ResNet, ViT). Some researchers also exploit and enhance the detection…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Wentao Wu , Fanghua Hong , Xiao Wang , Chenglong Li , Jin Tang

We propose DeepFusion, a modular multi-modal architecture to fuse lidars, cameras and radars in different combinations for 3D object detection. Specialized feature extractors take advantage of each modality and can be exchanged easily,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Florian Drews , Di Feng , Florian Faion , Lars Rosenbaum , Michael Ulrich , Claudius Gläser

Lidar based 3D object detection and classification tasks are essential for automated driving(AD). A Lidar sensor can provide the 3D point coud data reconstruction of the surrounding environment. But the detection in 3D point cloud still…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Xuanyu YIN , Yoko SASAKI , Weimin WANG , Kentaro SHIMIZU

There has been significant progress made in the field of autonomous vehicles. Object detection and tracking are the primary tasks for any autonomous vehicle. The task of object detection in autonomous vehicles relies on a variety of sensors…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Gaurav Raut , Advait Patole

LiDAR point clouds can effectively depict the motion and posture of objects in three-dimensional space. Many studies accomplish the 3D object detection by voxelizing point clouds. However, in autonomous driving scenarios, the sparsity and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yongxin Shao , Aihong Tan , Binrui Wang , Tianhong Yan , Zhetao Sun , Yiyang Zhang , Jiaxin Liu

Monocular 3D Object Detection represents a challenging Computer Vision task due to the nature of the input used, which is a single 2D image, lacking in any depth cues and placing the depth estimation problem as an ill-posed one. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Diana-Alexandra Sas , Florin Oniga

The goal of this paper is open-vocabulary object detection (OVOD) $\unicode{x2013}$ building a model that can detect objects beyond the set of categories seen at training, thus enabling the user to specify categories of interest at…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Prannay Kaul , Weidi Xie , Andrew Zisserman

Today's state-of-the-art methods for 3D object detection are based on lidar, stereo, or monocular cameras. Lidar-based methods achieve the best accuracy, but have a large footprint, high cost, and mechanically-limited angular sampling…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Frank Julca-Aguilar , Jason Taylor , Mario Bijelic , Fahim Mannan , Ethan Tseng , Felix Heide

3D object detection and occupancy prediction are critical tasks in autonomous driving, attracting significant attention. Despite the potential of recent vision-based methods, they encounter challenges under adverse conditions. Thus,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Lianqing Zheng , Jianan Liu , Runwei Guan , Long Yang , Shouyi Lu , Yuanzhe Li , Xiaokai Bai , Jie Bai , Zhixiong Ma , Hui-Liang Shen , Xichan Zhu

Multi-modal 3D object detectors are dedicated to exploring secure and reliable perception systems for autonomous driving (AD).Although achieving state-of-the-art (SOTA) performance on clean benchmark datasets, they tend to overlook the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ziying Song , Guoxing Zhang , Lin Liu , Lei Yang , Shaoqing Xu , Caiyan Jia , Feiyang Jia , Li Wang

Camera, LiDAR and radar are common perception sensors for autonomous driving tasks. Robust prediction of 3D object detection is optimally based on the fusion of these sensors. To exploit their abilities wisely remains a challenge because…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Ziang Guo , Zakhar Yagudin , Selamawit Asfaw , Artem Lykov , Dzmitry Tsetserukou

Roadside monocular 3D detection requires detecting objects of predefined classes in an RGB frame and predicting their 3D attributes, such as bird's-eye-view (BEV) locations. It has broad applications in traffic control, vehicle-vehicle…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yechi Ma , Yanan Li , Wei Hua , Shu Kong

Autonomous driving, in recent years, has been receiving increasing attention for its potential to relieve drivers' burdens and improve the safety of driving. In modern autonomous driving pipelines, the perception system is an indispensable…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Jiageng Mao , Shaoshuai Shi , Xiaogang Wang , Hongsheng Li

Vision foundation models (VFMs) trained on large-scale image datasets provide high-quality features that have significantly advanced 2D visual recognition. However, their potential in 3D scene segmentation remains largely untapped, despite…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Karim Knaebel , Kadir Yilmaz , Daan de Geus , Alexander Hermans , David Adrian , Timm Linder , Bastian Leibe

Multi-sensor fusion is crucial for accurate 3D object detection in autonomous driving, with cameras and LiDAR being the most commonly used sensors. However, existing methods perform sensor fusion in a single view by projecting features from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Rohit Mohan , Daniele Cattaneo , Florian Drews , Abhinav Valada

The multi-line LiDAR is widely used in autonomous vehicles, so point cloud-based 3D detectors are essential for autonomous driving. Extracting rich multi-scale features is crucial for point cloud-based 3D detectors in autonomous driving due…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Xusheng Li , Chengliang Wang , Shumao Wang , Zhuo Zeng , Ji Liu

Ensuring robust performance on long-tail examples is an important problem for many real-world applications of machine learning, such as autonomous driving. This work focuses on the problem of identifying rare examples within a corpus of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Mao Ye , Gregory P. Meyer , Zaiwei Zhang , Dennis Park , Siva Karthik Mustikovela , Yuning Chai , Eric M Wolff

LiDAR-based 3D detection plays a vital role in autonomous navigation. Surprisingly, although autonomous vehicles (AVs) must detect both near-field objects (for collision avoidance) and far-field objects (for longer-term planning),…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Neehar Peri , Mengtian Li , Benjamin Wilson , Yu-Xiong Wang , James Hays , Deva Ramanan

3D perception using sensors under vehicle industrial standard is the rigid demand in autonomous driving. MEMS LiDAR emerges with irresistible trend due to its lower cost, more robust, and meeting the mass-production standards. However, it…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Jianing Zhang , Wei Li , Honggang Gou , Lu Fang , Ruigang Yang