English
Related papers

Related papers: Multimodal 3D Object Detection from Simulated Pret…

200 papers

Autonomous driving and assistance systems rely on annotated data from traffic and road scenarios to model and learn the various object relations in complex real-world scenarios. Preparation and training of deploy-able deep learning…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Shubham Dokania , A. H. Abdul Hafez , Anbumani Subramanian , Manmohan Chandraker , C. V. Jawahar

Prior work in 3D object detection evaluates models using offline metrics like average precision since closed-loop online evaluation on the downstream driving task is costly. However, it is unclear how indicative offline results are of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Tim Schreier , Katrin Renz , Andreas Geiger , Kashyap Chitta

Multi-object tracking (MOT) with camera-LiDAR fusion demands accurate results of object detection, affinity computation and data association in real time. This paper presents an efficient multi-modal MOT framework with online joint…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Kemiao Huang , Qi Hao

Drones equipped with cameras can significantly enhance human ability to perceive the world because of their remarkable maneuverability in 3D space. Ironically, object detection for drones has always been conducted in the 2D image space,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Yue Hu , Shaoheng Fang , Weidi Xie , Siheng Chen

Aiming at facilitating a real-world, ever-evolving and scalable autonomous driving system, we present a large-scale dataset for standardizing the evaluation of different self-supervised and semi-supervised approaches by learning from raw…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Jianhua Han , Xiwen Liang , Hang Xu , Kai Chen , Lanqing Hong , Jiageng Mao , Chaoqiang Ye , Wei Zhang , Zhenguo Li , Xiaodan Liang , Chunjing Xu

Simulation systems have become an essential component in the development and validation of autonomous driving technologies. The prevailing state-of-the-art approach for simulation is to use game engines or high-fidelity computer graphics…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Wei Li , Chengwei Pan , Rong Zhang , Jiaping Ren , Yuexin Ma , Jin Fang , Feilong Yan , Qichuan Geng , Xinyu Huang , Huajun Gong , Weiwei Xu , Guoping Wang , Dinesh Manocha , Ruigang Yang

Point cloud data from 3D LiDAR sensors are one of the most crucial sensor modalities for versatile safety-critical applications such as self-driving vehicles. Since the annotations of point cloud data is an expensive and time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2019-05-23 Khaled Saleh , Ahmed Abobakr , Mohammed Attia , Julie Iskander , Darius Nahavandi , Mohammed Hossny

Accurate 3D object detection and understanding for self-driving cars heavily relies on LiDAR point clouds, necessitating large amounts of labeled data to train. In this work, we introduce an innovative pre-training approach, Grounded Point…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Tai-Yu Pan , Chenyang Ma , Tianle Chen , Cheng Perng Phoo , Katie Z Luo , Yurong You , Mark Campbell , Kilian Q. Weinberger , Bharath Hariharan , Wei-Lun Chao

Accurate 3D object detection is critical for autonomous driving, necessitating reliable, cost-effective sensors capable of operating in adverse weather conditions. Camera and millimeter-wave radar fusion has emerged as a promising solution;…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Bingyi Liu , Chuanhui Zhu , Hongfei Xue , Jian Teng , Jipeng Liu , Enshu Wang , Penglin Dai , Pu Wang

The task of driver attention prediction has drawn considerable interest among researchers in robotics and the autonomous vehicle industry. Driver attention prediction can play an instrumental role in mitigating and preventing high-risk…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Yuan Shen , Niviru Wijayaratne , Pranav Sriram , Aamir Hasan , Peter Du , Katie Driggs-Campbell

Perceiving the surrounding environment is a fundamental task in autonomous driving. To obtain highly accurate perception results, modern autonomous driving systems typically employ multi-modal sensors to collect comprehensive environmental…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zhiwei Lin , Zhe Liu , Yongtao Wang , Le Zhang , Ce Zhu

Autonomous driving algorithms rely heavily on learning-based models, which require large datasets for training. However, there is often a large amount of redundant information in these datasets, while collecting and processing these…

Machine Learning · Computer Science 2023-06-27 Jianyu Lai , Zexuan Jia , Boao Li

Mobile robots and autonomous vehicles rely on multi-modal sensor setups to perceive and understand their surroundings. Aside from cameras, LiDAR sensors represent a central component of state-of-the-art perception systems. In addition to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-27 Florian Piewak , Peter Pinggera , Manuel Schäfer , David Peter , Beate Schwarz , Nick Schneider , David Pfeiffer , Markus Enzweiler , Marius Zöllner

Object detection using automotive radars has not been explored with deep learning models in comparison to the camera based approaches. This can be attributed to the lack of public radar datasets. In this paper, we collect a novel radar…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Ao Zhang , Farzan Erlik Nowruzi , Robert Laganiere

In the manufacturing industry, computer vision systems based on artificial intelligence (AI) are widely used to reduce costs and increase production. Training these AI models requires a large amount of training data that is costly to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Steven Moonen , Rob Salaets , Kenneth Batstone , Abdellatif Bey-Temsamani , Nick Michiels

We introduce the UT Campus Object Dataset (CODa), a mobile robot egocentric perception dataset collected on the University of Texas Austin Campus. Our dataset contains 8.5 hours of multimodal sensor data: synchronized 3D point clouds and…

LiDAR datasets for autonomous driving exhibit biases in properties such as point cloud density, range, and object dimensions. As a result, object detection networks trained and evaluated in different environments often experience…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Deepti Hegde , Suhas Lohit , Kuan-Chuan Peng , Michael J. Jones , Vishal M. Patel

This work aims to address the challenges in autonomous driving by focusing on the 3D perception of the environment using roadside LiDARs. We design a 3D object detection model that can detect traffic participants in roadside LiDARs in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Walter Zimmer , Jialong Wu , Xingcheng Zhou , Alois C. Knoll

As perception models continue to develop, the need for large-scale datasets increases. However, data annotation remains far too expensive to effectively scale and meet the demand. Synthetic datasets provide a solution to boost model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Arpit Jadon , Haoran Wang , Phillip Thomas , Michael Stanley , S. Nathaniel Cibik , Rachel Laurat , Omar Maher , Lukas Hoyer , Ozan Unal , Dengxin Dai

Recent years have witnessed huge successes in 3D object detection to recognize common objects for autonomous driving (e.g., vehicles and pedestrians). However, most methods rely heavily on a large amount of well-labeled training data. This…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Jiawei Liu , Xingping Dong , Sanyuan Zhao , Jianbing Shen