English
Related papers

Related papers: OmniDet: Surround View Cameras based Multi-task Vi…

200 papers

Camera, LiDAR and radar are common perception sensors for autonomous driving tasks. Robust prediction of 3D object detection is optimally based on the fusion of these sensors. To exploit their abilities wisely remains a challenge because…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Ziang Guo , Zakhar Yagudin , Selamawit Asfaw , Artem Lykov , Dzmitry Tsetserukou

Autonomous driving is a popular research area within the computer vision research community. Since autonomous vehicles are highly safety-critical, ensuring robustness is essential for real-world deployment. While several public multimodal…

Feed-forward foundation models for multi-view 3-dimensional (3D) reconstruction have been trained on large-scale datasets of perspective images; when tested on wide field-of-view images, e.g., from a fisheye camera, their performance…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Ruxiao Duan , Erin Hong , Dongxu Zhao , Eric Turner , Alex Wong , Yunwen Zhou

Adverse conditions like snow, rain, nighttime, and fog, pose challenges for autonomous driving perception systems. Existing methods have limited effectiveness in improving essential computer vision tasks, such as semantic segmentation, and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Chenghao Qian , Mahdi Rezaei , Saeed Anwar , Wenjing Li , Tanveer Hussain , Mohsen Azarmi , Wei Wang

Self-supervised monocular depth estimation has been widely investigated to estimate depth images and relative poses from RGB images. This framework is attractive for researchers because the depth and pose networks can be trained from just…

Computer Vision and Pattern Recognition · Computer Science 2022-02-21 Noriaki Hirose , Kosuke Tahara

3D object tracking is a critical task in autonomous driving systems. It plays an essential role for the system's awareness about the surrounding environment. At the same time there is an increasing interest in algorithms for autonomous cars…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Nicola Marinello , Marc Proesmans , Luc Van Gool

LiDAR is crucial for robust 3D scene perception in autonomous driving. LiDAR perception has the largest body of literature after camera perception. However, multi-task learning across tasks like detection, segmentation, and motion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Sambit Mohapatra , Senthil Yogamani , Varun Ravi Kumar , Stefan Milz , Heinrich Gotzig , Patrick Mäder

To ensure safe operation of autonomous vehicles in complex urban environments, complete perception of the environment is necessary. However, due to environmental conditions, sensor limitations, and occlusions, this is not always possible…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Sven Teufel , Jörg Gamerdinger , Jan-Patrick Kirchner , Georg Volk , Oliver Bringmann

Spatial scene-understanding, including dense depth and ego-motion estimation, is an important problem in computer vision for autonomous vehicles and advanced driver assistance systems. Thus, it is beneficial to design perception modules…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Hemang Chawla , Matti Jukola , Shabbir Marzban , Elahe Arani , Bahram Zonooz

We propose a multi-camera LiDAR-visual-inertial odometry framework, Multi-LVI-SAM, which fuses data from multiple fisheye cameras, LiDAR and inertial sensors for highly accurate and robust state estimation. To enable efficient and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Xinyu Zhang , Kai Huang , Junqiao Zhao , Zihan Yuan , Tiantian Feng

Multi-camera perception methods in Bird's-Eye-View (BEV) have gained wide application in autonomous driving. However, due to the differences between roadside and vehicle-side scenarios, there currently lacks a multi-camera BEV solution in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Jinrang Jia , Guangqi Yi , Yifeng Shi

There has been much recent interest in deep learning methods for monocular image based object pose estimation. While object pose estimation is an important problem for autonomous robot interaction with the physical world, and the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Gideon Billings , Matthew Johnson-Roberson

Accurate localization of other traffic participants is a vital task in autonomous driving systems. State-of-the-art systems employ a combination of sensing modalities such as RGB cameras and LiDARs for localizing traffic participants, but…

Given an image or a video captured from a monocular camera, amodal layout estimation is the task of predicting semantics and occupancy in bird's eye view. The term amodal implies we also reason about entities in the scene that are occluded…

Robotics · Computer Science 2021-08-23 Kaustubh Mani , N. Sai Shankar , Krishna Murthy Jatavallabhula , K. Madhava Krishna

The increase in vehicle ownership has led to increased traffic congestion, more accidents, and higher carbon emissions. Vehicle platooning is a promising solution to address these issues by improving road capacity and reducing fuel…

Robotics · Computer Science 2025-11-25 Jiale Zhang , Yeqiang Qian , Tong Qin , Mingyang Jiang , Siyuan Chen , Ming Yang

This paper aims to design a 3D object detection model from 2D images taken by monocular cameras by combining the estimated bird's-eye view elevation map and the deep representation of object features. The proposed model has a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Ali Babolhavaeji , Mohammad Fanaei

In this paper, a multi-modal 360$^{\circ}$ framework for 3D object detection and tracking for autonomous vehicles is presented. The process is divided into four main stages. First, images are fed into a CNN network to obtain instance…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jorge Beltrán , Carlos Guindel , Irene Cortés , Alejandro Barrera , Armando Astudillo , Jesús Urdiales , Mario Álvarez , Farid Bekka , Vicente Milanés , Fernando García

Surround-view depth estimation is a crucial task aims to acquire the depth maps of the surrounding views. It has many applications in real world scenarios such as autonomous driving, AR/VR and 3D reconstruction, etc. However, given that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yifan Mao , Ming Li , Jian Liu , Jiayang Liu , Zihan Qin , Chunxi Chu , Jialei Xu , Wenbo Zhao , Junjun Jiang , Xianming Liu

Existing deep learning-based approaches for monocular 3D object detection in autonomous driving often model the object as a rotated 3D cuboid while the object's geometric shape has been ignored. In this work, we propose an approach for…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Zongdai Liu , Dingfu Zhou , Feixiang Lu , Jin Fang , Liangjun Zhang

Driver distraction has become a significant cause of severe traffic accidents over the past decade. Despite the growing development of vision-driven driver monitoring systems, the lack of comprehensive perception datasets restricts road…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Dingkang Yang , Shuai Huang , Zhi Xu , Zhenpeng Li , Shunli Wang , Mingcheng Li , Yuzheng Wang , Yang Liu , Kun Yang , Zhaoyu Chen , Yan Wang , Jing Liu , Peixuan Zhang , Peng Zhai , Lihua Zhang