English
Related papers

Related papers: A Multimodal Vision Sensor for Autonomous Driving

200 papers

In this paper, we introduce Semi-SMD, a novel metric depth estimation framework tailored for surrounding cameras equipment in autonomous driving. In this work, the input data consists of adjacent surrounding frames and camera parameters. We…

Robotics · Computer Science 2025-09-10 Yusen Xie , Zhengmin Huang , Shaojie Shen , Jun Ma

Driven by deep learning techniques, perception technology in autonomous driving has developed rapidly in recent years, enabling vehicles to accurately detect and interpret surrounding environment for safe and efficient navigation. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Shanliang Yao , Runwei Guan , Xiaoyu Huang , Zhuoxiao Li , Xiangyu Sha , Yong Yue , Eng Gee Lim , Hyungjoon Seo , Ka Lok Man , Xiaohui Zhu , Yutao Yue

Depth estimation from images serves as the fundamental step of 3D perception for autonomous driving and is an economical alternative to expensive depth sensors like LiDAR. The temporal photometric constraints enables self-supervised depth…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Yi Wei , Linqing Zhao , Wenzhao Zheng , Zheng Zhu , Yongming Rao , Guan Huang , Jiwen Lu , Jie Zhou

Autonomous driving sensors generate an enormous amount of data. In this paper, we explore learned multimodal compression for autonomous driving, specifically targeted at 3D object detection. We focus on camera and LiDAR modalities and…

Image and Video Processing · Electrical Eng. & Systems 2024-08-16 Hadi Hadizadeh , Ivan V. Bajić

Most automated driving systems comprise a diverse sensor set, including several cameras, Radars, and LiDARs, ensuring a complete 360\deg coverage in near and far regions. Unlike Radar and LiDAR, which measure directly in 3D, cameras capture…

We propose a 3D object detection system with multi-sensor refinement in the context of autonomous driving. In our framework, the monocular camera serves as the fundamental sensor for 2D object proposal and initial 3D bounding box…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Peiliang Li , Siqi Liu , Shaojie Shen

In this work we showcase the design and assessment of the performance of a multi-camera UAV, when coupled with state-of-the-art planning and mapping algorithms for autonomous navigation. The system leverages state-of-the-art receding…

Depth estimation plays a important role in SLAM, odometry, and autonomous driving. Especially, monocular depth estimation is profitable technology because of its low cost, memory, and computation. However, it is not a sufficiently…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Hyeonsoo Jang , Yeongmin Ko , Younkwan Lee , Moongu Jeon

Reliable perception is essential for autonomous driving systems to operate safely under diverse real-world traffic conditions. However, camera- and LiDAR-based perception systems suffer from performance degradation under adverse weather and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yue Sun , Yeqiang Qian , Zhe Wang , Tianhui Li , Chunxiang Wang , Ming Yang

This dissertation is a multifaceted contribution to the advancement of vision-based 3D perception technologies. In the first segment, the thesis introduces structural enhancements to both monocular and stereo 3D object detection algorithms.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yuxuan Liu

Majority of the existing robot navigation systems, which facilitate the use of laser range finders, sonar sensors or artificial landmarks, has the ability to locate itself in an unknown environment and then build a map of the corresponding…

Robotics · Computer Science 2014-12-22 Arjun B. Krishnan , Jayaram Kollipara

The perception module of self-driving vehicles relies on a multi-sensor system to understand its environment. Recent advancements in deep learning have led to the rapid development of approaches that integrate multi-sensory measurements to…

Robotics · Computer Science 2023-07-14 Xi Zhu , Likang Wang , Caifa Zhou , Xiya Cao , Yue Gong , Lei Chen

Lidar-based sensing drives current autonomous vehicles. Despite rapid progress, current Lidar sensors still lag two decades behind traditional color cameras in terms of resolution and cost. For autonomous driving, this means that large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Tianwei Yin , Xingyi Zhou , Philipp Krähenbühl

Polarization-based vision has gained increasing attention for providing richer physical cues beyond RGB images. While achieving single-shot capture is highly desirable for practical applications, existing Division-of-Focal-Plane (DoFP)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Shuangfan Zhou , Chu Zhou , Heng Guo , Youwei Lyu , Boxin Shi , Zhanyu Ma , Imari Sato

In this paper, we propose a novel approach to address the problem of camera and radar sensor fusion for 3D object detection in autonomous vehicle perception systems. Our approach builds on recent advances in deep learning and leverages the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Daniel Dworak , Mateusz Komorkiewicz , Paweł Skruch , Jerzy Baranowski

We propose a cross attention transformer based method for multimodal sensor fusion to build a birds eye view of a vessels surroundings supporting safer autonomous marine navigation. The model deeply fuses multiview RGB and long wave…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Dimitrios Dagdilelis , Panagiotis Grigoriadis , Roberto Galeazzi

Autonomous robots that assist humans in day to day living tasks are becoming increasingly popular. Autonomous mobile robots operate by sensing and perceiving their surrounding environment to make accurate driving decisions. A combination of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Varuna De Silva , Jamie Roche , Ahmet Kondoz

Vision-centric autonomous driving has demonstrated excellent performance with economical sensors. As the fundamental step, 3D perception aims to infer 3D information from 2D images based on 3D-2D projection. This makes driving perception…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Ye Li , Wenzhao Zheng , Xiaonan Huang , Kurt Keutzer

One of the main paths towards the reduction of traffic accidents is the increase in vehicle safety through driver assistance systems or even systems with a complete level of autonomy. In these types of systems, tasks such as obstacle…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Felipe Manfio Barbosa , Fernando Santos Osório

Accurate 3D volumetric mapping is critical for autonomous underwater vehicles operating in obstacle-rich environments. Vision-based perception provides high-resolution data but fails in turbid conditions, while sonar is robust to lighting…

Robotics · Computer Science 2026-03-17 Ivana Collado-Gonzalez , John McConnell , Brendan Englot