English
Related papers

Related papers: Towards Self-Supervised High Level Sensor Fusion

200 papers

Traditional decision and planning frameworks for self-driving vehicles (SDVs) scale poorly in new scenarios, thus they require tedious hand-tuning of rules and parameters to maintain acceptable performance in all foreseeable cases.…

Robotics · Computer Science 2021-08-02 Peide Cai , Hengli Wang , Yuxiang Sun , Ming Liu

In this era of active development of autonomous vehicles, it becomes crucial to provide driving systems with the capacity to explain their decisions. In this work, we focus on generating high-level driving explanations as the vehicle…

Machine Learning · Computer Science 2021-11-24 Hédi Ben-Younes , Éloi Zablocki , Patrick Pérez , Matthieu Cord

Autonomous vehicle safety is crucial for the successful deployment of self-driving cars. However, most existing planning methods rely heavily on imitation learning, which limits their ability to leverage collision data effectively.…

Robotics · Computer Science 2025-03-07 Zi Wang , Shiyi Lan , Xinglong Sun , Nadine Chang , Zhenxin Li , Zhiding Yu , Jose M. Alvarez

This paper presents a novel method for pedestrian detection and tracking by fusing camera and LiDAR sensor data. To deal with the challenges associated with the autonomous driving scenarios, an integrated tracking and detection framework is…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Muhammad Mobaidul Islam , Abdullah Al Redwan Newaz , Ali Karimoddini

Visual recognition inside the vehicle cabin leads to safer driving and more intuitive human-vehicle interaction but such systems face substantial obstacles as they need to capture different granularities of driver behaviour while dealing…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Alina Roitberg , Kunyu Peng , Zdravko Marinov , Constantin Seibold , David Schneider , Rainer Stiefelhagen

A convolutional neural network (CNN) approach is used to implement a level 2 autonomous vehicle by mapping pixels from the camera input to the steering commands. The network automatically learns the maximum variable features from the camera…

Robotics · Computer Science 2019-09-10 Akhil Agnihotri , Prathamesh Saraf , Kriti Rajesh Bapnad

A fundamental challenge in car-following modeling lies in accurately representing the multi-scale complexity of driving behaviors, particularly the intra-driver heterogeneity where a single driver's actions fluctuate dynamically under…

Machine Learning · Computer Science 2025-06-09 Shirui Zhou , Jiying Yan , Junfang Tian , Tao Wang , Yongfu Li , Shiquan Zhong

Up-to-date High-Definition (HD) maps are essential for self-driving cars. To achieve constantly updated HD maps, we present a deep neural network (DNN), Diff-Net, to detect changes in them. Compared to traditional methods based on object…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Lei He , Shengjie Jiang , Xiaoqing Liang , Ning Wang , Shiyu Song

Merging into dense highway traffic for an autonomous vehicle is a complex decision-making task, wherein the vehicle must identify a potential gap and coordinate with surrounding human drivers, each of whom may exhibit diverse driving…

Accurate environmental representations are essential for autonomous driving, providing the foundation for safe and efficient navigation. Traditionally, high-definition (HD) maps are providing this representation of the static road…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Thomas Monninger , Zihan Zhang , Steffen Staab , Sihao Ding

Currently decision making is one of the biggest challenges in autonomous driving. This paper introduces a method for safely navigating an autonomous vehicle in highway scenarios by combining deep Q-Networks and insight from control theory.…

Robotics · Computer Science 2023-03-23 Max Peter Ronecker , Yuan Zhu

LiDAR sensors are widely used in autonomous driving due to the reliable 3D spatial information. However, the data of LiDAR is sparse and the frequency of LiDAR is lower than that of cameras. To generate denser point clouds spatially and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Xudong Huang , Chunyu Lin , Haojie Liu , Lang Nie , Yao Zhao

Image Super-Resolution (SR) provides a promising technique to enhance the image quality of low-resolution optical sensors, facilitating better-performing target detection and autonomous navigation in a wide range of robotics applications.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Fan Wang , Jiangxin Yang , Yanlong Cao , Yanpeng Cao , Michael Ying Yang

Driver Monitoring Systems (DMSs) are crucial for safe hand-over actions in Level-2+ self-driving vehicles. State-of-the-art DMSs leverage multiple sensors mounted at different locations to monitor the driver and the vehicle's interior scene…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yiming Ma , Victor Sanchez , Soodeh Nikan , Devesh Upadhyay , Bhushan Atote , Tanaya Guha

Robust road detection is a key challenge in safe autonomous driving. Recently, with the rapid development of 3D sensors, more and more researchers are trying to fuse information across different sensors to improve the performance of road…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Huafeng Liu , Xiaofeng Han , Xiangrui Li , Yazhou Yao , Pu Huang , Zhenming Tang

Nowadays, Earth Observation systems provide a multitude of heterogeneous remote sensing data. How to manage such richness leveraging its complementarity is a crucial chal- lenge in modern remote sensing analysis. Data Fusion techniques deal…

Computer Vision and Pattern Recognition · Computer Science 2018-07-02 Raffaele Gaetano , Dino Ienco , Kenji Ose , Remi Cresson

Self-driving vehicles and autonomous ground robots require a reliable and accurate method to analyze the traversability of the surrounding environment for safe navigation. This paper proposes and evaluates a real-time machine learning-based…

Algorithms that fuse multiple input sources benefit from both complementary and shared information. Shared information may provide robustness against faulty or noisy inputs, which is indispensable for safety-critical applications like…

Machine Learning · Computer Science 2019-10-17 Taewan Kim , Joydeep Ghosh

Reliable detection and tracking of surrounding objects are indispensable for comprehensive motion prediction and planning of autonomous vehicles. Due to the limitations of individual sensors, the fusion of multiple sensor modalities is…

Robotics · Computer Science 2023-10-13 Phillip Karle , Felix Fent , Sebastian Huch , Florian Sauerbeck , Markus Lienkamp

Focusing on the task of point-to-point navigation for an autonomous driving vehicle, we propose a novel deep learning model trained with end-to-end and multi-task learning manners to perform both perception and control tasks simultaneously.…

Robotics · Computer Science 2022-06-23 Oskar Natan , Jun Miura