English
Related papers

Related papers: Towards Self-Supervised High Level Sensor Fusion

200 papers

Multispectral imaging is an important task of image processing and computer vision, which is especially relevant to applications such as dehazing or object detection. With the development of the RGBT (RGB & Thermal) sensor, the problem of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Nati Ofir , Jean-Christophe Nebel

We present a novel method for testing the safety of self-driving vehicles in simulation. We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps. Instead, we directly simulate the outputs…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Kelvin Wong , Qiang Zhang , Ming Liang , Bin Yang , Renjie Liao , Abbas Sadat , Raquel Urtasun

Characterizing driving styles of human drivers using vehicle sensor data, e.g., GPS, is an interesting research problem and an important real-world requirement from automotive industries. A good representation of driving features can be…

Artificial Intelligence · Computer Science 2016-10-11 Weishan Dong , Jian Li , Renjie Yao , Changsheng Li , Ting Yuan , Lanjun Wang

High-definition (HD) maps play a crucial role in autonomous driving systems. Recent methods have attempted to construct HD maps in real-time using vehicle onboard sensors. Due to the inherent limitations of onboard sensors, which include…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Wenjie Gao , Jiawei Fu , Yanqing Shen , Haodong Jing , Shitao Chen , Nanning Zheng

In order to maximize detection precision rate as well as the recall rate, this paper proposes an in-vehicle multi-source fusion scheme in Keyword Spotting (KWS) System for vehicle applications. Vehicle information, as a new source for the…

Machine Learning · Computer Science 2019-02-19 Yue Tan , Kan Zheng , Lei Lei

The field of autonomous driving has grown tremendously over the past few years, along with the rapid progress in sensor technology. One of the major purposes of using sensors is to provide environment perception for vehicle understanding,…

Robotics · Computer Science 2020-08-07 Zhi Yan , Li Sun , Tomas Krajnik , Yassine Ruichek

Multimodal sensor fusion is an essential capability for autonomous robots, enabling object detection and decision-making in the presence of failing or uncertain inputs. While recent fusion methods excel in normal environmental conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Edoardo Palladin , Roland Dietze , Praveen Narayanan , Mario Bijelic , Felix Heide

Robust environment perception for autonomous vehicles is a tremendous challenge, which makes a diverse sensor set with e.g. camera, lidar and radar crucial. In the process of understanding the recorded sensor data, 3D semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Hannah Schieber , Fabian Duerr , Torsten Schoen , Jürgen Beyerer

Success in racing requires a unique combination of vehicle setup, understanding of the racetrack, and human expertise. Since building and testing many different vehicle configurations in the real world is prohibitively expensive,…

Robotics · Computer Science 2024-12-06 John Subosits , Jenna Lee , Shawn Manuel , Paul Tylkin , Avinash Balachandran

Trajectory prediction is a fundamental problem and challenge for autonomous vehicles. Early works mainly focused on designing complicated architectures for deep-learning-based prediction models in normal-illumination environments, which…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Hailong Gong , Zirui Li , Chao Lu , Guodong Du , Jianwei Gong

Recent advances in combining deep learning and Reinforcement Learning have shown a promising path for designing new control agents that can learn optimal policies for challenging control tasks. These new methods address the main limitations…

Artificial Intelligence · Computer Science 2017-05-31 Hamid Mirzaei , Tony Givargis

In this paper we proposed an ultimate theory to solve the multi-target control problem through its introduction to the machine learning framework in automatic driving, which explored the implementation of excellent drivers' knowledge…

Artificial Intelligence · Computer Science 2018-12-10 Zecang Gu , Yin Liang , Zhaoxi Zhang

In the typical autonomous driving stack, planning and control systems represent two of the most crucial components in which data retrieved by sensors and processed by perception algorithms are used to implement a safe and comfortable…

Robotics · Computer Science 2022-07-06 Paolo Maramotti , Alessandro Paolo Capasso , Giulio Bacchiani , Alberto Broggi

In shared autonomy, user input is combined with semi-autonomous control to achieve a common goal. The goal is often unknown ex-ante, so prior work enables agents to infer the goal from user input and assist with the task. Such methods tend…

Machine Learning · Computer Science 2018-05-24 Siddharth Reddy , Anca D. Dragan , Sergey Levine

Autonomous driving system development is critically dependent on the ability to replay complex and diverse traffic scenarios in simulation. In such scenarios, the ability to accurately simulate the vehicle sensors such as cameras, lidar or…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Zhenpei Yang , Yuning Chai , Dragomir Anguelov , Yin Zhou , Pei Sun , Dumitru Erhan , Sean Rafferty , Henrik Kretzschmar

Accurate and robust navigation in unstructured environments requires fusing data from multiple sensors. Such fusion ensures that the robot is better aware of its surroundings, including areas of the environment that are not immediately…

Robotics · Computer Science 2024-03-12 Mateus Valverde Gasparino , Arun Narenthiran Sivakumar , Girish Chowdhary

Current state of the art solutions in the control of an autonomous vehicle mainly use supervised end-to-end learning, or decoupled perception, planning and action pipelines. Another possible solution is deep reinforcement learning, but such…

Robotics · Computer Science 2019-01-17 Bogdan Trasnea , Andrei Vasilcoi , Claudiu Pozna , Sorin Grigorescu

As semi-automated vehicles (SAVs) become more common, ensuring effective human-vehicle interaction during control handovers remains a critical safety challenge. Existing studies often rely on single-session simulator experiments or…

Human-Computer Interaction · Computer Science 2026-04-02 Yasaman Hakiminejad , Shiva Azimi , Luis Gomero , Elizabeth Pantesco , Irene P. Kan , Meltem Izzetoglu , Arash Tavakoli

Recent years have seen a growing research interest in applications of Deep Neural Networks (DNN) on autonomous vehicle technology. The trend started with perception and prediction a few years ago and it is gradually being applied to motion…

Robotics · Computer Science 2024-05-07 Hang Zhou , Haichao Liu , Hongliang Lu , Dan Xu , Jun Ma , Yiding Ji

Navigation in varied and dynamic indoor environments remains a complex task for autonomous mobile platforms. Especially when conditions worsen, typical sensor modalities may fail to operate optimally and subsequently provide inapt input for…

Robotics · Computer Science 2022-08-24 Wouter Jansen , Dennis Laurijssen , Jan Steckel