English
Related papers

Related papers: Rethinking Self-driving: Multi-task Knowledge for …

200 papers

Environment perception is the task for intelligent vehicles on which all subsequent steps rely. A key part of perception is to safely detect other road users such as vehicles, pedestrians, and cyclists. With modern deep learning techniques…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Florian Kraus , Klaus Dietmayer

Perception is essential for autonomous driving system. Recent approaches based on Bird's-eye-view (BEV) and deep learning have made significant progress. However, there exists challenging issues including lengthy development cycles, poor…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yuqi Dai , Jian Sun , Shengbo Eben Li , Qing Xu , Jianqiang Wang , Lei He , Keqiang Li

Current autonomous driving vehicles rely mainly on their individual sensors to understand surrounding scenes and plan for future trajectories, which can be unreliable when the sensors are malfunctioning or occluded. To address this problem,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Hsu-kuang Chiu , Ryo Hachiuma , Chien-Yi Wang , Stephen F. Smith , Yu-Chiang Frank Wang , Min-Hung Chen

Autonomous driving technology can improve traffic safety and reduce traffic accidents. In addition, it improves traffic flow, reduces congestion, saves energy and increases travel efficiency. In the relatively mature automatic driving…

Robotics · Computer Science 2024-03-13 Wenjian Sun , Linying Pan , Jingyu Xu , Weixiang Wan , Yong Wang

Today, there are two major paradigms for vision-based autonomous driving systems: mediated perception approaches that parse an entire scene to make a driving decision, and behavior reflex approaches that directly map an input image to a…

Computer Vision and Pattern Recognition · Computer Science 2015-09-29 Chenyi Chen , Ari Seff , Alain Kornhauser , Jianxiong Xiao

Off-road autonomous unmanned ground vehicles (UGVs) are being developed for military and commercial use to deliver crucial supplies in remote locations, help with mapping and surveillance, and to assist war-fighters in contested…

Collaborative perception plays a crucial role in enhancing environmental understanding by expanding the perceptual range and improving robustness against sensor failures, which primarily involves collaborative 3D detection and tracking…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Xunjie He , Christina Dao Wen Lee , Meiling Wang , Chengran Yuan , Zefan Huang , Yufeng Yue , Marcelo H. Ang

Vision-Language Models(VLMs) have demonstrated significant potential for end-to-end autonomous driving, yet a substantial gap remains between their current capabilities and the reliability necessary for real-world deployment. A critical…

Extensive evaluation of perception systems is crucial for ensuring the safety of intelligent vehicles in complex driving scenarios. Conventional performance metrics such as precision, recall and the F1-score assess the overall detection…

Robotics · Computer Science 2025-12-18 Jörg Gamerdinger , Sven Teufel , Stephan Amann , Lukas Marc Listl , Oliver Bringmann

Autonomous driving technology is poised to transform transportation systems. However, achieving safe and accurate multi-task decision-making in complex scenarios, such as unsignalized intersections, remains a challenge for autonomous…

Robotics · Computer Science 2023-08-01 Jiaqi Liu , Peng Hang , Xiao qi , Jianqiang Wang , Jian Sun

Affective states have a critical role in driving performance and safety. They can degrade driver situation awareness and negatively impact cognitive processes, severely diminishing road safety. Therefore, detecting and assessing drivers'…

Machine Learning · Computer Science 2019-07-24 Daniel Lopez-Martinez , Neska El-Haouij , Rosalind Picard

One of the well-known challenges in computer vision tasks is the visual diversity of images, which could result in an agreement or disagreement between the learned knowledge and the visual content exhibited by the current observation. In…

Machine Learning · Computer Science 2020-01-03 Yan Luo , Yongkang Wong , Mohan S. Kankanhalli , Qi Zhao

Modern computer vision applications rely on learning-based perception modules parameterized with neural networks for tasks like object detection. These modules frequently have low expected error overall but high error on atypical groups of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Cinjon Resnick , Or Litany , Amlan Kar , Karsten Kreis , James Lucas , Kyunghyun Cho , Sanja Fidler

Vision-based urban driving is hard. The autonomous system needs to learn to perceive the world and act in it. We show that this challenging learning problem can be simplified by decomposing it into two stages. We first train an agent that…

Robotics · Computer Science 2019-12-30 Dian Chen , Brady Zhou , Vladlen Koltun , Philipp Krähenbühl

Multi-task learning (MTL) is to learn one single model that performs multiple tasks for achieving good performance on all tasks and lower cost on computation. Learning such a model requires to jointly optimize losses of a set of tasks with…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Wei-Hong Li , Hakan Bilen

Previous works on object detection have achieved high accuracy in closed-set scenarios, but their performance in open-world scenarios is not satisfactory. One of the challenging open-world problems is corner case detection in autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Lixing Xiao , Ruixiao Shi , Xiaoyang Tang , Yi Zhou

Low-latency intelligent systems are required for autonomous driving on non-uniform terrain in open-pit mines and developing countries. This work proposes a perception system for autonomous vehicles on unpaved roads and off-road…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Nelson Alves Ferreira Neto

In autonomous driving scenarios, current object detection models show strong performance when tested in clear weather. However, their performance deteriorates significantly when tested in degrading weather conditions. In addition, even when…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Stefan Leitner , M. Jehanzeb Mirza , Wei Lin , Jakub Micorek , Marc Masana , Mateusz Kozinski , Horst Possegger , Horst Bischof

The emergence of general human knowledge and impressive logical reasoning capacity in rapidly progressed vision-language models (VLMs) have driven increasing interest in applying VLMs to high-level autonomous driving tasks, such as scene…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Songyan Zhang , Wenhui Huang , Zihui Gao , Hao Chen , Chen Lv

Existing vehicle trajectory prediction models struggle with generalizability, prediction uncertainties, and handling complex interactions. It is often due to limitations like complex architectures customized for a specific dataset and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Kaouther Messaoud , Matthieu Cord , Alexandre Alahi