English
Related papers

Related papers: Learning Accurate and Human-Like Driving using Sem…

200 papers

General-purpose trajectory planning algorithms for automated driving utilize complex reward functions to perform a combined optimization of strategic, behavioral, and kinematic features. The specification and tuning of a single reward…

Robotics · Computer Science 2021-05-04 Sascha Rosbach , Xing Li , Simon Großjohann , Silviu Homoceanu , Stefan Roth

Categorizing driving scenes via visual perception is a key technology for safe driving and the downstream tasks of autonomous vehicles. Traditional methods infer scene category by detecting scene-related objects or using a classifier that…

Robotics · Computer Science 2021-03-11 Shaochi Hu , Hanwei Fan , Biao Gao , XijunZhao , Huijing Zhao

Autonomous driving relies on a huge volume of real-world data to be labeled to high precision. Alternative solutions seek to exploit driving simulators that can generate large amounts of labeled data with a plethora of content variations.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 David Acuna , Jonah Philion , Sanja Fidler

Understanding occupant-vehicle interactions by modeling control transitions is important to ensure safe approaches to passenger vehicle automation. Models which contain contextual, semantically meaningful representations of driver states…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Akshay Rangesh , Nachiket Deo , Ross Greer , Pujitha Gunaratne , Mohan M. Trivedi

Accurate driver attention prediction can serve as a critical reference for intelligent vehicles in understanding traffic scenes and making informed driving decisions. Though existing studies on driver attention prediction improved…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Dongyang Xu , Qingfan Wang , Ji Ma , Xiangyun Zeng , Lei Chen

People's goal-directed behaviors are influenced by their cognitive biases, and autonomous systems that interact with people should be aware of this. For example, people's attention to objects in their environment will be biased in a way…

Artificial Intelligence · Computer Science 2025-10-31 Sounak Banerjee , Daphne Cornelisse , Deepak Gopinath , Emily Sumner , Jonathan DeCastro , Guy Rosman , Eugene Vinitsky , Mark K. Ho

End-to-end paradigms have demonstrated great potential for autonomous driving. Additionally, most existing methods are built upon Transformer architectures. However, transformers incur a quadratic attention cost, limiting their ability to…

Artificial Intelligence · Computer Science 2025-12-19 Jihao Huang , Xi Xia , Zhiyuan Li , Tianle Liu , Jingke Wang , Junbo Chen , Tengju Ye

We discuss the process of building semantic maps, how to interactively label entities in them, and how to use them to enable context-aware navigation behaviors in human environments. We utilize planar surfaces, such as walls and tables, and…

Robotics · Computer Science 2018-08-15 Akansel Cosgun , Henrik Christensen

When faced with learning challenging new tasks, humans often follow sequences of steps that allow them to incrementally build up the necessary skills for performing these new tasks. However, in machine learning, models are most often…

Artificial Intelligence · Computer Science 2021-06-09 Otilia Stretcu , Emmanouil Antonios Platanios , Tom M. Mitchell , Barnabás Póczos

Humans are experts in making decisions for challenging driving tasks with uncertainties. Many efforts have been made to model the decision-making process of human drivers at the behavior level. However, limited studies explain how human…

Robotics · Computer Science 2022-10-18 Huanjie Wang , Haibin Liu , Wenshuo Wang , Lijun Sun

Artificial intelligence for autonomous driving must meet strict requirements on safety and robustness. We propose to validate machine learning models for self-driving vehicles not only with given ground truth labels, but also with…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Laura von Rueden , Tim Wirtz , Fabian Hueger , Jan David Schneider , Christian Bauckhage

Attention mechanisms have recently been introduced in deep learning for various tasks in natural language processing and computer vision. But despite their popularity, the "correctness" of the implicitly-learned attention maps has only been…

Computer Vision and Pattern Recognition · Computer Science 2016-11-24 Chenxi Liu , Junhua Mao , Fei Sha , Alan Yuille

As part of autonomous car driving systems, semantic segmentation is an essential component to obtain a full understanding of the car's environment. One difficulty, that occurs while training neural networks for this purpose, is class…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Robin Chan , Matthias Rottmann , Fabian Hüger , Peter Schlicht , Hanno Gottschalk

In this paper, we present a state-of-the-art reinforcement learning method for autonomous driving. Our approach employs temporal difference learning in a Bayesian framework to learn vehicle control signals from sensor data. The agent has…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Zahra Gharaee , Karl Holmquist , Linbo He , Michael Felsberg

The existence of real-world adversarial examples (commonly in the form of patches) poses a serious threat for the use of deep learning models in safety-critical computer vision tasks such as visual perception in autonomous driving. This…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Giulio Rossolini , Federico Nesti , Gianluca D'Amico , Saasha Nair , Alessandro Biondi , Giorgio Buttazzo

In this work we aim to predict the driver's focus of attention. The goal is to estimate what a person would pay attention to while driving, and which part of the scene around the vehicle is more critical for the task. To this end we propose…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Andrea Palazzi , Davide Abati , Simone Calderara , Francesco Solera , Rita Cucchiara

Human visual system can selectively attend to parts of a scene for quick perception, a biological mechanism known as Human attention. Inspired by this, recent deep learning models encode attention mechanisms to focus on the most…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Qiuxia Lai , Salman Khan , Yongwei Nie , Jianbing Shen , Hanqiu Sun , Ling Shao

Autonomous parking is a crucial task in the intelligent driving field. Traditional parking algorithms are usually implemented using rule-based schemes. However, these methods are less effective in complex parking scenarios due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Changze Li , Ziheng Ji , Zhe Chen , Tong Qin , Ming Yang

Imitation learning for end-to-end autonomous driving has drawn attention from academic communities. Current methods either only use images as the input which is ambiguous when a car approaches an intersection, or use additional command…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Qing Wang , Long Chen , Wei Tian

Learning visual representations from observing actions to benefit robot visuo-motor policy generation is a promising direction that closely resembles human cognitive function and perception. Motivated by this, and further inspired by…