English
Related papers

Related papers: Interpretable Learning for Self-Driving Cars by Vi…

200 papers

Steering a car through traffic is a complex task that is difficult to cast into algorithms. Therefore, researchers turn to training artificial neural networks from front-facing camera data stream along with the associated steering angles.…

Machine Learning · Computer Science 2017-11-23 Hesham M. Eraqi , Mohamed N. Moustafa , Jens Honer

Convolutional neural networks have enabled major progresses in addressing pixel-level prediction tasks such as semantic segmentation, depth estimation, surface normal prediction and so on, benefiting from their powerful capabilities in…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Guanglei Yang , Paolo Rota , Xavier Alameda-Pineda , Dan Xu , Mingli Ding , Elisa Ricci

Visual understanding requires comprehending complex visual relations between objects within a scene. Here, we seek to characterize the computational demands for abstract visual reasoning. We do this by systematically assessing the ability…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Mohit Vaishnav , Remi Cadene , Andrea Alamia , Drew Linsley , Rufin VanRullen , Thomas Serre

We present a control approach for autonomous vehicles based on deep reinforcement learning. A neural network agent is trained to map its estimated state to acceleration and steering commands given the objective of reaching a specific target…

Robotics · Computer Science 2020-03-16 Andreas Folkers , Matthias Rick , Christof Büskens

Causal thinking enables humans to understand not just what is seen, but why it happens. To replicate this capability in modern AI systems, we introduce the task of visual causal discovery. It requires models to infer cause-and-effect…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yize Zhang , Meiqi Chen , Sirui Chen , Bo Peng , Yanxi Zhang , Tianyu Li , Chaochao Lu

Modern computer vision applications rely on learning-based perception modules parameterized with neural networks for tasks like object detection. These modules frequently have low expected error overall but high error on atypical groups of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Cinjon Resnick , Or Litany , Amlan Kar , Karsten Kreis , James Lucas , Kyunghyun Cho , Sanja Fidler

This paper aims to investigate direct imitation learning from human drivers for the task of lane keeping assistance in highway and country roads using grayscale images from a single front view camera. The employed method utilizes…

Machine Learning · Computer Science 2017-09-13 Christopher Innocenti , Henrik Lindén , Ghazaleh Panahandeh , Lennart Svensson , Nasser Mohammadiha

Visual explanation enables human to understand the decision making of Deep Convolutional Neural Network (CNN), but it is insufficient to contribute the performance improvement. In this paper, we focus on the attention map for visual…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Hiroshi Fukui , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi

Vision Transformer(ViT) is one of the most widely used models in the computer vision field with its great performance on various tasks. In order to fully utilize the ViT-based architecture in various applications, proper visualization…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Saebom Leem , Hyunseok Seo

Driver gaze has been shown to be an excellent surrogate for driver attention in intelligent vehicles. With the recent surge of highly autonomous vehicles, driver gaze can be useful for determining the handoff time to a human driver. While…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Sourabh Vora , Akshay Rangesh , Mohan M. Trivedi

We propose a causal interpretation of self-attention in the Transformer neural network architecture. We interpret self-attention as a mechanism that estimates a structural equation model for a given input sequence of symbols (tokens). The…

Artificial Intelligence · Computer Science 2023-11-01 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov

Deep Convolutional Neural Networks (DCNNs) were originally inspired by principles of biological vision, have evolved into best current computational models of object recognition, and consequently indicate strong architectural and functional…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Leonard E. van Dyck , Sebastian J. Denzler , Walter R. Gruber

Attention mechanisms form a core component of several successful deep learning architectures, and are based on one key idea: ''The output depends only on a small (but unknown) segment of the input.'' In several practical applications like…

Machine Learning · Computer Science 2023-05-16 Lakshmi Narayan Pandey , Rahul Vashisht , Harish G. Ramaswamy

As we navigate our daily commutes, the threat posed by a distracted driver is at a large, resulting in a troubling rise in traffic accidents. Addressing this safety concern, our project harnesses the analytical power of Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Amaan Aijaz Sheikh , Imaad Zaffar Khan

Deep learning and computer vision techniques have become increasingly important in the development of self-driving cars. These techniques play a crucial role in enabling self-driving cars to perceive and understand their surroundings,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Kanishkha Jaisankar , Pranav M. Pawar , Diana Susane Joseph , Raja Muthalagu , Mithun Mukherjee

A convolutional neural network (CNN) approach is used to implement a level 2 autonomous vehicle by mapping pixels from the camera input to the steering commands. The network automatically learns the maximum variable features from the camera…

Robotics · Computer Science 2019-09-10 Akhil Agnihotri , Prathamesh Saraf , Kriti Rajesh Bapnad

Vehicle tracking task plays an important role on the internet of vehicles and intelligent transportation system. Beyond the traditional GPS sensor, the image sensor can capture different kinds of vehicles, analyze their driving situation…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Xu Kang , Bin Song , Jie Guo , Xiaojiang Du , Mohsen Guizani

Imitation learning, which learns agent policy by mimicking expert demonstration, has shown promising results in many applications such as medical treatment regimes and self-driving vehicles. However, it remains a difficult task to interpret…

Machine Learning · Computer Science 2024-01-31 Tianxiang Zhao , Wenchao Yu , Suhang Wang , Lu Wang , Xiang Zhang , Yuncong Chen , Yanchi Liu , Wei Cheng , Haifeng Chen

In the field of conditional autonomous driving technology, driver perceived risk prediction plays a crucial role in reducing traffic risks and ensuring passenger safety. This study introduces an innovative perceived risk prediction model…

Human-Computer Interaction · Computer Science 2025-03-07 Chenhao Yang , Siwei Huang , Chuan Hu

Imitation learning is a powerful approach for learning autonomous driving policy by leveraging data from expert driver demonstrations. However, driving policies trained via imitation learning that neglect the causal structure of expert…