English
Related papers

Related papers: Development and testing of an image transformer fo…

200 papers

While learning visuomotor skills in an end-to-end manner is appealing, deep neural networks are often uninterpretable and fail in surprising ways. For robotics tasks, such as autonomous driving, models that explicitly represent objects may…

Artificial Intelligence · Computer Science 2019-03-04 Dequan Wang , Coline Devin , Qi-Zhi Cai , Fisher Yu , Trevor Darrell

Trustworthy AI is mandatory for the broad deployment of autonomous vehicles. Although end-to-end approaches derive control commands directly from raw data, interpreting these decisions remains challenging, especially in complex urban…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Mona Mirzaie , Bodo Rosenhahn

To plan safe maneuvers and act with foresight, autonomous vehicles must be capable of accurately predicting the uncertain future. In the context of autonomous driving, deep neural networks have been successfully applied to learning…

Robotics · Computer Science 2022-08-02 Salar Arbabi , Davide Tavernini , Saber Fallah , Richard Bowden

End-to-end autonomous driving models based on Vision-Language-Action (VLA) architectures have shown promising results by learning driving policies through behavior cloning on expert demonstrations. However, imitation learning inherently…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Zihao Sheng , Xin Ye , Jingru Luo , Sikai Chen , Liu Ren

Computer vision applications in intelligent transportation systems (ITS) and autonomous driving (AD) have gravitated towards deep neural network architectures in recent years. While performance seems to be improving on benchmark datasets,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Talha Azfar , Jinlong Li , Hongkai Yu , Ruey Long Cheu , Yisheng Lv , Ruimin Ke

Conventional end-to-end (E2E) driving models are effective at generating physically plausible trajectories, but often fail to generalize to long-tail scenarios due to the lack of essential world knowledge to understand and reason about…

Robotics · Computer Science 2025-11-05 Yu Gao , Anqing Jiang , Yiru Wang , Wang Jijun , Hao Jiang , Zhigang Sun , Heng Yuwen , Wang Shuo , Hao Zhao , Sun Hao

In recent years, autonomous driving algorithms using low-cost vehicle-mounted cameras have attracted increasing endeavors from both academia and industry. There are multiple fronts to these endeavors, including object detection on roads,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Lu Chi , Yadong Mu

Self-driving vehicles (SDVs) hold great potential for improving traffic safety and are poised to positively affect the quality of life of millions of people. To unlock this potential one of the critical aspects of the autonomous technology…

The automotive industry has witnessed an increasing level of development in the past decades; from manufacturing manually operated vehicles to manufacturing vehicles with a high level of automation. With the recent developments in…

Human-Computer Interaction · Computer Science 2021-11-11 Daniel Omeiza , Helena Webb , Marina Jirotka , Lars Kunze

End-to-end vision-based autonomous driving has achieved impressive success, but safety remains a major concern. The safe control problem has been addressed in low-dimensional settings using safety filters, e.g., those based on control…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Yuxuan Yang , Hussein Sibai

The rapid evolution of machine learning (ML) has led to the widespread adoption of complex "black box" models, such as deep neural networks and ensemble methods. These models exhibit exceptional predictive performance, making them…

Machine Learning · Computer Science 2025-03-28 Moncef Garouani , Josiane Mothe , Ayah Barhrhouj , Julien Aligon

This survey explores the adaptation of visual transformer models in Autonomous Driving, a transition inspired by their success in Natural Language Processing. Surpassing traditional Recurrent Neural Networks in tasks like sequential image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Quoc-Vinh Lai-Dang

Recent advances in multimodal large language models (LLMs) have shown extreme effectiveness in visual question answering (VQA). However, the design nature of these end-to-end models prevents them from being interpretable to humans,…

Computation and Language · Computer Science 2024-04-16 Xingyu Fu , Ben Zhou , Sihao Chen , Mark Yatskar , Dan Roth

The development and adoption of Vision Transformers and other deep-learning architectures for image classification tasks has been rapid. However, the "black box" nature of neural networks is a barrier to adoption in applications where…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Mariano V. Ntrougkas , Nikolaos Gkalelis , Vasileios Mezaris

The driving environment perception has a vital role for autonomous driving and nowadays has been actively explored for its realization. The research community and relevant stakeholders necessitate the development of Deep Learning (DL)…

Artificial Intelligence · Computer Science 2025-10-16 Jalal Khan , Manzoor Khan , Sherzod Turaev , Sumbal Malik , Hesham El-Sayed , Farman Ullah

Concept bottleneck models have been successfully used for explainable machine learning by encoding information within the model with a set of human-defined concepts. In the context of human-assisted or autonomous driving, explainability…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jessica Echterhoff , An Yan , Kyungtae Han , Amr Abdelraouf , Rohit Gupta , Julian McAuley

Autonomous Vehicle (AV) systems have been developed with a strong reliance on machine learning techniques. While machine learning approaches, such as deep learning, are extremely effective at tasks that involve observation and…

Artificial Intelligence · Computer Science 2025-02-14 Keegan Kimbrell

End-to-end autonomous driving is a fully differentiable machine learning system that takes raw sensor input data and other metadata as prior information and directly outputs the ego vehicle's control signals or planned trajectories. This…

Robotics · Computer Science 2023-12-01 Apoorv Singh

The integration of Deep Learning (DL) in System Dynamics (SD) modeling for transportation logistics offers significant advantages in scalability and predictive accuracy. However, these gains are often offset by the loss of explainability…

Artificial Intelligence · Computer Science 2025-09-11 Riccardo D'Elia , Alberto Termine , Francesco Flammini

Vision-language models (VLMs) show promise for autonomous driving but often lack transparent reasoning capabilities that are critical for safety. We investigate whether explicitly modeling reasoning during fine-tuning enhances VLM…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Amirhosein Chahe , Lifeng Zhou