English
Related papers

Related papers: Learning On-Road Visual Control for Self-Driving V…

200 papers

End-to-end autonomous driving is a fully differentiable machine learning system that takes raw sensor input data and other metadata as prior information and directly outputs the ego vehicle's control signals or planned trajectories. This…

Robotics · Computer Science 2023-12-01 Apoorv Singh

A fundamental challenge in autonomous vehicles is adjusting the steering angle at different road conditions. Recent state-of-the-art solutions addressing this challenge include deep learning techniques as they provide end-to-end solution to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Rodolfo Valiente , Mahdi Zaman , Sedat Ozer , Yaser P. Fallah

ObjectGoal Navigation (ObjectNav) is an embodied task wherein agents are to navigate to an object instance in an unseen environment. Prior works have shown that end-to-end ObjectNav agents that use vanilla visual and recurrent modules, e.g.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Joel Ye , Dhruv Batra , Abhishek Das , Erik Wijmans

Deep learning has been used to demonstrate end-to-end neural network learning for autonomous vehicle control from raw sensory input. While LiDAR sensors provide reliably accurate information, existing end-to-end driving solutions are mainly…

Robotics · Computer Science 2021-05-21 Zhijian Liu , Alexander Amini , Sibo Zhu , Sertac Karaman , Song Han , Daniela Rus

Imitation learning is a promising approach for training autonomous vehicles (AV) to navigate complex traffic environments by mimicking expert driver behaviors. While existing imitation learning frameworks focus on leveraging expert…

Robotics · Computer Science 2025-09-25 Yasin Sonmez , Hanna Krasowski , Murat Arcak

Efficient reasoning about the semantic, spatial, and temporal structure of a scene is a crucial prerequisite for autonomous driving. We present NEural ATtention fields (NEAT), a novel representation that enables such reasoning for…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Kashyap Chitta , Aditya Prakash , Andreas Geiger

Autonomous UAV racing has recently emerged as an interesting research problem. The dream is to beat humans in this new fast-paced sport. A common approach is to learn an end-to-end policy that directly predicts controls from raw images by…

Robotics · Computer Science 2019-04-19 Matthias Müller , Guohao Li , Vincent Casser , Neil Smith , Dominik L. Michels , Bernard Ghanem

This work proposes a new self-driving framework that uses a human driver control model, whose feature-input values are extracted from images using deep convolutional neural networks (CNNs). The development of image processing techniques…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Justin Zheng , Kazuhide Okamoto , Panagiotis Tsiotras

The recent surge in interest in autonomous driving stems from its rapidly developing capacity to enhance safety, efficiency, and convenience. A pivotal aspect of autonomous driving technology is its perceptual systems, where core algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Qi Zhang , Siyuan Gou , Wenbin Li

Learning to drive faithfully in highly stochastic urban settings remains an open problem. To that end, we propose a Multi-task Learning from Demonstration (MT-LfD) framework which uses supervised auxiliary task prediction to guide the main…

Machine Learning · Computer Science 2018-08-31 Ashish Mehta , Adithya Subramanian , Anbumani Subramanian

A key component in autonomous driving is the ability of the self-driving car to understand, track and predict the dynamics of the surrounding environment. Although there is significant work in the area of object detection, tracking and…

Robotics · Computer Science 2021-07-20 Cosmin Ginerica , Mihai Zaha , Florin Gogianu , Lucian Busoniu , Bogdan Trasnea , Sorin Grigorescu

Performing multiple heterogeneous visual tasks in dynamic scenes is a hallmark of human perception capability. Despite remarkable progress in image and video recognition via representation learning, current research still focuses on…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Thomas E. Huang , Yifan Liu , Luc Van Gool , Fisher Yu

Autonomous driving (AD) technology, leveraging artificial intelligence, strives for vehicle automation. End-toend strategies, emerging to simplify traditional driving systems by integrating perception, decision-making, and control, offer…

Robotics · Computer Science 2024-03-19 Dong Hu , Chao Huang , Jingda Wu , Hongbo Gao

This paper investigates the use of artificial neural networks (ANNs) to replace traditional algorithms and manual review for identifying anomalies in vehicle run data. The specific data used for this study is from undersea vehicle…

Neural and Evolutionary Computing · Computer Science 2016-03-17 Adam J. Last

In the context of autonomous navigation, effectively conveying abstract navigational cues to agents in dynamic environments presents significant challenges, particularly when navigation information is derived from diverse modalities such as…

Machine Learning · Computer Science 2025-03-17 Hsuan-Kung Yang , Tsung-Chih Chiang , Jou-Min Liu , Ting-Ru Liu , Chun-Wei Huang , Tsu-Ching Hsiao , Chun-Yi Lee

Recent applications of deep learning to navigation have generated end-to-end navigation solutions whereby visual sensor input is mapped to control signals or to motion primitives. The resulting visual navigation strategies work very well at…

Robotics · Computer Science 2018-01-17 Justin S. Smith , Jin-Ha Hwang , Fu-Jen Chu , Patricio A. Vela

For safety of autonomous driving, vehicles need to be able to drive under various lighting, weather, and visibility conditions in different environments. These external and environmental factors, along with internal factors associated with…

Computer Vision and Pattern Recognition · Computer Science 2021-03-01 Yu Shen , Laura Zheng , Manli Shu , Weizi Li , Tom Goldstein , Ming C. Lin

We present a target-driven navigation system to improve mapless visual navigation in indoor scenes. Our method takes a multi-view observation of a robot and a target as inputs at each time step to provide a sequence of actions that move the…

Robotics · Computer Science 2022-05-10 Qiaoyun Wu , Xiaoxi Gong , Kai Xu , Dinesh Manocha , Jingxuan Dong , Jun Wang

We present a novel approach to modern car control utilizing a combination of Deep Convolutional Neural Networks and Long Short-Term Memory Systems: Both of which are a subsection of Hierarchical Representations Learning, more commonly known…

Robotics · Computer Science 2018-07-24 Surya Dantuluri

In the area of autonomous driving, navigating off-road terrains presents a unique set of challenges, from unpredictable surfaces like grass and dirt to unexpected obstacles such as bushes and puddles. In this work, we present a novel…

Robotics · Computer Science 2025-05-15 Akhil Nagariya , Dimitar Filev , Srikanth Saripalli , Gaurav Pandey