English
Related papers

Related papers: End-to-end Multi-Modal Multi-Task Vehicle Control …

200 papers

End-to-end autonomous driving is a fully differentiable machine learning system that takes raw sensor input data and other metadata as prior information and directly outputs the ego vehicle's control signals or planned trajectories. This…

Robotics · Computer Science 2023-12-01 Apoorv Singh

Latency-accuracy tradeoffs are fundamental in real-time applications of deep neural networks (DNNs) for cyber-physical systems. In autonomous driving, in particular, safety depends on both prediction quality and the end-to-end delay from…

Robotics · Computer Science 2026-05-29 Qitao Weng , Heechul Yun

To plan a safe and efficient route, an autonomous vehicle should anticipate future motions of other agents around it. Motion prediction is an extremely challenging task that recently gained significant attention within the research…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Stepan Konev , Kirill Brodt , Artsiom Sanakoyeu

Connected autonomous vehicles (CAVs) must simultaneously perform multiple tasks, such as object detection, semantic segmentation, depth estimation, trajectory prediction, motion prediction, and behaviour prediction, to ensure safe and…

Robotics · Computer Science 2025-08-07 Jiayuan Wang , Farhad Pourpanah , Q. M. Jonathan Wu , Ning Zhang

Autonomous car racing is a challenging task, as it requires precise applications of control while the vehicle is operating at cornering speeds. Traditional autonomous pipelines require accurate pre-mapping, localization, and planning which…

Robotics · Computer Science 2023-03-07 Dvij Kalaria , Qin Lin , John M. Dolan

This paper aims to investigate direct imitation learning from human drivers for the task of lane keeping assistance in highway and country roads using grayscale images from a single front view camera. The employed method utilizes…

Machine Learning · Computer Science 2017-09-13 Christopher Innocenti , Henrik Lindén , Ghazaleh Panahandeh , Lennart Svensson , Nasser Mohammadiha

We propose a novel traffic sign detection system that simultaneously estimates the location and precise boundary of traffic signs using convolutional neural network (CNN). Estimating the precise boundary of traffic signs is important in…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Hee Seok Lee , Kang Kim

Traditional methods for autonomous driving are implemented with many building blocks from perception, planning and control, making them difficult to generalize to varied scenarios due to complex assumptions and interdependencies. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Peide Cai , Yuxiang Sun , Hengli Wang , Ming Liu

Autonomous Vehicle (AV) perception systems have advanced rapidly in recent years, providing vehicles with the ability to accurately interpret their environment. Perception systems remain susceptible to errors caused by overly-confident…

Imitation learning for end-to-end autonomous driving has drawn attention from academic communities. Current methods either only use images as the input which is ambiguous when a car approaches an intersection, or use additional command…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Qing Wang , Long Chen , Wei Tian

Safety and decline of road traffic accidents remain important issues of autonomous driving. Statistics show that unintended lane departure is a leading cause of worldwide motor vehicle collisions, making lane detection the most promising…

Computer Vision and Pattern Recognition · Computer Science 2018-12-17 Wenhui Zhang , Tejas Mahale

Human intention prediction provides an augmented solution for the design of assistants and collaboration between the human driver and intelligent vehicles. In this study, a multi-task sequential learning framework is developed to predict…

Human-Computer Interaction · Computer Science 2022-07-04 Yang Xing , Wenbo Li , Xiaoyu Mo , Chen Lv

Deep Convolutional Neural Networks (DCNN) have been proven to be effective for various computer vision problems. In this work, we demonstrate its effectiveness on a continuous object orientation estimation task, which requires prediction of…

Computer Vision and Pattern Recognition · Computer Science 2017-02-07 Kota Hara , Raviteja Vemulapalli , Rama Chellappa

A rise in popularity of Deep Neural Networks (DNNs), attributed to more powerful GPUs and widely available datasets, has seen them being increasingly used within safety-critical domains. One such domain, self-driving, has benefited from…

Machine Learning · Computer Science 2018-11-19 Rhiannon Michelmore , Marta Kwiatkowska , Yarin Gal

Trajectory sampling in the Frenet(road-aligned) frame, is one of the most popular methods for motion planning of autonomous vehicles. It operates by sampling a set of behavioural inputs, such as lane offset and forward speed, before solving…

Robotics · Computer Science 2023-10-24 Jatan Shrestha , Simon Idoko , Basant Sharma , Arun Kumar Singh

This letter proposes a convolutional neural network (CNN)-based adaptive controller wtih three notable features: 1) it determines control input directly from historical sensor data (in an end-to-end process); 2) it learns the desired…

Systems and Control · Electrical Eng. & Systems 2024-03-07 Myeongseok Ryu , Kyunghwan Choi

Autonomous driving involves complex tasks such as data fusion, object and lane detection, behavior prediction, and path planning. As opposed to the modular approach which dedicates individual subsystems to tackle each of those tasks, the…

Artificial Intelligence · Computer Science 2024-11-26 Mahmoud M. Kishky , Hesham M. Eraqi , Khaled F. Elsayed

Speed-control forecasting, a challenging problem in driver behavior analysis, aims to predict the future actions of a driver in controlling vehicle speed such as braking or acceleration. In this paper, we try to address this challenge…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Yichen Ding , Ziming Zhang , Yanhua Li , Xun Zhou

Recent research on automotive driving developed an efficient end-to-end learning mode that directly maps visual input to control commands. However, it models distinct driving variations in a single network, which increases learning…

Robotics · Computer Science 2019-12-02 Huifang Ma , Yue Wang , Rong Xiong , Sarath Kodagoda , Li Tang

In this paper we show an effective means of integrating data driven frameworks to sampling based optimal control to vastly reduce the compute time for easy adoption and adaptation to real time applications such as on-road autonomous driving…

Robotics · Computer Science 2023-10-23 Kaustab Pal , Aditya Sharma , Mohd Omama , Parth N. Shah , K. Madhava Krishna