English
Related papers

Related papers: End-to-end Multi-Modal Multi-Task Vehicle Control …

200 papers

The training of many existing end-to-end steering angle prediction models heavily relies on steering angles as the supervisory signal. Without learning from much richer contexts, these methods are susceptible to the presence of sharp road…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Yuenan Hou , Zheng Ma , Chunxiao Liu , Chen Change Loy

This paper presents a vision-based modularized drone racing navigation system that uses a customized convolutional neural network (CNN) for the perception module to produce high-level navigation commands and then leverages a…

Robotics · Computer Science 2021-05-28 Tianqi Wang , Dong Eui Chang

Multi-task convolutional neural networks (CNNs) have shown impressive results for certain combinations of tasks, such as single-image depth estimation (SIDE) and semantic segmentation. This is achieved by pushing the network towards…

Computer Vision and Pattern Recognition · Computer Science 2018-11-05 Lukas Liebel , Marco Körner

Multi-task learning (MTL) jointly learns a set of tasks by sharing parameters among tasks. It is a promising approach for reducing storage costs while improving task accuracy for many computer vision tasks. The effective adoption of MTL…

Machine Learning · Computer Science 2022-10-03 Lijun Zhang , Xiao Liu , Hui Guan

Automatic segmentation of medical images is an important task for many clinical applications. In practice, a wide range of anatomical structures are visualised using different imaging modalities. In this paper, we investigate whether a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Pim Moeskops , Jelmer M. Wolterink , Bas H. M. van der Velden , Kenneth G. A. Gilhuijs , Tim Leiner , Max A. Viergever , Ivana Išgum

The perception system for autonomous driving generally requires to handle multiple diverse sub-tasks. However, current algorithms typically tackle individual sub-tasks separately, which leads to low efficiency when aiming at obtaining…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xuesong Chen , Shaoshuai Shi , Tao Ma , Jingqiu Zhou , Simon See , Ka Chun Cheung , Hongsheng Li

Modern vehicles communicate data to and from sensors, actuators, and electronic control units (ECUs) using Controller Area Network (CAN) bus, which operates on differential signaling. An autonomous ECU responsible for the execution of…

Signal Processing · Electrical Eng. & Systems 2021-12-01 Shoaib Azam , Farzeen Munir , Muhammad Aasim Rafique , Ahmad Muqeem Sheri , Muhammad Ishfaq Hussain , Moongu Jeon

Accurately detecting and predicting lane change (LC)processes of human-driven vehicles can help autonomous vehicles better understand their surrounding environment, recognize potential safety hazards, and improve traffic safety. This paper…

Machine Learning · Computer Science 2023-07-21 Renteng Yuan , Mohamed Abdel-Aty , Xin Gu , Ou Zheng , Qiaojun Xiang

Convolutional Neural Networks (CNNs) were recently shown to provide state-of-the-art results for object category viewpoint estimation. However different ways of formulating this problem have been proposed and the competing approaches have…

Computer Vision and Pattern Recognition · Computer Science 2016-09-14 Francisco Massa , Renaud Marlet , Mathieu Aubry

Deep learning has revolutionized the ability to learn "end-to-end" autonomous vehicle control directly from raw sensory data. While there have been recent extensions to handle forms of navigation instruction, these works are unable to…

Machine Learning · Computer Science 2021-11-24 Alexander Amini , Guy Rosman , Sertac Karaman , Daniela Rus

Autonomous driving demands an integrated approach that encompasses perception, prediction, and planning, all while operating under strict energy constraints to enhance scalability and environmental sustainability. We present Spiking…

Neural and Evolutionary Computing · Computer Science 2024-06-03 Rui-Jie Zhu , Ziqing Wang , Leilani Gilpin , Jason K. Eshraghian

An active area of research is to increase the safety of self-driving vehicles. Although safety cannot be guarenteed completely, the capability of a vehicle to predict the future trajectories of its surrounding vehicles could help ensure…

Computer Vision and Pattern Recognition · Computer Science 2019-02-15 Shayan Jawed , Eya Boumaiza , Josif Grabocka , Lars Schmidt-Thieme

Convolutional neural networks are commonly used to control the steering angle for autonomous cars. Most of the time, multiple long range cameras are used to generate lateral failure cases. In this paper we present a novel model to generate…

We propose Trusted Neural Network (TNN) models, which are deep neural network models that satisfy safety constraints critical to the application domain. We investigate different mechanisms for incorporating rule-based knowledge in the form…

Machine Learning · Computer Science 2018-05-21 Shalini Ghosh , Amaury Mercier , Dheeraj Pichapati , Susmit Jha , Vinod Yegneswaran , Patrick Lincoln

We propose the use of Bayesian networks, which provide both a mean value and an uncertainty estimate as output, to enhance the safety of learned control policies under circumstances in which a test-time input differs significantly from the…

Machine Learning · Computer Science 2019-02-18 Keuntaek Lee , Kamil Saigol , Evangelos A. Theodorou

This paper presents an end-to-end approach for tracking static and dynamic objects for an autonomous vehicle driving through crowded urban environments. Unlike traditional approaches to tracking, this method is learned end-to-end, and is…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 Julie Dequaire , Dushyant Rao , Peter Ondruska , Dominic Wang , Ingmar Posner

One of the challenges of full autonomy is to have a robot capable of manipulating its current environment to achieve another environment configuration. This paper is a step towards this challenge, focusing on the visual understanding of the…

Robotics · Computer Science 2020-11-24 Guilherme Maeda , Joni Väätäinen , Hironori Yoshida

End-to-end autonomous driving methods aim to directly map raw sensor inputs to future driving actions such as planned trajectories, bypassing traditional modular pipelines. While these approaches have shown promise, they often operate under…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Bozhou Zhang , Nan Song , Jingyu Li , Xiatian Zhu , Jiankang Deng , Li Zhang

Current autonomous driving systems are composed of a perception system and a decision system. Both of them are divided into multiple subsystems built up with lots of human heuristics. An end-to-end approach might clean up the system and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Jianyu Chen , Zhuo Xu , Masayoshi Tomizuka

Autonomous vehicles have limited computational resources and thus require efficient control systems. The cost and size of sensors have limited the development of self-driving cars. To overcome these restrictions, this study proposes an…

Robotics · Computer Science 2024-06-26 Der-Hau Lee