English
Related papers

Related papers: Memory based neural networks for end-to-end autono…

200 papers

We trained a convolutional neural network (CNN) to map raw pixels from a single front-facing camera directly to steering commands. This end-to-end approach proved surprisingly powerful. With minimum training data from humans the system…

In recent years, vision-based end-to-end autonomous driving has emerged as a new paradigm. However, popular end-to-end approaches typically rely on visual feature extraction networks trained under label supervision. This limited supervision…

Robotics · Computer Science 2025-11-04 Ling Niu , Xiaoji Zheng , Han Wang , Chen Zheng , Ziyuan Yang , Bokui Chen , Jiangtao Gong

Effective modeling of human interactions is of utmost importance when forecasting behaviors such as future trajectories. Each individual, with its motion, influences surrounding agents since everyone obeys to social non-written rules such…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Francesco Marchetti , Federico Becattini , Lorenzo Seidenari , Alberto Del Bimbo

We present a novel approach to modern car control utilizing a combination of Deep Convolutional Neural Networks and Long Short-Term Memory Systems: Both of which are a subsection of Hierarchical Representations Learning, more commonly known…

Robotics · Computer Science 2018-07-24 Surya Dantuluri

End-to-end learning has become a widely applicable and studied problem in training predictive ML models to be aware of their impact on downstream decision-making tasks. These end-to-end models often outperform traditional methods that…

Machine Learning · Computer Science 2025-05-19 Rares Cristian , Pavithra Harsha , Georgia Perakis , Brian Quanz

We propose the use of Bayesian networks, which provide both a mean value and an uncertainty estimate as output, to enhance the safety of learned control policies under circumstances in which a test-time input differs significantly from the…

Machine Learning · Computer Science 2019-02-18 Keuntaek Lee , Kamil Saigol , Evangelos A. Theodorou

A common approach for modeling the environment of an autonomous vehicle are dynamic occupancy grid maps, in which the surrounding is divided into cells, each containing the occupancy and velocity state of its location. Despite the advantage…

Robotics · Computer Science 2022-05-06 Marcel Schreiber , Vasileios Belagiannis , Claudius Gläser , Klaus Dietmayer

Convolutional Neural Networks (CNN) have been successfully applied to autonomous driving tasks, many in an end-to-end manner. Previous end-to-end steering control methods take an image or an image sequence as the input and directly predict…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Zhengyuan Yang , Yixuan Zhang , Jerry Yu , Junjie Cai , Jiebo Luo

In this paper we propose a new methodology for decision-making under uncertainty using recent advancements in the areas of nonlinear stochastic optimal control theory, applied mathematics, and machine learning. Grounded on the fundamental…

Robotics · Computer Science 2021-07-12 Marcus Pereira , Ziyi Wang , Ioannis Exarchos , Evangelos A. Theodorou

In this work, we study vision-based end-to-end reinforcement learning on vehicle control problems, such as lane following and collision avoidance. Our controller policy is able to control a small-scale robot to follow the right-hand lane of…

Machine Learning · Computer Science 2020-12-15 András Kalapos , Csaba Gór , Róbert Moni , István Harmati

We present a target-driven navigation system to improve mapless visual navigation in indoor scenes. Our method takes a multi-view observation of a robot and a target as inputs at each time step to provide a sequence of actions that move the…

Robotics · Computer Science 2022-05-10 Qiaoyun Wu , Xiaoxi Gong , Kai Xu , Dinesh Manocha , Jingxuan Dong , Jun Wang

Deep Learning has been widely applied in the area of image processing and natural language processing. In this paper, we propose an end-to-end communication structure based on autoencoder where the transceiver can be optimized jointly. A…

Information Theory · Computer Science 2019-06-18 Tianjie Mu , Xiaohui Chen , Li Chen , Huarui Yin , Weidong Wang

End-to-end autonomous driving models increasingly benefit from large vision--language models for semantic understanding, yet ensuring safe and accurate operation under long-tail conditions remains challenging. These challenges are…

Robotics · Computer Science 2026-02-03 Weizhe Tang , Junwei You , Jiaxi Liu , Zhaoyi Wang , Rui Gan , Zilin Huang , Feng Wei , Bin Ran

In self driving car applications, there is a requirement to predict the location of the lane given an input RGB front facing image. In this paper, we propose an architecture that allows us to increase the speed and robustness of road…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Praveen Venkatesh , Rwik Rana , Varun Jain

We develop a principled approach to end-to-end learning in stochastic optimization. First, we show that the standard end-to-end learning algorithm admits a Bayesian interpretation and trains a posterior Bayes action map. Building on the…

Optimization and Control · Mathematics 2023-06-13 Yves Rychener , Daniel Kuhn , Tobias Sutter

Conventional power system reliability suffers from the long run time of Monte Carlo simulation and the dimension-curse of analytic enumeration methods. This paper proposes a preliminary investigation on end-to-end machine learning for…

Machine Learning · Computer Science 2022-05-31 Yongli Zhu , Chanan Singh

Nowadays, Neural Networks represent a major expectation for the realization of powerful Deep Learning algorithms, which can determine several physical systems' behaviors and operations. Computational resources required for model, training,…

Machine Learning · Computer Science 2021-03-02 Giulia Crocioni , Giambattista Gruosso , Danilo Pau , Davide Denaro , Luigi Zambrano , Giuseppe di Giore

In this paper, we investigate the problem of enabling a drone to fly through a tilted narrow gap, without a traditional planning and control pipeline. To this end, we propose an end-to-end policy network, which imitates from the traditional…

Robotics · Computer Science 2019-08-06 Jiarong Lin , Luqi Wang , Fei Gao , Shaojie Shen , Fu Zhang

End-to-end autonomous driving models are typically trained on multi-city datasets using supervised ImageNet-pretrained backbones, yet their ability to generalize to unseen cities remains largely unexamined. When training and evaluation data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Fatemeh Naeinian , Ali Hamza , Haoran Zhu , Anna Choromanska

Many existing autonomous driving paradigms involve a multi-stage discrete pipeline of tasks. To better predict the control signals and enhance user safety, an end-to-end approach that benefits from joint spatial-temporal feature learning is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Shengchao Hu , Li Chen , Penghao Wu , Hongyang Li , Junchi Yan , Dacheng Tao