English
Related papers

Related papers: ObserveNet Control: A Vision-Dynamics Learning App…

200 papers

With the development of state-of-art deep reinforcement learning, we can efficiently tackle continuous control problems. But the deep reinforcement learning method for continuous control is based on historical data, which would make…

Robotics · Computer Science 2016-12-02 Xi Xiong , Jianqiang Wang , Fang Zhang , Keqiang Li

Driverless vehicles are complex systems operating in constantly changing environments. Automated driving is achieved by controlling the coupled longitudinal and lateral vehicle dynamics. Model predictive control is one of the most promising…

Optimization and Control · Mathematics 2025-09-25 Yassine Kebbati , Naima Ait-Oufroukh , Vicenç Puig , Vincent Vigneron , Dalil Ichalal

In this paper, we present a state-of-the-art reinforcement learning method for autonomous driving. Our approach employs temporal difference learning in a Bayesian framework to learn vehicle control signals from sensor data. The agent has…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Zahra Gharaee , Karl Holmquist , Linbo He , Michael Felsberg

Uncertainty plays a key role in future prediction. The future is uncertain. That means there might be many possible futures. A future prediction method should cover the whole possibilities to be robust. In autonomous driving, covering…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Adil Kaan Akan

Long-term situation prediction plays a crucial role in the development of intelligent vehicles. A major challenge still to overcome is the prediction of complex downtown scenarios with multiple road users, e.g., pedestrians, bikes, and…

Robotics · Computer Science 2017-11-08 Stefan Hoermann , Martin Bach , Klaus Dietmayer

As autonomous vehicles move from a simplified research setting to practical use, there exists a large gap between the dynamic behavior of a human driving and an autonomous system. Risk-aware behavior needs to naturally develop in order to…

Robotics · Computer Science 2026-05-14 Jason Gibson , Bogdan Vlahov , Patrick Spieler , Evangelos A. Theodorou

Autonomous vehicles (AVs) rely on real-time perception systems to understand road environments and ensure safe navigation. However, implementing reliable perception algorithms on resource-constrained embedded platforms remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Md Tanjemul Islam , Md Rafiul Kabir

In the typical autonomous driving stack, planning and control systems represent two of the most crucial components in which data retrieved by sensors and processed by perception algorithms are used to implement a safe and comfortable…

Robotics · Computer Science 2022-07-06 Paolo Maramotti , Alessandro Paolo Capasso , Giulio Bacchiani , Alberto Broggi

In this paper, we present a novel end-to-end deep neural network model for autonomous driving that takes monocular image sequence as input, and directly generates the steering control angle. Firstly, we model the end-to-end driving problem…

Robotics · Computer Science 2021-03-11 Peng Wan , Zhenbo Song , Jianfeng Lu

This work presents a novel Learning Model Predictive Control (LMPC) strategy for autonomous racing at the handling limit that can iteratively explore and learn unknown dynamics in high-speed operational domains. We start from existing LMPC…

Robotics · Computer Science 2024-08-22 Haoru Xue , Edward L. Zhu , John M. Dolan , Francesco Borrelli

Imitation learning is a promising approach for training autonomous vehicles (AV) to navigate complex traffic environments by mimicking expert driver behaviors. While existing imitation learning frameworks focus on leveraging expert…

Robotics · Computer Science 2025-09-25 Yasin Sonmez , Hanna Krasowski , Murat Arcak

Recent efforts in the development of autonomous driving technology have induced great advancements in perception, planning and control systems. Model predictive control is one of the most popular advanced control methods, but its…

Systems and Control · Electrical Eng. & Systems 2024-10-17 Matheus Wagner , Julio E. Normey-Rico

The technology for autonomous vehicles is close to replacing human drivers by artificial systems endowed with high-level decision-making capabilities. In this regard, systems must learn about the usual vehicle's behavior to predict imminent…

Image and Video Processing · Electrical Eng. & Systems 2020-04-22 Mahdyar Ravanbakhsh , Mohamad Baydoun , Damian Campo , Pablo Marin , David Martin , Lucio Marcenaro , andCarlo Regazzoni

Car-following is a control process in which a following vehicle (FV) adjusts its acceleration to keep a safe distance from the lead vehicle (LV). Recently, there has been a booming of data-driven models that enable more accurate modeling of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Xianda Chen , Meixin Zhu , Kehua Chen , Pengqin Wang , Hongliang Lu , Hui Zhong , Xu Han , Yinhai Wang

This literature review focuses on three important aspects of an autonomous car system: tracking (assessing the identity of the actors such as cars, pedestrians or obstacles in a sequence of observations), prediction (predicting the future…

Machine Learning · Computer Science 2023-08-30 Florin Leon , Marius Gavrilescu

As part of a complete software stack for autonomous driving, NVIDIA has created a neural-network-based system, known as PilotNet, which outputs steering angles given images of the road ahead. PilotNet is trained using road images paired…

Computer Vision and Pattern Recognition · Computer Science 2017-04-27 Mariusz Bojarski , Philip Yeres , Anna Choromanska , Krzysztof Choromanski , Bernhard Firner , Lawrence Jackel , Urs Muller

Autonomous driving remains a challenging task, particularly due to safety concerns. Modern vehicles are typically equipped with expensive sensors such as LiDAR, cameras, and radars to reduce the risk of accidents. However, these sensors…

Artificial Intelligence · Computer Science 2025-10-15 Mattia Grasselli , Angelo Porrello , Carlo Augusto Grazia

Autonomous driving presents many challenges due to the large number of scenarios the autonomous vehicle (AV) may encounter. End-to-end deep learning models are comparatively simplistic models that can handle a broad set of scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhongying CuiZhu , Francois Charette , Amin Ghafourian , Debo Shi , Matthew Cui , Anjali Krishnamachar , Iman Soltani

Lane detection plays a critical role in the field of autonomous driving. Prevailing methods generally adopt basic concepts (anchors, key points, etc.) from object detection and segmentation tasks, while these approaches require manual…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Jiayan Cao , Xueyu Zhu , Cheng Qian

Predicting the future location of vehicles is essential for safety-critical applications such as advanced driver assistance systems (ADAS) and autonomous driving. This paper introduces a novel approach to simultaneously predict both the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Yu Yao , Mingze Xu , Chiho Choi , David J. Crandall , Ella M. Atkins , Behzad Dariush