English
Related papers

Related papers: Imitation Learning for End to End Vehicle Longitud…

200 papers

Usually, a controller for path- or trajectory tracking is employed in autonomous driving. Typically, these controllers generate high-level commands like longitudinal acceleration or force. However, vehicles with combustion engines expect…

Systems and Control · Electrical Eng. & Systems 2025-04-25 Phillip Pitschi , Simon Sagmeister , Sven Goblirsch , Markus Lienkamp , Boris Lohmann

Deep learning has been used to demonstrate end-to-end neural network learning for autonomous vehicle control from raw sensory input. While LiDAR sensors provide reliably accurate information, existing end-to-end driving solutions are mainly…

Robotics · Computer Science 2021-05-21 Zhijian Liu , Alexander Amini , Sibo Zhu , Sertac Karaman , Song Han , Daniela Rus

An intelligent driving system should dynamically formulate appropriate driving strategies based on the current environment and vehicle status while ensuring system security and reliability. However, methods based on reinforcement learning…

Robotics · Computer Science 2025-09-11 Zuojin Tang , Xiaoyu Chen , Yongqiang Li , Jianyu Chen

While video action recognition has been an active area of research for several years, zero-shot action recognition has only recently started gaining traction. In this work, we propose a novel end-to-end trained transformer model which is…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Keval Doshi , Yasin Yilmaz

The current autonomous stack is well modularized and consists of perception, decision making and control in a handcrafted framework. With the advances in artificial intelligence (AI) and computing resources, researchers have been pushing…

Robotics · Computer Science 2024-04-19 Satya R. Jaladi , Zhimin Chen , Narahari R. Malayanur , Raja M. Macherla , Bing Li

To plan safe and comfortable trajectories for automated vehicles on highways, accurate predictions of traffic situations are needed. So far, a lot of research effort has been spent on detecting lane change maneuvers rather than on…

Machine Learning · Computer Science 2021-03-17 Florian Wirthmüller , Marvin Klimke , Julian Schlechtriemen , Jochen Hipp , Manfred Reichert

One way to approach end-to-end autonomous driving is to learn a policy function that maps from a sensory input, such as an image frame from a front-facing camera, to a driving action, by imitating an expert driver, or a reference policy.…

Machine Learning · Computer Science 2016-05-23 Jiakai Zhang , Kyunghyun Cho

End-to-end visual-based imitation learning has been widely applied in autonomous driving. When deploying the trained visual-based driving policy, a deterministic command is usually directly applied without considering the uncertainty of the…

Robotics · Computer Science 2019-07-19 Lei Tai , Peng Yun , Yuying Chen , Congcong Liu , Haoyang Ye , Ming Liu

This paper proposes a life-long adaptive path tracking policy learning method for autonomous vehicles that can self-evolve and self-adapt with multi-task knowledge. Firstly, the proposed method can learn a model-free control policy for path…

Robotics · Computer Science 2021-09-16 Cheng Gong , Jianwei Gong , Chao Lu , Zhe Liu , Zirui Li

Learning contextual and spatial environmental representations enhances autonomous vehicle's hazard anticipation and decision-making in complex scenarios. Recent perception systems enhance spatial understanding with sensor fusion but often…

Robotics · Computer Science 2024-01-18 Shoaib Azam , Farzeen Munir , Ville Kyrki , Moongu Jeon , Witold Pedrycz

End-to-end autonomous driving has drawn tremendous attention recently. Many works focus on using modular deep neural networks to construct the end-to-end archi-tecture. However, whether using powerful large language models (LLM), especially…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Zilong Guo , Yi Luo , Long Sha , Dongxu Wang , Panqu Wang , Chenyang Xu , Yi Yang

We demonstrate the first reinforcement-learning application for robots equipped with an event camera. Because of the considerably lower latency of the event camera, it is possible to achieve much faster control of robots compared with the…

Machine Learning · Computer Science 2020-04-03 Riku Arakawa , Shintaro Shiba

A realistic long-term microscopic traffic simulator is necessary for understanding how microscopic changes affect traffic patterns at a larger scale. Traditional simulators that model human driving behavior with heuristic rules often fail…

Robotics · Computer Science 2023-11-21 Ke Guo , Wei Jing , Lingping Gao , Weiwei Liu , Weizi Li , Jia Pan

Imitation learning for end-to-end autonomous driving has drawn attention from academic communities. Current methods either only use images as the input which is ambiguous when a car approaches an intersection, or use additional command…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Qing Wang , Long Chen , Wei Tian

End-to-end models for autonomous driving hold the promise of learning complex behaviors directly from sensor data, but face critical challenges in safety and handling long-tail events. Reinforcement Learning (RL) offers a promising path to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Tianyi Yan , Tao Tang , Xingtai Gui , Yongkang Li , Jiasen Zhesng , Weiyao Huang , Lingdong Kong , Wencheng Han , Xia Zhou , Xueyang Zhang , Yifei Zhan , Kun Zhan , Cheng-zhong Xu , Jianbing Shen

Multi-sensor fusion is essential for autonomous vehicle localization, as it is capable of integrating data from various sources for enhanced accuracy and reliability. The accuracy of the integrated location and orientation depends on the…

Robotics · Computer Science 2025-03-10 Changhong Lin , Jiarong Lin , Zhiqiang Sui , XiaoZhi Qu , Rui Wang , Kehua Sheng , Bo Zhang

Trajectory sampling in the Frenet(road-aligned) frame, is one of the most popular methods for motion planning of autonomous vehicles. It operates by sampling a set of behavioural inputs, such as lane offset and forward speed, before solving…

Robotics · Computer Science 2023-10-24 Jatan Shrestha , Simon Idoko , Basant Sharma , Arun Kumar Singh

Autonomous driving presents many challenges due to the large number of scenarios the autonomous vehicle (AV) may encounter. End-to-end deep learning models are comparatively simplistic models that can handle a broad set of scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhongying CuiZhu , Francois Charette , Amin Ghafourian , Debo Shi , Matthew Cui , Anjali Krishnamachar , Iman Soltani

Continual learning is essential for all real-world applications, as frozen pre-trained models cannot effectively deal with non-stationary data distributions. The purpose of this study is to review the state-of-the-art methods that allow…

Machine Learning · Computer Science 2022-02-28 Khadija Shaheen , Muhammad Abdullah Hanif , Osman Hasan , Muhammad Shafique

Autonomous driving is challenging in adverse road and weather conditions in which there might not be lane lines, the road might be covered in snow and the visibility might be poor. We extend the previous work on end-to-end learning for…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Jyri Maanpää , Josef Taher , Petri Manninen , Leo Pakola , Iaroslav Melekhov , Juha Hyyppä