English
Related papers

Related papers: PlanT 2.0: Exposing Biases and Structural Flaws in…

200 papers

In the behavioral cloning approach to end-to-end driving, a dataset of expert driving is collected and the model learns to guess what the expert would do in different situations. Situations are summarized in observations and the outputs are…

Robotics · Computer Science 2024-04-16 Ardi Tampuu , Ilmar Uduste , Kristjan Roosild

Networked control strategies based on limited information about the plant model usually results in worse closed-loop performance than optimal centralized control with full plant model information. Recently, this fact has been established by…

Optimization and Control · Mathematics 2014-07-23 Farhad Farokhi , Karl H. Johansson

Autonomous race cars require perception, estimation, planning, and control modules which work together asynchronously while driving at the limit of a vehicle's handling capability. A fundamental challenge encountered in designing these…

Robotics · Computer Science 2020-11-17 Achin Jain , Matthew O'Kelly , Pratik Chaudhari , Manfred Morari

Diffusion-based planners have shown strong potential for autonomous driving by capturing multi-modal driving behaviors. A key challenge is how to effectively guide these models for safe and reactive planning in closed-loop settings, where…

Artificial Intelligence · Computer Science 2026-03-06 Shu Liu , Wenlin Chen , Weihao Li , Zheng Wang , Lijin Yang , Jianing Huang , Yipin Zhang , Zhongzhan Huang , Ze Cheng , Hao Yang

Given the current point-to-point navigation capabilities of autonomous vehicles, researchers are looking into complex service requests that require the vehicles to visit multiple points of interest. In this paper, we develop a layered…

Robotics · Computer Science 2022-10-06 Yan Ding , Cheng Cui , Xiaohan Zhang , Shiqi Zhang

In autonomous driving, end-to-end planners directly utilize raw sensor data, enabling them to extract richer scene features and reduce information loss compared to traditional planners. This raises a crucial research question: how can we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Yingyan Li , Lue Fan , Jiawei He , Yuqi Wang , Yuntao Chen , Zhaoxiang Zhang , Tieniu Tan

Autonomous driving presents a complex challenge, which is usually addressed with artificial intelligence models that are end-to-end or modular in nature. Within the landscape of modular approaches, a bio-inspired neural circuit policy model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Anass Bairouk , Mirjana Maras , Simon Herlin , Alexander Amini , Marc Blanchon , Ramin Hasani , Patrick Chareyre , Daniela Rus

End-to-end autonomous driving systems powered by Vision-Language-Action (VLA) models achieve strong performance on common driving scenarios, yet remain brittle in rare but safety-critical long-tail situations such as active construction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ruiyang Zhu , Yuehan He , Boyuan Zheng , Zesen Zhao , Ahmad Chalhoub , Qingzhao Zhang , Z. Morley Mao

We consider planning problems, that often arise in autonomous driving applications, in which an agent should decide on immediate actions so as to optimize a long term objective. For example, when a car tries to merge in a roundabout it…

Machine Learning · Computer Science 2016-02-05 Shai Shalev-Shwartz , Nir Ben-Zrihem , Aviad Cohen , Amnon Shashua

Learning a human-like driving policy from large-scale driving demonstrations is promising, but the uncertainty and non-deterministic nature of planning make it challenging. Existing learning-based planning methods follow a deterministic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Bo Jiang , Shaoyu Chen , Hao Gao , Bencheng Liao , Qian Zhang , Wenyu Liu , Xinggang Wang

Machine learning (ML)-based planners have recently gained significant attention. They offer advantages over traditional optimization-based planning algorithms. These advantages include fewer manually selected parameters and faster…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Hui Zhou , Shaoshuai Shi , Hongsheng Li

Recent research on testing autonomous driving agents has grown significantly, especially in simulation environments. The CARLA simulator is often the preferred choice, and the autonomous agents from the CARLA Leaderboard challenge are…

Software Engineering · Computer Science 2025-03-14 Masoud Jamshidiyan Tehrani , Jinhan Kim , Paolo Tonella

Originally, the decision and control of the lane change of the vehicle were on the human driver. In previous studies, the decision-making of lane-changing of the human drivers was mainly used to increase the individual's benefit. However,…

Systems and Control · Electrical Eng. & Systems 2021-08-31 Seongjin Choi

Current autonomous vehicles operate primarily within limited regions, but there is increasing demand for broader applications. However, as models scale, their limited capacity becomes a significant challenge for adapting to novel scenarios.…

Robotics · Computer Science 2025-03-03 Nanshan Deng , Weitao Zhou , Bo Zhang , Junze Wen , Kun Jiang , Zhong Cao , Diange Yang

Stereo matching plays a crucial role in enabling depth perception for autonomous driving and robotics. While recent years have witnessed remarkable progress in stereo matching algorithms, largely driven by learning-based methods and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Xianda Guo , Chenming Zhang , Ruilin Wang , Youmin Zhang , Wenzhao Zheng , Matteo Poggi , Hao Zhao , Qin Zou , Long Chen

This paper explores the emerging knowledge-driven autonomous driving technologies. Our investigation highlights the limitations of current autonomous driving systems, in particular their sensitivity to data bias, difficulty in handling…

The integration of Vision-Language Models (VLMs) into autonomous driving promises to solve long-tail scenarios, but this paradigm faces the critical and unaddressed challenge of catastrophic forgetting. The very fine-tuning process used to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Runhao Mao , Hanshi Wang , Yixiang Yang , Qianli Ma , Jingmeng Zhou , Zhipeng Zhang

Simulation has the potential to transform the development of robust algorithms for mobile agents deployed in safety-critical scenarios. However, the poor photorealism and lack of diverse sensor modalities of existing simulation engines…

In tasks aiming for long-term returns, planning becomes essential. We study generative modeling for planning with datasets repurposed from offline reinforcement learning. Specifically, we identify temporal consistency in the absence of…

Machine Learning · Computer Science 2025-08-19 Deqian Kong , Dehong Xu , Minglu Zhao , Bo Pang , Jianwen Xie , Andrew Lizarraga , Yuhao Huang , Sirui Xie , Ying Nian Wu

Autonomous driving has become one of the most popular research topics within Artificial Intelligence. An autonomous vehicle is understood as a system that combines perception, decision-making, planning, and control. All of those tasks…

Robotics · Computer Science 2023-06-01 Mariana Pinto , Inês Dutra , Joaquim Fonseca