English
Related papers

Related papers: See Tomorrow, Act Today: Foresight-Driven Autonomo…

200 papers

Accurate trajectory prediction has long been a major challenge for autonomous driving (AD). Traditional data-driven models predominantly rely on statistical correlations, often overlooking the causal relationships that govern traffic…

Artificial Intelligence · Computer Science 2025-05-13 Bonan Wang , Haicheng Liao , Chengyue Wang , Bin Rao , Yanchen Guan , Guyang Yu , Jiaxun Zhang , Songning Lai , Chengzhong Xu , Zhenning Li

How can we reliably simulate future driving scenarios under a wide range of ego driving behaviors? Recent driving world models, developed exclusively on real-world driving data composed mainly of safe expert trajectories, struggle to follow…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jiazhi Yang , Kashyap Chitta , Shenyuan Gao , Long Chen , Yuqian Shao , Xiaosong Jia , Hongyang Li , Andreas Geiger , Xiangyu Yue , Li Chen

The goal of autonomous vehicles is to navigate public roads safely and comfortably. To enforce safety, traditional planning approaches rely on handcrafted rules to generate trajectories. Machine learning-based systems, on the other hand,…

End-to-end autonomous driving systems increasingly rely on vision-centric world models to understand and predict their environment. However, a common ineffectiveness in these models is the full reconstruction of future scenes, which expends…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jianbiao Mei , Yu Yang , Xuemeng Yang , Licheng Wen , Jiajun Lv , Botian Shi , Yong Liu

Self-driving vehicles rely on multimodal motion forecasts to effectively interact with their environment and plan safe maneuvers. We introduce SceneMotion, an attention-based model for forecasting scene-wide motion modes of multiple traffic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Royden Wagner , Ömer Sahin Tas , Marlon Steiner , Fabian Konstantinidis , Hendrik Königshof , Marvin Klemp , Carlos Fernandez , Christoph Stiller

Autonomous driving requires reasoning about how the environment evolves and planning actions accordingly. Existing world-model-based approaches typically predict future scenes first and plan afterwards, resulting in open-loop imagination…

Robotics · Computer Science 2026-03-31 Qiqi Liu , Huan Xu , Jingyu Li , Bin Sun , Zhihui Hao , Dangen She , Xiatian Zhu , Li Zhang

While intelligence of autonomous vehicles (AVs) has significantly advanced in recent years, accidents involving AVs suggest that these autonomous systems lack gracefulness in driving when interacting with human drivers. In the setting of a…

Robotics · Computer Science 2019-01-30 Yi Ren , Steven Elliott , Yiwei Wang , Yezhou Yang , Wenlong Zhang

Prospection, the act of predicting the consequences of many possible futures, is intrinsic to human planning and action, and may even be at the root of consciousness. Surprisingly, this idea has been explored comparatively little in…

Robotics · Computer Science 2018-04-03 Chris Paxton , Yotam Barnoy , Kapil Katyal , Raman Arora , Gregory D. Hager

Directly producing planning results from raw sensors has been a long-desired solution for autonomous driving and has attracted increasing attention recently. Most existing end-to-end autonomous driving methods factorize this problem into…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Wenzhao Zheng , Ruiqi Song , Xianda Guo , Chenming Zhang , Long Chen

Motion prediction for intelligent vehicles typically focuses on estimating the most probable future evolutions of a traffic scenario. Estimating the gap acceptance, i.e., whether a vehicle merges or crosses before another vehicle with the…

Robotics · Computer Science 2024-09-18 Max Bastian Mertens , Jona Ruof , Jan Strohbeck , Michael Buchholz

In this paper, we present LookOut, a novel autonomy system that perceives the environment, predicts a diverse set of futures of how the scene might unroll and estimates the trajectory of the SDV by optimizing a set of contingency plans over…

Robotics · Computer Science 2022-11-07 Alexander Cui , Sergio Casas , Abbas Sadat , Renjie Liao , Raquel Urtasun

Autonomous vehicles need to accomplish their tasks while interacting with human drivers in traffic. It is thus crucial to equip autonomous vehicles with artificial reasoning to better comprehend the intentions of the surrounding traffic,…

Artificial Intelligence · Computer Science 2023-11-02 Xiao Li , Kaiwen Liu , H. Eric Tseng , Anouck Girard , Ilya Kolmanovsky

The ability of predicting the future is important for intelligent systems, e.g. autonomous vehicles and robots to plan early and make decisions accordingly. Future scene parsing and optical flow estimation are two key tasks that help agents…

Computer Vision and Pattern Recognition · Computer Science 2017-11-10 Xiaojie Jin , Huaxin Xiao , Xiaohui Shen , Jimei Yang , Zhe Lin , Yunpeng Chen , Zequn Jie , Jiashi Feng , Shuicheng Yan

In this paper we introduce a general estimation methodology for learning a model of human perception and control in a sensorimotor control task based upon a finite set of demonstrations. The model's structure consists of i the agent's…

Machine Learning · Computer Science 2025-05-02 Ran Wei , Anthony D. McDonald , Alfredo Garcia , Gustav Markkula , Johan Engstrom , Matthew O'Kelly

Motion forecasting for on-road traffic agents presents both a significant challenge and a critical necessity for ensuring safety in autonomous driving systems. In contrast to most existing data-driven approaches that directly predict future…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Muleilan Pei , Shaoshuai Shi , Xuesong Chen , Xu Liu , Shaojie Shen

Predicting the behaviors of other road users is crucial to safe and intelligent decision-making for autonomous vehicles (AVs). However, most motion prediction models ignore the influence of the AV's actions and the planning module has to…

Robotics · Computer Science 2023-02-09 Zhiyu Huang , Haochen Liu , Jingda Wu , Wenhui Huang , Chen Lv

Self-driving vehicles rely on sensory input to monitor their surroundings and continuously adapt to the most likely future road course. Predictive trajectory planning is based on snapshots of the (uncertain) road course as a key input.…

Robotics · Computer Science 2025-09-24 Benjamin Bogenberger , Johannes Bürger , Vladislav Nenchev

This paper presents a novel approach to Autonomous Vehicle (AV) control through the application of active inference, a theory derived from neuroscience that conceptualizes the brain as a predictive machine. Traditional autonomous driving…

Robotics · Computer Science 2025-03-17 Elahe Delavari , John Moore , Junho Hong , Jaerock Kwon

The way of analyzing, designing and building of real-time projects has been changed due to the rapid growth of internet, mobile technologies and intelligent applications. Most of these applications are intelligent, tiny and distributed…

Multiagent Systems · Computer Science 2011-08-03 Venkatesh. M , K. Kumar , Srinivas. V

Autonomous driving has become one of the most popular research topics within Artificial Intelligence. An autonomous vehicle is understood as a system that combines perception, decision-making, planning, and control. All of those tasks…

Robotics · Computer Science 2023-06-01 Mariana Pinto , Inês Dutra , Joaquim Fonseca