English
Related papers

Related papers: Infrastructure-Centric World Models: Bridging Temp…

200 papers

Exploring open-world situations in an end-to-end manner is a promising yet challenging task due to the need for strong generalization capabilities. In particular, end-to-end autonomous driving in unstructured outdoor environments often…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Hyunki Seong , Seongwoo Moon , Hojin Ahn , Jehun Kang , David Hyunchul Shim

World models are becoming central to robotic planning and control as they enable prediction of future state transitions. Existing approaches often emphasize video generation or natural-language prediction, which are difficult to ground in…

World models, which are predictive representations of how environments evolve under actions, have become a central component of robot learning. They support policy learning, planning, simulation, evaluation, data generation, and have…

A semantic map of the road scene, covering fundamental road elements, is an essential ingredient in autonomous driving systems. It provides important perception foundations for positioning and planning when rendered in the Bird's-Eye-View…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Siyu Li , Kailun Yang , Hao Shi , Jiaming Zhang , Jiacheng Lin , Zhifeng Teng , Zhiyong Li

End-to-end autonomous driving has emerged as a promising approach to unify perception, prediction, and planning within a single framework, reducing information loss and improving adaptability. However, existing methods often rely on fixed…

Robotics · Computer Science 2025-07-18 Yuhang Lu , Jiadong Tu , Yuexin Ma , Xinge Zhu

The key to achieving autonomous driving lies in topology-aware perception, the structured understanding of the driving environment with an emphasis on lane topology and road semantics. This survey systematically reviews four core research…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yixiao Chen , Ruining Yang , Xin Chen , Jia He , Dongliang Xu , Yue Yao

Bird's-Eye View (BEV) Perception has received increasing attention in recent years as it provides a concise and unified spatial representation across views and benefits a diverse set of downstream driving applications. At the same time,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Alexander Swerdlow , Runsheng Xu , Bolei Zhou

Autonomous driving promises transformative improvements to transportation, but building systems capable of safely navigating the unstructured complexity of real-world scenarios remains challenging. A critical problem lies in effectively…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Anthony Hu , Lloyd Russell , Hudson Yeo , Zak Murez , George Fedoseev , Alex Kendall , Jamie Shotton , Gianluca Corrado

Urban traffic speed prediction aims to estimate the future traffic speed for improving the urban transportation services. Enormous efforts have been made on exploiting spatial correlations and temporal dependencies of traffic speed evolving…

Machine Learning · Computer Science 2022-12-27 Dongkun Wang , Wei Fan , Pengyang Wang , Pengfei Wang , Dongjie Wang , Denghui Zhang , Yanjie Fu

Real-time urban traffic surveillance is vital for Intelligent Transportation Systems (ITS) to ensure road safety, optimize traffic flow, track vehicle trajectories, and prevent collisions in smart cities. Deploying edge cameras across urban…

Networking and Internet Architecture · Computer Science 2025-09-26 Murat Arda Onsu , Poonam Lohan , Burak Kantarci , Aisha Syed , Matthew Andrews , Sean Kennedy

World models aim to improve robotic decision making by predicting the consequences of actions. However, in practice, their predictions often become unreliable once the robot encounters states outside the training distribution, limiting…

Robotics · Computer Science 2026-05-18 Tuo An , Jindou Jia , Gen Li , Jingliang Li , Chuhao Zhou , Pengfei Liu , Bofan Lyu , Jiaqi Bai , Xinying Guo , Geng Li , Jianfei Yang

Agile locomotion in complex 3D environments requires robust spatial awareness to safely avoid diverse obstacles such as aerial clutter, uneven terrain, and dynamic agents. Depth-based perception approaches often struggle with sensor noise,…

Robotics · Computer Science 2025-08-29 Zifan Wang , Teli Ma , Yufei Jia , Xun Yang , Jiaming Zhou , Wenlong Ouyang , Qiang Zhang , Junwei Liang

3D object detection based on LiDAR point clouds is a crucial module in autonomous driving particularly for long range sensing. Most of the research is focused on achieving higher accuracy and these models are not optimized for deployment on…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sambit Mohapatra , Senthil Yogamani , Heinrich Gotzig , Stefan Milz , Patrick Mader

End-to-end autonomous driving offers a streamlined alternative to the traditional modular pipeline, integrating perception, prediction, and planning within a single framework. While Deep Reinforcement Learning (DRL) has recently gained…

Artificial Intelligence · Computer Science 2024-09-27 Siyi Lu , Lei He , Shengbo Eben Li , Yugong Luo , Jianqiang Wang , Keqiang Li

A significant portion of driving hazards is caused by human error and disregard for local driving regulations; Consequently, an intelligent assistance system can be beneficial. This paper proposes a novel vision-based modular package to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Amirhossein Kazerouni , Amirhossein Heydarian , Milad Soltany , Aida Mohammadshahi , Abbas Omidi , Saeed Ebadollahi

Pretrained foundation models have become an important basis for end-to-end autonomous driving. In contrast to vision-language models pretrained primarily on static image-text pairs, video generative models capture temporal dynamics and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Chen Shi , Jinrui Xu , Shaoshuai Shi , Kehua Sheng , Bo Zhang , Li Jiang

With the growing interest in autonomous driving, there is an increasing demand for accurate and reliable road perception technologies. In complex environments without high-definition map support, autonomous vehicles must independently…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xuewei Tang , Mengmeng Yang , Tuopu Wen , Peijin Jia , Le Cui , Mingshang Luo , Kehua Sheng , Bo Zhang , Diange Yang , Kun Jiang

End-to-end autonomous driving methods aim to directly map raw sensor inputs to future driving actions such as planned trajectories, bypassing traditional modular pipelines. While these approaches have shown promise, they often operate under…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Bozhou Zhang , Nan Song , Jingyu Li , Xiatian Zhu , Jiankang Deng , Li Zhang

Collaborative perception plays a crucial role in enhancing environmental understanding by expanding the perceptual range and improving robustness against sensor failures, which primarily involves collaborative 3D detection and tracking…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Xunjie He , Christina Dao Wen Lee , Meiling Wang , Chengran Yuan , Zefan Huang , Yufeng Yue , Marcelo H. Ang

Legged locomotion over various terrains is challenging and requires precise perception of the robot and its surroundings from both proprioception and vision. However, learning directly from high-dimensional visual input is often…

Robotics · Computer Science 2024-09-26 Hang Lai , Jiahang Cao , Jiafeng Xu , Hongtao Wu , Yunfeng Lin , Tao Kong , Yong Yu , Weinan Zhang