English
Related papers

Related papers: Infrastructure-Centric World Models: Bridging Temp…

200 papers

World modeling has become a cornerstone in AI research, enabling agents to understand, represent, and predict the dynamic environments they inhabit. While prior work largely emphasizes generative methods for 2D image and video data, they…

Autonomous vehicle perception typically relies on modular pipelines that decompose the task into detection, tracking, and prediction. While interpretable, these pipelines suffer from error accumulation and limited inter-task synergy.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Loïc Stratil , Felix Fent , Esteban Rivera , Markus Lienkamp

Occlusion is a major challenge for LiDAR-based object detection methods. This challenge becomes safety-critical in urban traffic where the ego vehicle must have reliable object detection to avoid collision while its field of view is…

Robotics · Computer Science 2023-09-20 Minh-Quan Dao , Julie Stephany Berrio , Vincent Frémont , Mao Shan , Elwan Héry , Stewart Worrall

The capability for open vocabulary perception represents a significant advancement in autonomous driving systems, facilitating the comprehension and interpretation of a wide array of textual inputs in real-time. Despite extensive research…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xinlong Cheng , Lei Li

Vehicle localization using roadside LiDARs can provide centimeter-level accuracy for cloud-controlled vehicles while simultaneously serving multiple vehicles, enhanc-ing safety and efficiency. While most existing studies rely on repetitive…

Robotics · Computer Science 2025-09-22 Runxin Zhao , Chunxiang Wang , Hanyang Zhuang , Ming Yang

A robust and efficient traffic monitoring system is essential for smart cities and Intelligent Transportation Systems (ITS), using sensors and cameras to track vehicle movements, optimize traffic flow, reduce congestion, enhance road…

Artificial Intelligence · Computer Science 2026-01-23 Murat Arda Onsu , Poonam Lohan , Burak Kantarci , Aisha Syed , Matthew Andrews , Sean Kennedy

Recent progress in advanced driver assistance systems and the race towards autonomous vehicles is mainly driven by two factors: (1) increasingly sophisticated algorithms that interpret the environment around the vehicle and react…

Computer Vision and Pattern Recognition · Computer Science 2017-04-04 Marius Cordts , Timo Rehfeld , Lukas Schneider , David Pfeiffer , Markus Enzweiler , Stefan Roth , Marc Pollefeys , Uwe Franke

Large vision-language models (VLMs) have shown promising capabilities in scene understanding, enhancing the explainability of driving behaviors and interactivity with users. Existing methods primarily fine-tune VLMs on on-board multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Nan Song , Bozhou Zhang , Xiatian Zhu , Jiankang Deng , Li Zhang

Unlike popular modularized framework, end-to-end autonomous driving seeks to solve the perception, decision and control problems in an integrated way, which can be more adapting to new scenarios and easier to generalize at scale. However,…

Robotics · Computer Science 2020-07-08 Jianyu Chen , Shengbo Eben Li , Masayoshi Tomizuka

Pretrained video diffusion models provide powerful spatiotemporal generative priors, making them a natural foundation for robotic world models. While recent world-action models jointly optimize future videos and actions, they predominantly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Zhaoyang Yang , Yurun Jin , Lizhe Qi , Cong Huang , Kai Chen

The deep integration of communication with intelligence and sensing, as a defining vision of 6G, renders environment-aware channel prediction a key enabling technology. As a representative 6G application, vehicular communications require…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Xuejian Zhang , Ruisi He , Minseok Kim , Inocent Calist , Mi Yang , Ziyi Qi

Traffic forecasting requires modeling complex temporal dynamics and long-range spatial dependencies over large sensor networks. Existing methods typically face a trade-off between expressiveness and efficiency: Transformer-based models…

Machine Learning · Computer Science 2026-04-16 Xinjin Li , Jinghan Cao , Mengyue Wang , Yue Wu , Longxiang Yan , Yeyang Zhou , Ziqi Sha , Yu Ma

World models and video generation are pivotal technologies in the domain of autonomous driving, each playing a critical role in enhancing the robustness and reliability of autonomous systems. World models, which simulate the dynamics of…

Artificial Intelligence · Computer Science 2024-11-06 Ao Fu , Yi Zhou , Tao Zhou , Yi Yang , Bojun Gao , Qun Li , Guobin Wu , Ling Shao

Real-time perception and motion planning are two crucial tasks for autonomous driving. While there are many research works focused on improving the performance of perception and motion planning individually, it is still not clear how a…

Robotics · Computer Science 2023-09-01 Zhanhong Huang , Xiao Zhang , Xinming Huang

Scene understanding, defined as learning, extraction, and representation of interactions among traffic elements, is one of the critical challenges toward high-level autonomous driving (AD). Current scene understanding methods mainly focus…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Yuning Wang , Zhiyuan Liu , Haotian Lin , Junkai Jiang , Shaobing Xu , Jianqiang Wang

The use of infrastructure sensor technology for traffic detection has already been proven several times. However, extrinsic sensor calibration is still a challenge for the operator. While previous approaches are unable to calibrate the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Laurent Kloeker , Christian Kotulla , Lutz Eckstein

LiDAR is crucial for robust 3D scene perception in autonomous driving. LiDAR perception has the largest body of literature after camera perception. However, multi-task learning across tasks like detection, segmentation, and motion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Sambit Mohapatra , Senthil Yogamani , Varun Ravi Kumar , Stefan Milz , Heinrich Gotzig , Patrick Mäder

This report presents a unified technical system addressing the two core capabilities of world models for autonomous driving: world representation and world generation. For world representation, we propose WorldRec, a feed-forward…

Building robust 3D perception for self-driving still relies heavily on large-scale data collection and manual annotation, yet this paradigm becomes impractical as deployment expands across diverse cities and regions. Meanwhile, modern…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Zhen Xu , Jinsu Yoo , Cristian Bautista , Zanming Huang , Tai-Yu Pan , Zhenzhen Liu , Katie Z Luo , Mark Campbell , Bharath Hariharan , Wei-Lun Chao

Model-based planning in robotic domains is challenged by the hybrid nature of physical dynamics, where continuous motion is punctuated by discrete events such as contacts and impacts. Conventional latent world models typically employ…

Artificial Intelligence · Computer Science 2026-05-14 Mingwei Li , Xiaoyuan Zhang , Chengwei Yang , Zilong Zheng , Yaodong Yang