English
Related papers

Related papers: Infrastructure-Centric World Models: Bridging Temp…

200 papers

Traditional manual driving and single-vehicle-based intelligent driving have limitations in real-time and accurate acquisition of the current driving status and intentions of surrounding vehicles, leading to vehicles typically maintaining…

Computers and Society · Computer Science 2025-03-18 Tao Li , Xiang Dong , Junfeng Hao , Ping Yin , Xiaoxue Xu , Maokai Lai , Yuan Li , Ting Peng

We explore Bird's-Eye View (BEV) generation, converting a BEV map into its corresponding multi-view street images. Valued for its unified spatial representation aiding multi-sensor fusion, BEV is pivotal for various autonomous driving…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xiaojie Xu , Tianshuo Xu , Fulong Ma , Yingcong Chen

Vision-centric autonomous driving has recently raised wide attention due to its lower cost. Pre-training is essential for extracting a universal representation. However, current vision-centric pre-training typically relies on either 2D or…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Chen Min , Dawei Zhao , Liang Xiao , Jian Zhao , Xinli Xu , Zheng Zhu , Lei Jin , Jianshu Li , Yulan Guo , Junliang Xing , Liping Jing , Yiming Nie , Bin Dai

Dynamic scene understanding is the ability of a computer system to interpret and make sense of the visual information present in a video of a real-world scene. In this thesis, we present a series of frameworks for dynamic scene…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Salman Khan

Intelligent Traffic Monitoring (ITMo) technologies hold the potential for improving road safety/security and for enabling smart city infrastructure. Understanding traffic situations requires a complex fusion of perceptual information with…

Computation and Language · Computer Science 2023-07-18 Jiarui Zhang , Filip Ilievski , Kaixin Ma , Aravinda Kollaa , Jonathan Francis , Alessandro Oltramari

Perceiving the environment is one of the most fundamental keys to enabling Cooperative Driving Automation (CDA), which is regarded as the revolutionary solution to addressing the safety, mobility, and sustainability issues of contemporary…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Zhengwei Bai , Guoyuan Wu , Matthew J. Barth , Yongkang Liu , Emrah Akin Sisbot , Kentaro Oguchi , Zhitong Huang

End-to-end autonomous driving directly generates planning trajectories from raw sensor data, yet it typically relies on costly perception supervision to extract scene information. A critical research challenge arises: constructing an…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Yupeng Zheng , Pengxuan Yang , Zebin Xing , Qichao Zhang , Yuhang Zheng , Yinfeng Gao , Pengfei Li , Teng Zhang , Zhongpu Xia , Peng Jia , Dongbin Zhao

In the rapidly evolving landscape of autonomous driving, the capability to accurately predict future events and assess their implications is paramount for both safety and efficiency, critically aiding the decision-making process. World…

Machine Learning · Computer Science 2024-05-08 Yanchen Guan , Haicheng Liao , Zhenning Li , Jia Hu , Runze Yuan , Yunjian Li , Guohui Zhang , Chengzhong Xu

Within the field of automated driving, a clear trend in environment perception tends towards more sensors, higher redundancy, and overall increase in computational power. This is mainly driven by the paradigm to perceive the entire…

Robotics · Computer Science 2023-01-27 Matti Henning , Johannes Müller , Fabian Gies , Michael Buchholz , Klaus Dietmayer

Existing data collection methods for traffic operations and control usually rely on infrastructure-based loop detectors or probe vehicle trajectories. Connected and automated vehicles (CAVs) not only can report data about themselves but…

Robotics · Computer Science 2022-08-05 Hanlin Chen , Brian Liu , Xumiao Zhang , Feng Qian , Z. Morley Mao , Yiheng Feng

Vehicle-infrastructure (V2I) cooperative perception can substantially extend the range, coverage, and robustness of autonomous driving systems beyond the limits of onboard-only sensing, particularly in occluded and adverse-weather…

End-to-end autonomous driving solutions, which directly process multimodal sensory data and output fine-grained control commands, have gradually become a mainstream direction with the development of autonomous driving technology. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Runyi Huang , Ni Ding , Ruidan Xing , Yuheng Shi , Lei He , Keqiang Li

End-to-end autonomous driving seeks to solve the perception, decision, and control problems in an integrated way, which can be easier to generalize at scale and be more adapting to new scenarios. However, high costs and risks make it very…

Machine Learning · Computer Science 2022-06-08 Sidney Bender , Tim Joseph , Marius Zoellner

Vision-Language-Action (VLA) models have emerged as a promising paradigm for end-to-end autonomous driving. However, existing reasoning mechanisms still struggle to provide planning-oriented intermediate representations: textual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Minqing Huang , Yujiao Xiang , Zihan Liang , Jiajie Huang , Jingqi Wang , Zhi Xu , Feiyang Tan , Hangning Zhou , Mu Yang , Gong Che

Roadside Collaborative Perception refers to a system where multiple roadside units collaborate to pool their perceptual data, assisting vehicles in enhancing their environmental awareness. Existing roadside perception methods concentrate on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Yuwen Du , Anning Hu , Zichen Chao , Yifan Lu , Junhao Ge , Genjia Liu , Weitao Wu , Lanjun Wang , Siheng Chen

Current autonomous driving systems are composed of a perception system and a decision system. Both of them are divided into multiple subsystems built up with lots of human heuristics. An end-to-end approach might clean up the system and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Jianyu Chen , Zhuo Xu , Masayoshi Tomizuka

Despite the unprecedented volume of multimodal data provided by modern Earth observation systems, our ability to model atmospheric dynamics remains constrained. Traditional modeling frameworks force heterogeneous measurements into…

Accurate perception and scene understanding in complex urban environments is a critical challenge for ensuring safe and efficient autonomous navigation. In this paper, we present Co-Win, a novel bird's eye view (BEV) perception framework…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Haichuan Li , Tomi Westerlund

Data-efficient learning remains a central challenge in autonomous driving due to the high cost and safety risks of large-scale real-world interaction. Although world-model-based reinforcement learning enables policy optimization through…

Robotics · Computer Science 2026-03-10 Jiazhuo Li , Linjiang Cao , Qi Liu , Xi Xiong

We propose a novel and pragmatic framework for traffic scene perception with roadside cameras. The proposed framework covers a full-stack of roadside perception pipeline for infrastructure-assisted autonomous driving, including object…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Zhengxia Zou , Rusheng Zhang , Shengyin Shen , Gaurav Pandey , Punarjay Chakravarty , Armin Parchami , Henry X. Liu