English
Related papers

Related papers: GAIA-2: A Controllable Multi-View Generative World…

200 papers

Autonomous driving promises transformative improvements to transportation, but building systems capable of safely navigating the unstructured complexity of real-world scenarios remains challenging. A critical problem lies in effectively…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Anthony Hu , Lloyd Russell , Hudson Yeo , Zak Murez , George Fedoseev , Alex Kendall , Jamie Shotton , Gianluca Corrado

Generative AI (GenAI) is rapidly advancing the field of Autonomous Driving (AD), extending beyond traditional applications in text, image, and video generation. We explore how generative models can enhance automotive tasks, such as static…

Video generation models, as one form of world models, have emerged as one of the most exciting frontiers in AI, promising agents the ability to imagine the future by modeling the temporal evolution of complex scenes. In autonomous driving,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yang Zhou , Hao Shao , Letian Wang , Zhuofan Zong , Hongsheng Li , Steven L. Waslander

Generative Artificial Intelligence (GenAI) constitutes a transformative technological wave that reconfigures industries through its unparalleled capabilities for content creation, reasoning, planning, and multimodal understanding. This…

As the automotive world moves toward higher levels of driving automation, Level 3 automated driving represents a critical juncture. In Level 3 driving, vehicles can drive alone under limited conditions, but drivers are expected to be ready…

Human-Computer Interaction · Computer Science 2024-02-19 Patrick Ebel

We introduce GAUDI, a generative model capable of capturing the distribution of complex and realistic 3D scenes that can be rendered immersively from a moving camera. We tackle this challenging problem with a scalable yet powerful approach,…

Datasets are essential for training and testing vehicle perception algorithms. However, the collection and annotation of real-world images is time-consuming and expensive. Driving simulators offer a solution by automatically generating…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Haonan Zhao , Yiting Wang , Thomas Bashford-Rogers , Valentina Donzella , Kurt Debattista

Multi-view image generation in autonomous driving demands consistent 3D scene understanding across camera views. Most existing methods treat this problem as a 2D image set generation task, lacking explicit 3D modeling. However, we argue…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zeming Chen , Hang Zhao

Recognizing the tremendous improvements that the integration of generative AI can bring to intelligent transportation systems, this article explores the integration of generative AI technologies in vehicular networks, focusing on their…

Networking and Internet Architecture · Computer Science 2023-04-24 Ruichen Zhang , Ke Xiong , Hongyang Du , Dusit Niyato , Jiawen Kang , Xuemin Shen , H. Vincent Poor

Recent advances in generative models have sparked exciting new possibilities in the field of autonomous vehicles. Specifically, video generation models are now being explored as controllable virtual testing environments. Simultaneously,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Jiahao Wang , Zhenpei Yang , Yijing Bai , Yingwei Li , Yuliang Zou , Bo Sun , Abhijit Kundu , Jose Lezama , Luna Yue Huang , Zehao Zhu , Jyh-Jing Hwang , Dragomir Anguelov , Mingxing Tan , Chiyu Max Jiang

In this paper, we introduce the first large-scale video prediction model in the autonomous driving discipline. To eliminate the restriction of high-cost data collection and empower the generalization ability of our model, we acquire massive…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Jiazhi Yang , Shenyuan Gao , Yihang Qiu , Li Chen , Tianyu Li , Bo Dai , Kashyap Chitta , Penghao Wu , Jia Zeng , Ping Luo , Jun Zhang , Andreas Geiger , Yu Qiao , Hongyang Li

Recent breakthroughs in autonomous driving have been propelled by advances in robust world modeling, fundamentally transforming how vehicles interpret dynamic scenes and execute safe decision-making. World models have emerged as a linchpin…

Robotics · Computer Science 2025-09-11 Tuo Feng , Wenguan Wang , Yi Yang

As artificial intelligence-generated content (AIGC) continues to evolve, video-to-audio (V2A) generation has emerged as a key area with promising applications in multimedia editing, augmented reality, and automated content creation. While…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Yuhuan You , Xihong Wu , Tianshu Qu

Generative AI is transforming image synthesis, enabling the creation of high-quality, diverse, and photorealistic visuals across industries like design, media, healthcare, and autonomous systems. Advances in techniques such as…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Fouad Bousetouane

Physics-aware driving world model is essential for drive planning, out-of-distribution data synthesis, and closed-loop evaluation. However, existing methods often rely on a single diffusion model to directly map driving actions to videos,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Zhenya Yang , Zhe Liu , Yuxiang Lu , Liping Hou , Chenxuan Miao , Siyi Peng , Bailan Feng , Xiang Bai , Hengshuang Zhao

Reliable anticipation of traffic accidents is essential for advancing autonomous driving systems. However, this objective is limited by two fundamental challenges: the scarcity of diverse, high-quality training data and the frequent absence…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yanchen Guan , Haicheng Liao , Chengyue Wang , Xingcheng Liu , Jiaxun Zhang , Zhenning Li

This paper aims to serve as a comprehensive guide for researchers and practitioners, offering insights into the current state, potential applications, and future research directions for generative artificial intelligence and foundation…

Artificial Intelligence · Computer Science 2023-05-30 Lukas Stappen , Jeremy Dillmann , Serena Striegel , Hans-Jörg Vögel , Nicolas Flores-Herr , Björn W. Schuller

Generative models have significantly improved the generation and prediction quality on either camera images or LiDAR point clouds for autonomous driving. However, a real-world autonomous driving system uses multiple kinds of input modality,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Zehuan Wu , Jingcheng Ni , Xiaodong Wang , Yuxin Guo , Rui Chen , Lewei Lu , Jifeng Dai , Yuwen Xiong

Modeling the 3D world from sensor data for simulation is a scalable way of developing testing and validation environments for robotic learning problems such as autonomous driving. However, manually creating or re-creating real-world-like…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Bokui Shen , Xinchen Yan , Charles R. Qi , Mahyar Najibi , Boyang Deng , Leonidas Guibas , Yin Zhou , Dragomir Anguelov

In recent years there have been remarkable breakthroughs in image-to-video generation. However, the 3D consistency and camera controllability of generated frames have remained unsolved. Recent studies have attempted to incorporate camera…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Dejia Xu , Yifan Jiang , Chen Huang , Liangchen Song , Thorsten Gernoth , Liangliang Cao , Zhangyang Wang , Hao Tang
‹ Prev 1 2 3 10 Next ›