中文
相关论文

相关论文: UniFuture: A 4D Driving World Model for Future Gen…

200 篇论文

Autonomous driving requires rich contextual comprehension and precise predictive reasoning to navigate dynamic and complex environments safely. Vision-Language Models (VLMs) and Driving World Models (DWMs) have independently emerged as…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Jingyu Li , Bozhou Zhang , Xin Jin , Jiankang Deng , Xiatian Zhu , Li Zhang

We introduce LivingWorld, an interactive framework for generating 4D worlds with environmental dynamics from a single image. While recent advances in 3D scene generation enable large-scale environment creation, most approaches focus…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Hyeongju Mun , In-Hwan Jin , Sohyeong Kim , Kyeongbo Kong

The Driving World Model (DWM), which focuses on predicting scene evolution during the driving process, has emerged as a promising paradigm in the pursuit of autonomous driving (AD). DWMs enable AD systems to better perceive, understand, and…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Sifan Tu , Xin Zhou , Dingkang Liang , Xingyu Jiang , Yumeng Zhang , Xiaofan Li , Xiang Bai

How should representations from complementary sensors be integrated for autonomous driving? Geometry-based sensor fusion has shown great promise for perception tasks such as object detection and motion forecasting. However, for the actual…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Aditya Prakash , Kashyap Chitta , Andreas Geiger

We present InfiniCube, a scalable method for generating unbounded dynamic 3D driving scenes with high fidelity and controllability. Previous methods for scene generation either suffer from limited scales or lack geometric and appearance…

计算机视觉与模式识别 · 计算机科学 2025-06-27 Yifan Lu , Xuanchi Ren , Jiawei Yang , Tianchang Shen , Zhangjie Wu , Jun Gao , Yue Wang , Siheng Chen , Mike Chen , Sanja Fidler , Jiahui Huang

The field of 4D world modeling - aiming to jointly capture spatial geometry and temporal dynamics - has witnessed remarkable progress in recent years, driven by advances in large-scale generative models and multimodal learning. However, the…

Recent advances in driving-scene generation and reconstruction have demonstrated significant potential for enhancing autonomous driving systems by producing scalable and controllable training data. Existing generation methods primarily…

计算机视觉与模式识别 · 计算机科学 2025-10-17 Ziyue Zhu , Zhanqian Wu , Zhenxin Zhu , Lijun Zhou , Haiyang Sun , Bing Wan , Kun Ma , Guang Chen , Hangjun Ye , Jin Xie , jian Yang

World model-based searching and planning are widely recognized as a promising path toward human-level physical intelligence. However, current driving world models primarily rely on video diffusion models, which specialize in visual…

计算机视觉与模式识别 · 计算机科学 2024-12-25 Yuntao Chen , Yuqi Wang , Zhaoxiang Zhang

World models, generative AI systems that simulate how environments evolve, are transforming autonomous driving, yet all existing approaches adopt an ego-vehicle perspective, leaving the infrastructure viewpoint unexplored. We argue that…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Siyuan Meng , Chengbo Ai

We introduce Uni4D, a unified framework for large scale open vocabulary 3D retrieval and controlled 4D generation based on structured three level alignment across text, 3D models, and image modalities. Built upon the Align3D 130 dataset,…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Philip Xu

We propose 4DGT, a 4D Gaussian-based Transformer model for dynamic scene reconstruction, trained entirely on real-world monocular posed videos. Using 4D Gaussian as an inductive bias, 4DGT unifies static and dynamic components, enabling the…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Zhen Xu , Zhengqin Li , Zhao Dong , Xiaowei Zhou , Richard Newcombe , Zhaoyang Lv

Vision-centric autonomous driving has recently raised wide attention due to its lower cost. Pre-training is essential for extracting a universal representation. However, current vision-centric pre-training typically relies on either 2D or…

计算机视觉与模式识别 · 计算机科学 2024-05-08 Chen Min , Dawei Zhao , Liang Xiao , Jian Zhao , Xinli Xu , Zheng Zhu , Lei Jin , Jianshu Li , Yulan Guo , Junliang Xing , Liping Jing , Yiming Nie , Bin Dai

Real-time, high-fidelity reconstruction of dynamic driving scenes is challenged by complex dynamics and sparse views, with prior methods struggling to balance quality and efficiency. We propose DrivingScene, an online, feed-forward…

计算机视觉与模式识别 · 计算机科学 2025-10-30 Qirui Hou , Wenzhang Sun , Chang Zeng , Chunfeng Wang , Hao Li , Jianxun Cui

Although multi-modal large language models (MLLMs) have shown strong capabilities across diverse domains, their application in generating fine-grained 3D perception and prediction outputs in autonomous driving remains underexplored. In this…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Zhe Liu , Runhui Huang , Rui Yang , Siming Yan , Zining Wang , Lu Hou , Di Lin , Xiang Bai , Hengshuang Zhao

Notable breakthroughs in unified understanding and generation modeling have led to remarkable advancements in image understanding, reasoning, production and editing, yet current foundational models predominantly focus on processing images,…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Zhiyu Tan , Hao Yang , Luozheng Qin , Jia Gong , Mengping Yang , Hao Li

Human mobility prediction is vital for urban planning, transportation optimization, and personalized services. However, the inherent randomness, non-uniform time intervals, and complex patterns of human mobility, compounded by the…

机器学习 · 计算机科学 2025-11-11 Chonghua Han , Yuan Yuan , Yukun Liu , Jingtao Ding , Jie Feng , Yong Li

With the growing interest in autonomous driving, there is an increasing demand for accurate and reliable road perception technologies. In complex environments without high-definition map support, autonomous vehicles must independently…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Xuewei Tang , Mengmeng Yang , Tuopu Wen , Peijin Jia , Le Cui , Mingshang Luo , Kehua Sheng , Bo Zhang , Diange Yang , Kun Jiang

The domain gap between remote sensing imagery and natural images has recently received widespread attention and Vision-Language Models (VLMs) have demonstrated excellent generalization performance in remote sensing multimodal tasks.…

计算机视觉与模式识别 · 计算机科学 2024-12-31 Yujie Li , Wenjia Xu , Guangzuo Li , Zijian Yu , Zhiwei Wei , Jiuniu Wang , Mugen Peng

The advancement of 4D (i.e., sequential 3D) generation opens up new possibilities for lifelike experiences in various applications, where users can explore dynamic objects or characters from any viewpoint. Meanwhile, video generative models…

图形学 · 计算机科学 2025-04-08 Yikai Wang , Guangce Liu , Xinzhou Wang , Zilong Chen , Jiafang Li , Xin Liang , Fuchun Sun , Jun Zhu

We present UniQueR, a unified query-based feedforward framework for efficient and accurate 3D reconstruction from unposed images. Existing feedforward models such as DUSt3R, VGGT, and AnySplat typically predict per-pixel point maps or…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Chensheng Peng , Quentin Herau , Jiezhi Yang , Yichen Xie , Yihan Hu , Wenzhao Zheng , Matthew Strong , Masayoshi Tomizuka , Wei Zhan