中文
相关论文

相关论文: DriveDreamer4D: World Models Are Effective Data Ma…

200 篇论文

Robotic world models are a promising paradigm for forecasting future environment states, yet their inference speed and the physical plausibility of generated trajectories remain critical bottlenecks, limiting their real-world applications.…

机器人学 · 计算机科学 2025-09-26 Sibo Li , Qianyue Hao , Yu Shang , Yong Li

Driving simulators play a large role in developing and testing new intelligent vehicle systems. The visual fidelity of the simulation is critical for building vision-based algorithms and conducting human driver experiments. Low visual…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Ekim Yurtsever , Dongfang Yang , Ibrahim Mert Koc , Keith A. Redmill

Data scaling is fundamental to modern deep learning, and grows increasingly critical as autonomous driving shifts to end-to-end learning. Real-world driving data is expensive to annotate and scene-biased, making real-synthetic co-training…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Hongzhi Ruan , Pei Liu , Weiliang Ma , Zhengning Li , Xueyang Zhang , Jun Ma , Dan Xu , Kun Zhan

Wheeled robots have gained significant attention due to their wide range of applications in manufacturing, logistics, and service industries. However, due to the difficulty of building a highly accurate dynamics model for wheeled robots,…

机器人学 · 计算机科学 2024-11-15 Yunfeng Lin , Minghuan Liu , Yong Yu

We propose DriveAnyMesh, a method for driving mesh guided by monocular video. Current 4D generation techniques encounter challenges with modern rendering engines. Implicit methods have low rendering efficiency and are unfriendly to…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Yahao Shi , Yang Liu , Yanmin Wu , Xing Liu , Chen Zhao , Jie Luo , Bin Zhou

World models significantly enhance hierarchical understanding, improving data integration and learning efficiency. To explore the potential of the world model in the remote sensing (RS) field, this paper proposes a label-efficient remote…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Jinping Wang , Weiwei Song , Hao Chen , Jinchang Ren , Huimin Zhao

A critical bottleneck in deep reinforcement learning (DRL) is sample inefficiency, as training high-performance agents often demands extensive environmental interactions. Model-based reinforcement learning (MBRL) mitigates this by building…

机器学习 · 计算机科学 2025-09-30 Boxuan Zhang , Runqing Wang , Wei Xiao , Weipu Zhang , Jian Sun , Gao Huang , Jie Chen , Gang Wang

High-fidelity visual reconstruction and novel-view synthesis are essential for realistic closed-loop evaluation in autonomous driving. While 4D Gaussian Splatting (4DGS) offers a promising balance of accuracy and efficiency, existing…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Haibao Yu , Kuntao Xiao , Jiahang Wang , Ruiyang Hao , Yuxin Huang , Guoran Hu , Haifang Qin , Bowen Jing , Yuntian Bo , Ping Luo

Modeling the 3D world from sensor data for simulation is a scalable way of developing testing and validation environments for robotic learning problems such as autonomous driving. However, manually creating or re-creating real-world-like…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Bokui Shen , Xinchen Yan , Charles R. Qi , Mahyar Najibi , Boyang Deng , Leonidas Guibas , Yin Zhou , Dragomir Anguelov

Building world models with spatial consistency and real-time interactivity remains a fundamental challenge in computer vision. Current video generation paradigms often struggle with a lack of spatial persistence and insufficient visual…

Video generation models have emerged as high-fidelity models of the physical world, capable of synthesizing high-quality videos capturing fine-grained interactions between agents and their environments conditioned on multi-modal user…

World models that support controllable and editable spatiotemporal environments are valuable for robotics, enabling scalable training data, repro ducible evaluation, and flexible task design. While recent text-to-video models generate…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Xuehai He , Shijie Zhou , Thivyanth Venkateswaran , Kaizhi Zheng , Ziyu Wan , Achuta Kadambi , Xin Eric Wang

The rapid evolution of video generation has enabled models to simulate complex physical dynamics and long-horizon causalities, positioning them as potential world simulators. However, a critical gap still remains between the theoretical…

图像与视频处理 · 电气工程与系统科学 2026-05-06 Muyang He , Hanzhong Guo , Junxiong Lin , Yizhou Yu

World models, which predict future transitions from past observation and action sequences, have shown great promise for improving data efficiency in sequential decision-making. However, existing world models often require extensive…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Siqiao Huang , Jialong Wu , Qixing Zhou , Shangchen Miao , Mingsheng Long

We propose the use of latent space generative world models to address the covariate shift problem in autonomous driving. A world model is a neural network capable of predicting an agent's next state given past states and actions. By…

The field of 4D world modeling - aiming to jointly capture spatial geometry and temporal dynamics - has witnessed remarkable progress in recent years, driven by advances in large-scale generative models and multimodal learning. However, the…

This paper presents DriveTrack, a new benchmark and data generation framework for long-range keypoint tracking in real-world videos. DriveTrack is motivated by the observation that the accuracy of state-of-the-art trackers depends strongly…

计算机视觉与模式识别 · 计算机科学 2023-12-18 Arjun Balasingam , Joseph Chandler , Chenning Li , Zhoutong Zhang , Hari Balakrishnan

An accurate vehicle dynamic model is the key to bridge the gap between simulation and real road test in autonomous driving. In this paper, we present a Dynamic model-Residual correction model Framework (DRF) for vehicle dynamic modeling. On…

机器人学 · 计算机科学 2020-11-03 Shu Jiang , Yu Wang , Longtao Lin , Weiman Lin , Yu Cao , Jinghao Miao , Qi Luo

With deep learning and computer vision technology development, autonomous driving provides new solutions to improve traffic safety and efficiency. The importance of building high-quality datasets is self-evident, especially with the rise of…

Perception sensors, particularly camera and Lidar, are key elements of Autonomous Driving Systems (ADS) that enable them to comprehend their surroundings to informed driving and control decisions. Therefore, developing realistic simulation…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Hamed Haghighi , Xiaomeng Wang , Hao Jing , Mehrdad Dianati