English
Related papers

Related papers: VectorWorld: Efficient Streaming World Model via D…

200 papers

Evaluating the performance of autonomous vehicle planning algorithms necessitates simulating long-tail safety-critical traffic scenarios. However, traditional methods for generating such scenarios often fall short in terms of…

Robotics · Computer Science 2024-08-08 Wei-Jer Chang , Francesco Pittaluga , Masayoshi Tomizuka , Wei Zhan , Manmohan Chandraker

World models serve as essential building blocks toward Artificial General Intelligence (AGI), enabling intelligent agents to predict future states and plan actions by simulating complex physical interactions. However, existing interactive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Junyi Chen , Haoyi Zhu , Xianglong He , Yifan Wang , Jianjun Zhou , Wenzheng Chang , Yang Zhou , Zizun Li , Zhoujie Fu , Jiangmiao Pang , Tong He

Real-world data visualization (DV) requires native environmental grounding, cross-platform evolution, and proactive intent alignment. Yet, existing benchmarks often suffer from code-sandbox confinement, single-language creation-only tasks,…

Anticipating diverse future states is a central challenge in video world modeling. Discriminative world models produce a deterministic prediction that implicitly averages over possible futures, while existing generative world models remain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Tommie Kerssies , Gabriele Berton , Ju He , Qihang Yu , Wufei Ma , Daan de Geus , Gijs Dubbelman , Liang-Chieh Chen

Autonomous driving evaluation requires simulation environments that closely replicate actual road conditions, including real-world sensory data and responsive feedback loops. However, many existing simulations need to predict waypoints…

Robotics · Computer Science 2024-11-19 Tianyi Yan , Dongming Wu , Wencheng Han , Junpeng Jiang , Xia Zhou , Kun Zhan , Cheng-zhong Xu , Jianbing Shen

Diffusion-based world models have demonstrated strong capabilities in synthesizing realistic long-horizon trajectories for offline reinforcement learning (RL). However, many existing methods do not directly generate actions alongside states…

Machine Learning · Computer Science 2026-05-14 Zongyue Li , Xiao Han , Yusong Li , Niklas Strauss , Matthias Schubert

Video generative models pre-trained on large-scale internet datasets have achieved remarkable success, excelling at producing realistic synthetic videos. However, they often generate clips based on static prompts (e.g., text or images),…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Haoran He , Yang Zhang , Liang Lin , Zhongwen Xu , Ling Pan

Safety-critical corner cases, difficult to collect in the real world, are crucial for evaluating end-to-end autonomous driving. Adversarial interaction is an effective method to generate such safety-critical corner cases. While existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jiaheng Geng , Jiatong Du , Xinyu Zhang , Ye Li , Panqu Wang , Yanjun Huang

The advancement of autonomous driving technologies necessitates increasingly sophisticated methods for understanding and predicting real-world scenarios. Vision language models (VLMs) are emerging as revolutionary tools with significant…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Yongjie Fu , Anmol Jain , Xuan Di , Xu Chen , Zhaobin Mo

Recently, world models have made significant progress in enhancing end-to-end driving systems through both future situation forecasting and improved scene understanding. However, existing driving world models are typically built upon dense…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Ruoyu Wang , Jingke Wang , Yukai Ma , Yuehao Huang , Shuangming Lei , Guanglin Xu , Aixue Ye , Yong Liu

Vector graphics, known for their scalability and user-friendliness, provide a unique approach to visual content compared to traditional pixel-based images. Animation of these graphics, driven by the motion of their elements, offers enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Wenshuo Gao , Xicheng Lan , Luyao Zhang , Shuai Yang

Traditional methods for autonomous driving are implemented with many building blocks from perception, planning and control, making them difficult to generalize to varied scenarios due to complex assumptions and interdependencies. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Peide Cai , Yuxiang Sun , Hengli Wang , Ming Liu

The goal of traffic simulation is to augment a potentially limited amount of manually-driven miles that is available for testing and validation, with a much larger amount of simulated synthetic miles. The culmination of this vision would be…

Recent advances in driving-scene generation and reconstruction have demonstrated significant potential for enhancing autonomous driving systems by producing scalable and controllable training data. Existing generation methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Ziyue Zhu , Zhanqian Wu , Zhenxin Zhu , Lijun Zhou , Haiyang Sun , Bing Wan , Kun Ma , Guang Chen , Hangjun Ye , Jin Xie , jian Yang

We present a flow-matching planner for autonomous driving that directly outputs actionable control trajectories defined by acceleration and curvature profiles. The model is conditioned on a bird's-eye-view (BEV) raster of the surrounding…

Autoregressive video diffusion models are capable of long rollouts that are stable and consistent with history, but they are unable to guide the current generation with conditioning from the future. In camera-guided video generation with a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Chonghyuk Song , Michal Stary , Boyuan Chen , George Kopanas , Vincent Sitzmann

With the increasing availability of open-source robotic data, imitation learning has become a promising approach for both manipulation and locomotion. Diffusion models are now widely used to train large, generalized policies that predict…

Machine Learning · Computer Science 2025-12-15 Shashank Hegde , Satyajeet Das , Gautam Salhotra , Gaurav S. Sukhatme

Accurate modeling and simulation of mobile networks are essential for enabling intelligent and cost-effective network optimization. In this paper, we propose MobiWorld, a generative world model designed to support high-fidelity and flexible…

Networking and Internet Architecture · Computer Science 2025-07-15 Haoye Chai , Yuan Yuan , Yong Li

Vision-language models (VLMs) could power real-time assistants and autonomous agents, but they face a critical challenge: understanding near-infinite video streams without escalating latency and memory usage. Processing entire videos with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Ruyi Xu , Guangxuan Xiao , Yukang Chen , Liuning He , Kelly Peng , Yao Lu , Song Han

End-to-end autonomous driving aims to generate safe and plausible planning policies from raw sensor input. Driving world models have shown great potential in learning rich representations by predicting the future evolution of a driving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xingtai Gui , Meijie Zhang , Tianyi Yan , Wencheng Han , Jiahao Gong , Feiyang Tan , Cheng-zhong Xu , Jianbing Shen
‹ Prev 1 4 5 6 7 8 10 Next ›