English
Related papers

Related papers: HorizonDrive: Self-Corrective Autoregressive World…

200 papers

Existing robot video world models are typically trained with low-level objectives such as reconstruction and perceptual similarity, which are poorly aligned with the capabilities that matter most for robot decision making, including…

This paper presents DriVerse, a generative model for simulating navigation-driven driving scenes from a single image and a future trajectory. Previous autonomous driving world models either directly feed the trajectory or discrete control…

Robotics · Computer Science 2026-04-28 Xiaofan Li , Chenming Wu , Zhao Yang , Zhihao Xu , Dingkang Liang , Yumeng Zhang , Ji Wan , Jun Wang

Autonomous driving and its widespread adoption have long held tremendous promise. Nevertheless, without a trustworthy and thorough testing procedure, not only does the industry struggle to mass-produce autonomous vehicles (AV), but neither…

Machine Learning · Computer Science 2023-06-13 Haoyi Niu , Kun Ren , Yizhou Xu , Ziyuan Yang , Yichen Lin , Yi Zhang , Jianming Hu

Realistic and controllable simulation is critical for advancing end-to-end autonomous driving, yet existing approaches often struggle to support novel view synthesis under large viewpoint changes or to ensure geometric consistency. We…

Action-conditioned robot world models generate future video frames of the manipulated scene given a robot action sequence, offering a promising alternative for simulating tasks that are difficult to model with traditional physics engines.…

Robotics · Computer Science 2026-03-27 Jai Bardhan , Patrik Drozdik , Josef Sivic , Vladimir Petrik

End-to-end autonomous driving has been recently seen rapid development, exerting a profound influence on both industry and academia. However, the existing work places excessive focus on ego-vehicle status as their sole learning objectives…

Robotics · Computer Science 2025-08-08 Rui Yu , Xianghang Zhang , Runkai Zhao , Huaicheng Yan , Meng Wang

Driving world models are used to simulate futures by video generation based on the condition of the current state and actions. However, current models often suffer serious error accumulations when predicting the long-term future, which…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Xiaodong Wang , Zhirong Wu , Peixi Peng

The long-tail distribution of real driving data poses challenges for training and testing autonomous vehicles (AV), where rare yet crucial safety-critical scenarios are infrequent. And virtual simulation offers a low-cost and efficient…

Robotics · Computer Science 2024-06-07 Ziyuan Yang , Zhaoyang Li , Jianming Hu , Yi Zhang

Traditional continual learning methods prioritize knowledge retention and focus primarily on mitigating catastrophic forgetting, implicitly assuming that the data distribution of previously learned tasks remains static. This overlooks the…

Machine Learning · Computer Science 2026-02-16 Alif Ashrafee , Jedrzej Kozal , Michal Wozniak , Bartosz Krawczyk

Reinforcement learning for training end-to-end autonomous driving models in closed-loop simulations is gaining growing attention. However, most simulation environments differ significantly from real-world conditions, creating a substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Chaojun Ni , Guosheng Zhao , Xiaofeng Wang , Zheng Zhu , Wenkang Qin , Xinze Chen , Guanghong Jia , Guan Huang , Wenjun Mei

Existing neural solvers for vehicle routing problems (VRPs) are typically trained either in a one-off manner on a fixed set of pre-defined tasks or in a lifelong manner with tasks arriving sequentially, assuming sufficient training on each…

Machine Learning · Computer Science 2026-05-08 Jiyuan Pei , Yi Mei , Jialin Liu , Mengjie Zhang , Xin Yao

Autoregressive (AR) diffusion enables streaming, interactive long-video generation by producing frames causally, yet maintaining coherence over minute-scale horizons remains challenging due to accumulated errors, motion drift, and content…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Yifei Yu , Xiaoshan Wu , Xinting Hu , Tao Hu , Yangtian Sun , Xiaoyang Lyu , Bo Wang , Lin Ma , Yuewen Ma , Zhongrui Wang , Xiaojuan Qi

Recent years have seen remarkable progress in autonomous driving, yet generalization to long-tail and open-world scenarios remains a major bottleneck for large-scale deployment. To address this challenge, some works use LLMs and VLMs for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Hao Shao , Letian Wang , Yang Zhou , Yuxuan Hu , Zhuofan Zong , Steven L. Waslander , Wei Zhan , Hongsheng Li

Multi-horizon time series forecasting, crucial across diverse domains, demands high accuracy and speed. While AutoRegressive (AR) models excel in short-term predictions, they suffer speed and error issues as the horizon extends.…

Machine Learning · Computer Science 2024-08-09 Yang Lin

Autonomous driving systems require comprehensive evaluation in safety-critical scenarios to ensure safety and robustness. However, such scenarios are rare and difficult to collect from real-world driving data, necessitating simulation-based…

Artificial Intelligence · Computer Science 2026-03-04 Zhulin Jiang , Zetao Li , Cheng Wang , Ziwen Wang , Chen Xiong

Recent successes in autoregressive (AR) generation models, such as the GPT series in natural language processing, have motivated efforts to replicate this success in visual tasks. Some works attempt to extend this approach to autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Xiaotao Hu , Wei Yin , Mingkai Jia , Junyuan Deng , Xiaoyang Guo , Qian Zhang , Xiaoxiao Long , Ping Tan

Although Deep Reinforcement Learning (DRL) and Large Language Models (LLMs) each show promise in addressing decision-making challenges in autonomous driving, DRL often suffers from high sample complexity, while LLMs have difficulty ensuring…

Artificial Intelligence · Computer Science 2025-02-21 Chengkai Xu , Jiaqi Liu , Shiyu Fang , Yiming Cui , Dong Chen , Peng Hang , Jian Sun

Online High-Definition (HD) map construction is pivotal for autonomous driving. While recent approaches leverage historical temporal fusion to improve performance, we identify a critical safety flaw in this paradigm: it is inherently…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ruikai Li , Xinrun Li , Mengwei Xie , Hao Shan , Shoumeng Qiu , Xinyuan Chang , Yizhe Fan , Feng Xiong , Han Jiang , Yilong Ren , Haiyang Yu , Mu Xu , Yang Long , Varun Ojha , Zhiyong Cui

End-to-end autonomous driving has witnessed rapid progress, yet existing benchmarks are increasingly saturated, with state-of-the-art models achieving near-perfect scores on widely used open-loop and closed-loop benchmarks. This saturation…

Robotics · Computer Science 2026-05-12 Zhongyu Xia , Guanyu Zhu , Guo Tang , Wenhao Chen , Yongtao Wang

Long-context video modeling is essential for enabling generative models to function as world simulators, as they must maintain temporal coherence over extended time spans. However, most existing models are trained on short clips, limiting…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yuchao Gu , Weijia Mao , Mike Zheng Shou