English
Related papers

Related papers: InstaDrive: Instance-Aware Driving World Models fo…

200 papers

Generating high-fidelity, temporally consistent videos in autonomous driving scenarios faces a significant challenge, e.g. problematic maneuvers in corner cases. Despite recent video generation works are proposed to tackcle the mentioned…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Junpeng Jiang , Gangyi Hong , Lijun Zhou , Enhui Ma , Hengtong Hu , Xia Zhou , Jie Xiang , Fan Liu , Kaicheng Yu , Haiyang Sun , Kun Zhan , Peng Jia , Miao Zhang

Reliable autonomous driving relies on large-scale, well-labeled data and robust models. However, manual data collection is resource-intensive, and traditional simulation suffers from a persistent reality gap. While recent generative…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Kaicong Huang , Talha Azfar , Weisong Shi , Ruimin Ke

The Intelligent Driver Model is studied and several drawbacks with respect to driving simulators are defined. We present two modifications of the IDM. The first one gives any predefined distance to the leading vehicle in a steady state. The…

Physics and Society · Physics 2016-10-18 Valentina Kurtc , Igor Anufriev

We present an integrated approach for perception and control for an autonomous vehicle and demonstrate this approach in a high-fidelity urban driving simulator. Our approach first builds a model for the environment, then trains a policy…

Systems and Control · Electrical Eng. & Systems 2020-03-19 Ali Baheri , Ilya Kolmanovsky , Anouck Girard , H. Eric Tseng , Dimitar Filev

Generating multi-camera street-view videos is critical for augmenting autonomous driving datasets, addressing the urgent demand for extensive and varied data. Due to the limitations in diversity and challenges in handling lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Jiachen Lu , Ze Huang , Zeyu Yang , Jiahui Zhang , Li Zhang

World models, generative AI systems that simulate how environments evolve, are transforming autonomous driving, yet all existing approaches adopt an ego-vehicle perspective, leaving the infrastructure viewpoint unexplored. We argue that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Siyuan Meng , Chengbo Ai

The creation of diverse and realistic driving scenarios has become essential to enhance perception and planning capabilities of the autonomous driving system. However, generating long-duration, surround-view consistent driving videos…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Rui Chen , Zehuan Wu , Yichen Liu , Yuxin Guo , Jingcheng Ni , Haifeng Xia , Siyu Xia

Instance detection (InsDet) is a long-lasting problem in robotics and computer vision, aiming to detect object instances (predefined by some visual examples) in a cluttered scene. Despite its practical significance, its advancement is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Qianqian Shen , Yunhan Zhao , Nahyun Kwon , Jeeeun Kim , Yanan Li , Shu Kong

The landscape of video generation is shifting, from a focus on generating visually appealing clips to building virtual environments that support interaction and maintain physical plausibility. These developments point toward the emergence…

Artificial Intelligence · Computer Science 2026-02-09 Jingtong Yue , Ziqi Huang , Zhaoxi Chen , Xintao Wang , Pengfei Wan , Ziwei Liu

Accident prediction and timely preventive actions improve road safety by reducing the risk of injury to road users and minimizing property damage. Hence, they are critical components of advanced driver assistance systems (ADAS) and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Vipooshan Vipulananthan , Kumudu Mohottala , Kavindu Chinthana , Nimsara Paramulla , Charith D Chitraranjan

Embodied navigation in open, dynamic environments demands accurate foresight of how the world will evolve and how actions will unfold over time. We propose AstraNav-World, an end-to-end world model that jointly reasons about future visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Jintao Chen , Junjun Hu , Haochen Bai , Minghua Luo , Xinda Xue , Botao Ren , Chengyu Bai , Shichao Xie , Ziyi Chen , Fei Liu , Zedong Chu , Xiaolong Wu , Mu Xu , Shanghang Zhang

Testing Automated Driving Systems (ADS) in simulation with realistic driving scenarios is important for verifying their performance. However, converting real-world driving videos into simulation scenarios is a significant challenge due to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Yan Miao , Georgios Fainekos , Bardh Hoxha , Hideki Okamoto , Danil Prokhorov , Sayan Mitra

Scene understanding is essential for enhancing driver safety, generating human-centric explanations for Automated Vehicle (AV) decisions, and leveraging Artificial Intelligence (AI) for retrospective driving video analysis. This study…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Mohammed Elhenawy , Huthaifa I. Ashqar , Andry Rakotonirainy , Taqwa I. Alhadidi , Ahmed Jaber , Mohammad Abu Tami

Classification is one of the most important supervised machine learning tasks. During the training of a classification model, the training instances are fed to the model multiple times (during multiple epochs) in order to iteratively…

Machine Learning · Computer Science 2021-03-03 Michael Pühringer , Andreas Hinterreiter , Marc Streit

Diffusion models have made substantial progress in facilitating image generation and editing. As the technology matures, we see its potential in the context of driving simulations to enhance the simulated experience. In this paper, we…

Human-Computer Interaction · Computer Science 2024-10-08 Fanjun Bu , Hiroshi Yasuda

End-to-end (E2E) autonomous driving has recently attracted increasing interest in unifying Vision-Language-Action (VLA) with World Models to enhance decision-making and forward-looking imagination. However, existing methods fail to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Feiyang jia , Lin Liu , Ziying Song , Caiyan Jia , Hangjun Ye , Xiaoshuai Hao , Long Chen

Today's autonomous vehicles rely extensively on high-definition 3D maps to navigate the environment. While this approach works well when these maps are completely up-to-date, safe autonomous vehicles must be able to corroborate the map's…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Ari Seff , Jianxiong Xiao

Synthesizing high-fidelity and controllable 4D LiDAR data is crucial for creating scalable simulation environments for autonomous driving. This task is inherently challenging due to the sensor's unique spherical geometry, the temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Pei Liu , Songtao Wang , Lang Zhang , Xingyue Peng , Yuandong Lyu , Jiaxin Deng , Songxin Lu , Weiliang Ma , Xueyang Zhang , Yifei Zhan , XianPeng Lang , Jun Ma

Generative models have significantly improved the generation and prediction quality on either camera images or LiDAR point clouds for autonomous driving. However, a real-world autonomous driving system uses multiple kinds of input modality,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Zehuan Wu , Jingcheng Ni , Xiaodong Wang , Yuxin Guo , Rui Chen , Lewei Lu , Jifeng Dai , Yuwen Xiong

As an essential component of autonomous driving systems, high-definition (HD) maps provide rich and precise environmental information for auto-driving scenarios; however, existing methods, which primarily rely on query-based detection…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Jing Yang , Sen Yang , Xiao Tan , Hanli Wang