English
Related papers

Related papers: V2XCrafter: Learning to Generate Driving Scene Acr…

200 papers

Multi-agent trajectory prediction is a fundamental problem in autonomous driving. The key challenges in prediction are accurately anticipating the behavior of surrounding agents and understanding the scene context. To address these…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Elmira Amirloo , Amir Rasouli , Peter Lakner , Mohsen Rohani , Jun Luo

Vehicle-to-everything (V2X) cooperation has emerged as a promising paradigm to overcome the perception limitations of classical autonomous driving by leveraging information from both ego-vehicle and infrastructure sensors. However,…

Robotics · Computer Science 2025-06-23 Junwei You , Haotian Shi , Zhuoyu Jiang , Zilin Huang , Rui Gan , Keshu Wu , Xi Cheng , Xiaopeng Li , Bin Ran

Modern perception systems of autonomous vehicles are known to be sensitive to occlusions and lack the capability of long perceiving range. It has been one of the key bottlenecks that prevents Level 5 autonomy. Recent research has…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Runsheng Xu , Xin Xia , Jinlong Li , Hanzhao Li , Shuo Zhang , Zhengzhong Tu , Zonglin Meng , Hao Xiang , Xiaoyu Dong , Rui Song , Hongkai Yu , Bolei Zhou , Jiaqi Ma

This paper presents ShareVerse, a video generation framework enabling multi-agent shared world modeling, addressing the gap in existing works that lack support for unified shared world construction with multi-agent interaction. ShareVerse…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Jiayi Zhu , Jianing Zhang , Yiying Yang , Wei Cheng , Xiaoyun Yuan

Achieving fully autonomous driving with enhanced safety and efficiency relies on vehicle-to-everything cooperative perception, which enables vehicles to share perception data, thereby enhancing situational awareness and overcoming the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Tao Huang , Jianan Liu , Xi Zhou , Dinh C. Nguyen , Mostafa Rahimi Azghadi , Yuxuan Xia , Qing-Long Han , Sumei Sun

With the increasing popularity of autonomous driving based on the powerful and unified bird's-eye-view (BEV) representation, a demand for high-quality and large-scale multi-view video data with accurate annotation is urgently required.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Xiaofan Li , Yifu Zhang , Xiaoqing Ye

Recent progress in video-to-video (V2V) translation has enabled realistic resimulation of embodied AI demonstrations, a capability that allows pretrained robot policies to be transferable to new environments without additional data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 George Eskandar , Fengyi Shen , Mohammad Altillawi , Dong Chen , Yang Bai , Liudi Yang , Ziyuan Liu

Learned communication makes multi-agent systems more effective by aggregating distributed information. However, it also exposes individual agents to the threat of erroneous messages they might receive. In this paper, we study the setting…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Nicholas Vadivelu , Mengye Ren , James Tu , Jingkang Wang , Raquel Urtasun

Collaborative perception allows connected and autonomous vehicles (CAVs) to improve perception by sharing sensory data, but it also introduces security risks from manipulated inputs. Prior work shows that attackers can spoof or remove…

Cryptography and Security · Computer Science 2026-05-05 Qingzhao Zhang , Runting Zhang , Z. Morley Mao

Generating 3D scenes from human motion sequences supports numerous applications, including virtual reality and architectural design. However, previous auto-regression-based human-aware 3D scene generation methods have struggled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xiaolin Hong , Hongwei Yi , Fazhi He , Qiong Cao

Recent advances in video diffusion models shows promise for generating robotic decision-making data, with trajectory conditions further enabling fine-grained control. However, existing methods primarily focus on individual object motion and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Xiao Fu , Xintao Wang , Xian Liu , Jianhong Bai , Runsen Xu , Pengfei Wan , Di Zhang , Dahua Lin

Realistic driving simulation requires that NPCs not only mimic natural driving behaviors but also react to the behavior of other simulated agents. Recent developments in diffusion-based scenario generation focus on creating diverse and…

Machine Learning · Computer Science 2025-02-14 Yunpeng Liu , Matthew Niedoba , William Harvey , Adam Scibior , Berend Zwartsenberg , Frank Wood

Predicting future trajectories of surrounding traffic agents is critical for safe autonomous navigation and collision avoidance. Despite all advances in the trajectory forecasting realm, the prediction models remains vulnerable to…

Multi-agent collaboration enhances the perception capabilities of individual agents through information sharing. However, in real-world applications, differences in sensors and models across heterogeneous agents inevitably lead to domain…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Junfei Zhou , Penglin Dai , Quanmin Wei , Bingyi Liu , Xiao Wu , Jianping Wang

Accurate trajectory prediction is fundamental to autonomous driving, as it underpins safe motion planning and collision avoidance in complex environments. However, existing benchmark datasets suffer from a pronounced long-tail distribution…

Robotics · Computer Science 2025-10-06 Ruining Yang , Yi Xu , Yixiao Chen , Yun Fu , Lili Su

The objective of the collaborative vehicle-to-everything perception task is to enhance the individual vehicle's perception capability through message communication among neighboring traffic agents. Previous methods focus on achieving…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Si Liu , Zihan Ding , Jiahui Fu , Hongyu Li , Siheng Chen , Shifeng Zhang , Xu Zhou

Research on video generation has recently made tremendous progress, enabling high-quality videos to be generated from text prompts or images. Adding control to the video generation process is an important goal moving forward and recent…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Zhengfei Kuang , Shengqu Cai , Hao He , Yinghao Xu , Hongsheng Li , Leonidas Guibas , Gordon Wetzstein

Reliable anticipation of traffic accidents is essential for advancing autonomous driving systems. However, this objective is limited by two fundamental challenges: the scarcity of diverse, high-quality training data and the frequent absence…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yanchen Guan , Haicheng Liao , Chengyue Wang , Xingcheng Liu , Jiaxun Zhang , Zhenning Li

Multi-agent learning provides a potential framework for learning and simulating traffic behaviors. This paper proposes a novel architecture to learn multiple driving behaviors in a traffic scenario. The proposed architecture can learn…

Machine Learning · Computer Science 2018-11-20 Meha Kaushik , Phaniteja S , K. Madhava Krishna

Vehicle-to-everything-aided autonomous driving (V2X-AD) has a huge potential to provide a safer driving solution. Despite extensive researches in transportation and communication to support V2X-AD, the actual utilization of these…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Genjia Liu , Yue Hu , Chenxin Xu , Weibo Mao , Junhao Ge , Zhengxiang Huang , Yifan Lu , Yinda Xu , Junkai Xia , Yafei Wang , Siheng Chen