English
Related papers

Related papers: KiGRAS: Kinematic-Driven Generative Model for Real…

200 papers

Modeling realistic and interactive multi-agent behavior is critical to autonomous driving and traffic simulation. However, existing diffusion and autoregressive approaches are limited by iterative sampling, sequential decoding, or…

Robotics · Computer Science 2025-11-24 Zhiyu Huang , Zewei Zhou , Tianhui Cai , Yun Zhang , Jiaqi Ma

We develop a deep generative model built on a fully differentiable simulator for multi-agent trajectory prediction. Agents are modeled with conditional recurrent variational neural networks (CVRNNs), which take as input an ego-centric…

Machine Learning · Statistics 2021-04-23 Adam Scibior , Vasileios Lioutas , Daniele Reda , Peyman Bateni , Frank Wood

Trajectory generation for mobile robots in unstructured environments faces a critical dilemma: balancing kinematic smoothness for safe execution with terminal precision for fine-grained tasks. Existing generative planners often struggle…

Robotics · Computer Science 2026-03-03 Jinyang Zhao , Handong Zheng , Yanjiu Zhong , Qiang Zhang , Yu Kang , Shunyu Wu

We propose the use of latent space generative world models to address the covariate shift problem in autonomous driving. A world model is a neural network capable of predicting an agent's next state given past states and actions. By…

Evaluating the decision-making system is indispensable in developing autonomous vehicles, while realistic and challenging safety-critical test scenarios play a crucial role. Obtaining these scenarios is non-trivial, thanks to the…

Robotics · Computer Science 2024-08-08 Kunkun Hao , Yonggang Luo , Wen Cui , Yuqiao Bai , Jucheng Yang , Songyang Yan , Yuxi Pan , Zijiang Yang

Simulating the human mobility and generating large-scale trajectories are of great use in many real-world applications, such as urban planning, epidemic spreading analysis, and geographic privacy protect. Although many previous works have…

Machine Learning · Computer Science 2023-01-19 Wenjun Jiang , Wayne Xin Zhao , Jingyuan Wang , Jiawei Jiang

Effective understanding of the environment and accurate trajectory prediction of surrounding dynamic obstacles are critical for intelligent systems such as autonomous vehicles and wheeled mobile robotics navigating in complex scenarios to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Jiachen Li , Hengbo Ma , Masayoshi Tomizuka

Generative models in Autonomous Driving (AD) enable diverse scene creation, yet existing methods fall short by only capturing a limited range of modalities, restricting the capability of generating controllable scenes for comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yanhao Wu , Haoyang Zhang , Tianwei Lin , Lichao Huang , Shujie Luo , Rui Wu , Congpei Qiu , Wei Ke , Tong Zhang

4D driving simulation is essential for developing realistic autonomous driving simulators. Despite advancements in existing methods for generating driving scenes, significant challenges remain in view transformation and spatial-temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Lening Wang , Wenzhao Zheng , Dalong Du , Yunpeng Zhang , Yilong Ren , Han Jiang , Zhiyong Cui , Haiyang Yu , Jie Zhou , Jiwen Lu , Shanghang Zhang

Motion behaviour is driven by several factors -- goals, presence and actions of neighbouring agents, social relations, physical and social norms, the environment with its variable characteristics, and further. Most factors are not directly…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Sahib Julka , Vishal Sowrirajan , Joerg Schloetterer , Michael Granitzer

Simulation is a crucial component of any robotic system. In order to simulate correctly, we need to write complex rules of the environment: how dynamic agents behave, and how the actions of each of the agents affect the behavior of others.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Seung Wook Kim , Yuhao Zhou , Jonah Philion , Antonio Torralba , Sanja Fidler

Video generation models, as one form of world models, have emerged as one of the most exciting frontiers in AI, promising agents the ability to imagine the future by modeling the temporal evolution of complex scenes. In autonomous driving,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yang Zhou , Hao Shao , Letian Wang , Zhuofan Zong , Hongsheng Li , Steven L. Waslander

Simulation plays a crucial role in the development of autonomous vehicles (AVs) due to the potential risks associated with real-world testing. Although significant progress has been made in the visual aspects of simulators, generating…

Machine Learning · Computer Science 2024-08-14 Wenhao Ding , Yulong Cao , Ding Zhao , Chaowei Xiao , Marco Pavone

Video generation models have shown strong potential as world models for autonomous driving simulation. However, existing approaches are primarily trained on real-world driving datasets, which mostly contain natural and safe driving…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Jiawei Zhou , Zhenxin Zhu , Lingyi Du , Linye Lyu , Lijun Zhou , Zhanqian Wu , Hongcheng Luo , Zhuotao Tian , Bing Wang , Guang Chen , Hangjun Ye , Haiyang Sun , Yu Li

We consider the problem of generating realistic traffic scenes automatically. Existing methods typically insert actors into the scene according to a set of hand-crafted heuristics and are limited in their ability to model the true…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Shuhan Tan , Kelvin Wong , Shenlong Wang , Sivabalan Manivasagam , Mengye Ren , Raquel Urtasun

The automated generation of diverse and complex training scenarios has been an important ingredient in many complex learning tasks. Especially in real-world application domains, such as autonomous driving, auto-curriculum generation is…

Robotics · Computer Science 2025-02-07 Axel Brunnbauer , Luigi Berducci , Peter Priller , Dejan Nickovic , Radu Grosu

Data-efficient learning remains a central challenge in autonomous driving due to the high cost and safety risks of large-scale real-world interaction. Although world-model-based reinforcement learning enables policy optimization through…

Robotics · Computer Science 2026-03-10 Jiazhuo Li , Linjiang Cao , Qi Liu , Xi Xiong

Trajectory generation for visually impaired scenarios requires smooth and temporally consistent state in structured, low-speed dynamic environments. However, traditional jerk-based heuristic trajectory sampling with independent segment…

Robotics · Computer Science 2026-02-26 Yuting Zeng , Manping Fan , You Zhou , Yongbin Yu , Zhiwen Zheng , Jingtao Zhang , Liyong Ren , Zhenglin Yang

We present ReinDriveGen, a framework that enables full controllability over dynamic driving scenes, allowing users to freely edit actor trajectories to simulate safety-critical corner cases such as front-vehicle collisions, drifting cars,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Hao Zhang , Lue Fan , Weikang Bian , Zehuan Wu , Lewei Lu , Zhaoxiang Zhang , Hongsheng Li

Existing offline hierarchical reinforcement learning methods rely on high-level policy learning to generate subgoal sequences. However, their efficiency degrades as task horizons increase, and they lack effective strategies for stitching…

Machine Learning · Computer Science 2025-07-08 Seungho Baek , Taegeon Park , Jongchan Park , Seungjun Oh , Yusung Kim