English
Related papers

Related papers: Versatile Behavior Diffusion for Generalized Traff…

200 papers

Scenario-based testing for automated driving systems (ADS) must be able to simulate traffic scenarios that rely on interactions with other vehicles. Although many languages for high-level scenario modelling have been proposed, they lack the…

Recent advances in diffusion models have achieved remarkable success in isolated computer vision tasks such as text-to-image generation, depth estimation, and optical flow. However, these models are often restricted by a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Yilin Gao , Shuguang Dou , Junzhou Li , Zhiheng Yu , Yin Li , Dongsheng Jiang , Shugong Xu

Recent advances in text-to-image generation with diffusion models present transformative capabilities in image quality. However, user controllability of the generated image, and fast adaptation to new tasks still remains an open challenge,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Omer Bar-Tal , Lior Yariv , Yaron Lipman , Tali Dekel

Realistic temporal dynamics are crucial for many video generation, processing and modelling applications, e.g. in computational fluid dynamics, weather prediction, or long-term climate simulations. Video diffusion models (VDMs) are the…

Machine Learning · Computer Science 2025-05-16 Philipp Hess , Maximilian Gelbrecht , Christof Schötz , Michael Aich , Yu Huang , Shangshang Yang , Niklas Boers

Bird's-eye-view (BEV) representations play a crucial role in autonomous driving tasks. Despite recent advancements in BEV generation, inherent noise, stemming from sensor limitations and the learning process, remains largely unaddressed,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Xin Ye , Burhaneddin Yaman , Sheng Cheng , Feng Tao , Abhirup Mallik , Liu Ren

Generating novel views of a natural scene, e.g., every-day scenes both indoors and outdoors, from a single view is an under-explored problem, even though it is an organic extension to the object-centric novel view synthesis. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Wonbong Jang , Jonathan Tremblay , Lourdes Agapito

BEV perception is of great importance in the field of autonomous driving, serving as the cornerstone of planning, controlling, and motion prediction. The quality of the BEV feature highly affects the performance of BEV perception. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Jiayu Zou , Zheng Zhu , Yun Ye , Xingang Wang

Despite remarkable achievements in video synthesis, achieving granular control over complex dynamics, such as nuanced movement among multiple interacting objects, still presents a significant hurdle for dynamic world modeling, compounded by…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Pengxiang Li , Kai Chen , Zhili Liu , Ruiyuan Gao , Lanqing Hong , Guo Zhou , Hua Yao , Dit-Yan Yeung , Huchuan Lu , Xu Jia

The advancement of autonomous driving technologies necessitates increasingly sophisticated methods for understanding and predicting real-world scenarios. Vision language models (VLMs) are emerging as revolutionary tools with significant…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Yongjie Fu , Anmol Jain , Xuan Di , Xu Chen , Zhaobin Mo

Diffusion-based planners have shown strong potential for autonomous driving by capturing multi-modal driving behaviors. A key challenge is how to effectively guide these models for safe and reactive planning in closed-loop settings, where…

Artificial Intelligence · Computer Science 2026-03-06 Shu Liu , Wenlin Chen , Weihao Li , Zheng Wang , Lijin Yang , Jianing Huang , Yipin Zhang , Zhongzhan Huang , Ze Cheng , Hao Yang

Being able to generate realistic trajectory options is at the core of increasing the degree of automation of road vehicles. While model-driven, rule-based, and classical learning-based methods are widely used to tackle these tasks at…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Annajoyce Mariani , Kira Maag , Hanno Gottschalk

Diffusion models are promising for joint trajectory prediction and controllable generation in autonomous driving, but they face challenges of inefficient inference steps and high computational demands. To tackle these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Yixiao Wang , Chen Tang , Lingfeng Sun , Simone Rossi , Yichen Xie , Chensheng Peng , Thomas Hannagan , Stefano Sabatini , Nicola Poerio , Masayoshi Tomizuka , Wei Zhan

Traffic congestion is a major challenge in modern urban settings. The industry-wide development of autonomous and automated vehicles (AVs) motivates the question of how can AVs contribute to congestion reduction. Past research has shown…

Artificial Intelligence · Computer Science 2022-07-08 Jiaxun Cui , William Macke , Harel Yedidsion , Daniel Urieli , Peter Stone

Autonomous driving requires accurate scene understanding, including road geometry, traffic agents, and their semantic relationships. In online HD map generation scenarios, raster-based representations are well-suited to vision models but…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zhigang Sun , Yiru Wang , Anqing Jiang , Shuo Wang , Yu Gao , Yuwen Heng , Shouyi Zhang , An He , Hao Jiang , Jinhao Chai , Zichong Gu , Wang Jijun , Shichen Tang , Lavdim Halilaj , Juergen Luettin , Hao Sun

Unified visual grounding pursues a simple and generic technical route to leverage multi-task data with less task-specific design. The most advanced methods typically present boxes and masks as vertex sequences to model referring detection…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Zesen Cheng , Kehan Li , Peng Jin , Xiangyang Ji , Li Yuan , Chang Liu , Jie Chen

Diffusion models are advancing autonomous driving by enabling realistic data synthesis, predictive end-to-end planning, and closed-loop simulation, with a primary focus on temporally consistent generation. However, large-scale 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yu Yang , Alan Liang , Jianbiao Mei , Yukai Ma , Yong Liu , Gim Hee Lee

In contemporary autonomous driving testing, virtual simulation has become an important approach due to its efficiency and cost effectiveness. However, existing methods usually rely on reinforcement learning to generate risky scenarios,…

Robotics · Computer Science 2026-03-24 Chen Xiong , Cheng Wang , Yuhang Liu , Zirui Wu , Ye Tian

World models can foresee the outcomes of different actions, which is of paramount importance for autonomous driving. Nevertheless, existing driving world models still have limitations in generalization to unseen environments, prediction…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Shenyuan Gao , Jiazhi Yang , Li Chen , Kashyap Chitta , Yihang Qiu , Andreas Geiger , Jun Zhang , Hongyang Li

Deep generative models have made rapid progress in image, text, audio, and video generation, and are increasingly being applied to structured records. For tabular data, however, generative modeling remains difficult: a dataset may contain…

Machine Learning · Computer Science 2026-05-25 Zhong Li , Qi Huang , Lincen Yang , Jiayang Shi , Zhao Yang , Niki van Stein , Thomas Bäck , Matthijs van Leeuwen

Video virtual try-on (VVT) technology has garnered considerable academic interest owing to its promising applications in e-commerce advertising and entertainment. However, most existing end-to-end methods rely heavily on scarce paired…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Tongchun Zuo , Zaiyu Huang , Shuliang Ning , Ente Lin , Chao Liang , Zerong Zheng , Jianwen Jiang , Yuan Zhang , Mingyuan Gao , Xin Dong