English
Related papers

Related papers: LANGTRAJ: Diffusion Model and Dataset for Language…

200 papers

Traffic simulation, complementing real-world data with a long-tail distribution, allows for effective evaluation and enhancement of the ability of autonomous vehicles to handle accident-prone scenarios. Simulating such safety-critical…

Robotics · Computer Science 2025-03-10 Zherui Huang , Xing Gao , Guanjie Zheng , Licheng Wen , Xuemeng Yang , Xiao Sun

An ideal traffic simulator replicates the realistic long-term point-to-point trip that a self-driving system experiences during deployment. Prior models and benchmarks focus on closed-loop motion simulation for initial agents in a scene.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Xiuyu Yang , Shuhan Tan , Philipp Krähenbühl

Past work has demonstrated that autonomous vehicles can drive more safely if they communicate with one another than if they do not. However, their communication has often not been human-understandable. Using natural language as a…

Robotics · Computer Science 2025-06-02 Jiaxun Cui , Chen Tang , Jarrett Holtz , Janice Nguyen , Alessandro G. Allievi , Hang Qiu , Peter Stone

Large language models have been widely applied to knowledge-driven decision-making for automated vehicles due to their strong generalization and reasoning capabilities. However, the safety of the resulting decisions cannot be ensured due to…

Robotics · Computer Science 2025-10-09 Yuanfei Lin , Sebastian Illing , Matthias Althoff

This study introduces a text-conditioned approach to generating drumbeats with Latent Diffusion Models (LDMs). It uses informative conditioning text extracted from training data filenames. By pretraining a text and drumbeat encoder through…

Sound · Computer Science 2024-08-07 Pushkar Jajoria , James McDermott

The manual design of scenarios for Air Traffic Control (ATC) training is a demanding and time-consuming bottleneck that limits the diversity of simulations available to controllers. To address this, we introduce a novel, end-to-end…

Artificial Intelligence · Computer Science 2025-08-18 Dewi Sid William Gould , George De Ath , Ben Carvell , Nick Pepper

Diffusion models for multi-agent trajectory prediction are limited by iterative denoising, which causes inference latency that hinders their use in time-critical settings like autonomous driving. Fast-sampling variants using DDIM and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Alen Mrdovic , Qingze , Liu , Danrui Li , Mathew Schwartz , Kaidong Hu , Sejong Yoon , Mubbasir Kapadia , Vladimir Pavlovic

Achieving robust safety alignment in large language models (LLMs) while preserving their utility remains a fundamental challenge. Existing approaches often struggle to balance comprehensive safety with fine-grained controllability at the…

Artificial Intelligence · Computer Science 2025-09-25 Huizhen Shu , Xuying Li , Zhuo Li

This paper addresses the problem of generating dynamically admissible trajectories for control tasks using diffusion models, particularly in scenarios where the environment is complex and system dynamics are crucial for practical…

Robotics · Computer Science 2025-10-15 Darshan Gadginmath , Fabio Pasqualetti

Diffusion-based tabular data synthesis models have yielded promising results. However, when the data dimensionality increases, existing models tend to degenerate and may perform even worse than simpler, non-diffusion-based models. This is…

Machine Learning · Computer Science 2025-11-12 Zuqing Li , Junhao Gan , Jianzhong Qi

Realistic scene-level multi-agent motion simulations are crucial for developing and evaluating self-driving algorithms. However, most existing works focus on generating trajectories for a certain single agent type, and typically ignore the…

Robotics · Computer Science 2023-11-28 Zhiming Guo , Xing Gao , Jianlan Zhou , Xinyu Cai , Botian Shi

We introduce a method for generating realistic pedestrian trajectories and full-body animations that can be controlled to meet user-defined goals. We draw on recent advances in guided diffusion modeling to achieve test-time controllability…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Davis Rempe , Zhengyi Luo , Xue Bin Peng , Ye Yuan , Kris Kitani , Karsten Kreis , Sanja Fidler , Or Litany

Constrained reinforcement learning (RL) seeks high-performance policies under safety constraints. We focus on an offline setting where the agent has only a fixed dataset -- common in realistic tasks to prevent unsafe exploration. To address…

Machine Learning · Computer Science 2025-09-08 Junyu Guo , Zhi Zheng , Donghao Ying , Ming Jin , Shangding Gu , Costas Spanos , Javad Lavaei

Simulation is pivotal in evaluating the performance of autonomous driving systems due to the advantages of high efficiency and low cost compared to on-road testing. Bridging the gap between simulation and the real world requires realistic…

Robotics · Computer Science 2025-06-17 Haojie Xin , Xiaodong Zhang , Renzhi Tang , Songyang Yan , Qianrui Zhao , Chunze Yang , Wen Cui , Zijiang Yang

Simulation is critical for safety evaluation in autonomous driving, particularly in capturing complex interactive behaviors. However, generating realistic and controllable traffic scenarios in long-tail situations remains a significant…

Artificial Intelligence · Computer Science 2025-05-28 Haohong Lin , Xin Huang , Tung Phan-Minh , David S. Hayden , Huan Zhang , Ding Zhao , Siddhartha Srinivasa , Eric M. Wolff , Hongge Chen

Large language models have made revolutionary progress in generating human-like text, yet their outputs often tend to be generic, exhibiting insufficient structural diversity, which limits personalized expression. Recent advances in…

Computation and Language · Computer Science 2025-10-02 Ruqian Zhang , Yijiao Zhang , Juan Shen , Zhongyi Zhu , Annie Qu

We introduce a technique for synthesis of control and communication strategies for a team of agents from a global task specification given as a Linear Temporal Logic (LTL) formula over a set of properties that can be satisfied by the…

Robotics · Computer Science 2011-11-10 Yushan Chen , Xu Chu Ding , Calin Belta

Simulating diverse and realistic traffic scenarios is critical for developing and testing autonomous planning. Traditional rule-based planners lack diversity and realism, while learning-based simulators often replay, forecast, or edit…

Robotics · Computer Science 2025-09-30 Da Saem Lee , Akash Karthikeyan , Yash Vardhan Pant , Sebastian Fischmeister

Diffusion models operate in a reflexive System 1 mode, constrained by a fixed, content-agnostic sampling schedule. This rigidity arises from the curse of state dimensionality, where the combinatorial explosion of possible states in the…

Machine Learning · Computer Science 2026-03-17 Ping Chen , Xiang Liu , Xingpeng Zhang , Fei Shen , Xun Gong , Zhaoxiang Liu , Zezhou Chen , Huan Hu , Kai Wang , Shiguo Lian

Imitation learning is a promising approach to end-to-end training of autonomous vehicle controllers. Typically the driving process with such approaches is entirely automatic and black-box, although in practice it is desirable to control the…

Robotics · Computer Science 2020-11-23 Renhao Wang , Adam Scibior , Frank Wood