English
Related papers

Related papers: Language-Driven Interactive Traffic Trajectory Gen…

200 papers

We address language-conditioned robotic manipulation using flow-based trajectory generation, which enables training on human and web videos of object manipulation and requires only minimal embodiment-specific data. This task is challenging,…

Robotics · Computer Science 2026-03-27 Motonari Kambara , Koki Seno , Tomoya Kaichi , Yanan Wang , Komei Sugiura

LangDriveCTRL is a natural-language-controllable framework for editing real-world driving videos to synthesize diverse traffic scenarios. It represents each video as an explicit 3D scene graph, decomposing the scene into a static background…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Yun He , Francesco Pittaluga , Ziyu Jiang , Matthias Zwicker , Manmohan Chandraker , Zaid Tasneem

Generating multi-vehicle interaction scenarios can benefit motion planning and decision making of autonomous vehicles when on-road data is insufficient. This paper presents an efficient approach to generate varied multi-vehicle interaction…

Robotics · Computer Science 2019-10-10 Weiyang Zhang , Wenshuo Wang , Ding Zhao

Precise modeling of microscopic vehicle trajectories is critical for traffic behavior analysis and autonomous driving systems. We propose Ctx2TrajGen, a context-aware trajectory generation framework that synthesizes realistic urban driving…

Artificial Intelligence · Computer Science 2025-07-24 Joobin Jin , Seokjun Hong , Gyeongseon Baek , Yeeun Kim , Byeongjoon Noh

This paper introduces the Text-to-TrajVis task, which aims to transform natural language questions into trajectory data visualizations, facilitating the development of natural language interfaces for trajectory visualization systems. As…

Computation and Language · Computer Science 2025-04-24 Tian Bai , Huiyan Ying , Kailong Suo , Junqiu Wei , Tao Fan , Yuanfeng Song

This work presents a mapless global navigation approach for outdoor applications. It combines the exploratory capacity of conditional variational autoencoders (CVAEs) to generate trajectories and the semantic segmentation capabilities of a…

Robotics · Computer Science 2026-02-03 Gonzalo Olguin , Javier Ruiz-del-Solar

Trajectory generation has garnered significant attention from researchers in the field of spatio-temporal analysis, as it can generate substantial synthesized human mobility trajectories that enhance user privacy and alleviate data…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Ji Cao , Tongya Zheng , Qinghong Guo , Yu Wang , Junshu Dai , Shunyu Liu , Jie Yang , Jie Song , Mingli Song

Traditional methods for autonomous driving are implemented with many building blocks from perception, planning and control, making them difficult to generalize to varied scenarios due to complex assumptions and interdependencies. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Peide Cai , Yuxiang Sun , Hengli Wang , Ming Liu

We present a multi-modal trajectory generation and selection algorithm for real-world mapless outdoor navigation in human-centered environments. Such environments contain rich features like crosswalks, grass, and curbs, which are easily…

Robotics · Computer Science 2025-05-19 Daeun Song , Jing Liang , Xuesu Xiao , Dinesh Manocha

Predicting future trajectories of surrounding obstacles is a crucial task for autonomous driving cars to achieve a high degree of road safety. There are several challenges in trajectory prediction in real-world traffic scenarios, including…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Bo Dong , Hao Liu , Yu Bai , Jinbiao Lin , Zhuoran Xu , Xinyu Xu , Qi Kong

Accurately predicting the possible behaviors of traffic participants is an essential capability for autonomous vehicles. Since autonomous vehicles need to navigate in dynamically changing environments, they are expected to make accurate…

Robotics · Computer Science 2022-11-15 Yeping Hu , Wei Zhan , Masayoshi Tomizuka

Generating trajectory data is among promising solutions to addressing privacy concerns, collection costs, and proprietary restrictions usually associated with human mobility analyses. However, existing trajectory generation methods are…

Machine Learning · Computer Science 2024-04-25 Yuanshao Zhu , James Jianqiao Yu , Xiangyu Zhao , Qidong Liu , Yongchao Ye , Wei Chen , Zijian Zhang , Xuetao Wei , Yuxuan Liang

A key aspect of driving a road vehicle is to interact with other road users, assess their intentions and make risk-aware tactical decisions. An intuitive approach to enabling an intelligent automated driving system would be incorporating…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Videsh Suman , Phu Pham , Aniket Bera

In this work, we aim to predict the future motion of vehicles in a traffic scene by explicitly modeling their pairwise interactions. Specifically, we propose a graph neural network that jointly predicts the discrete interaction modes and…

Machine Learning · Statistics 2019-12-18 Donsuk Lee , Yiming Gu , Jerrick Hoang , Micol Marchetti-Bowick

Accurately predicting the trajectory of surrounding vehicles is a critical challenge for autonomous vehicles. In complex traffic scenarios, there are two significant issues with the current autonomous driving system: the cognitive…

Robotics · Computer Science 2024-09-25 Wen Wei , Jiankun Wang

Car-focused navigation services are based on turns and distances of named streets, whereas navigation instructions naturally used by humans are centered around physical objects called landmarks. We present a neural model that takes…

Computation and Language · Computer Science 2021-05-27 Raphael Schumann , Stefan Riezler

Encoding a driving scene into vector representations has been an essential task for autonomous driving that can benefit downstream tasks e.g. trajectory prediction. The driving scene often involves heterogeneous elements such as the…

Artificial Intelligence · Computer Science 2023-07-21 Xiaosong Jia , Penghao Wu , Li Chen , Yu Liu , Hongyang Li , Junchi Yan

We introduce ScenarioControl, the first vision-language control mechanism for learned driving scenario generation. Given a text prompt or an input image, Scenario-Control synthesizes diverse, realistic 3D scenario rollouts - including map,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Lili Gao , Yanbo Xu , William Koch , Samuele Ruffino , Luke Rowe , Behdad Chalaki , Dmitriy Rivkin , Julian Ost , Roger Girgis , Mario Bijelic , Felix Heide

Metaverse platforms are rapidly evolving to provide immersive spaces for user interaction and content creation. However, the generation of dynamic and interactive 3D objects remains challenging due to the need for advanced 3D modeling and…

Human-Computer Interaction · Computer Science 2025-05-01 Ryutaro Kurai , Takefumi Hiraki , Yuichi Hiroi , Yutaro Hirao , Monica Perusquía-Hernández , Hideaki Uchiyama , Kiyoshi Kiyokawa

The ability to predict the future trajectories of traffic participants is crucial for the safe and efficient operation of autonomous vehicles. In this paper, a diffusion-based generative model for multi-agent trajectory prediction is…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Theodor Westny , Björn Olofsson , Erik Frisk