English
Related papers

Related papers: ProgD: Progressive Multi-scale Decoding with Dynam…

200 papers

Dynamic scene graph generation extends scene graph generation from images to videos by modeling entity relationships and their temporal evolution. However, existing methods either generate scene graphs from observed frames without…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Yi Yang , Yuren Cong , Hao Cheng , Bodo Rosenhahn , Michael Ying Yang

In autonomous driving, accurately interpreting the movements of other road users and leveraging this knowledge to forecast future trajectories is crucial. This is typically achieved through the integration of map data and tracked…

Robotics · Computer Science 2024-05-17 Tobias Demmler , Andreas Tamke , Thao Dang , Karsten Haug , Lars Mikelsons

Accurately predicting the possible behaviors of traffic participants is an essential capability for autonomous vehicles. Since autonomous vehicles need to navigate in dynamically changing environments, they are expected to make accurate…

Robotics · Computer Science 2022-11-15 Yeping Hu , Wei Zhan , Masayoshi Tomizuka

Reliable forecasting of the future behavior of road agents is a critical component to safe planning in autonomous vehicles. Here, we represent continuous trajectories as sequences of discrete motion tokens and cast multi-agent motion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Ari Seff , Brian Cera , Dian Chen , Mason Ng , Aurick Zhou , Nigamaa Nayakanti , Khaled S. Refaat , Rami Al-Rfou , Benjamin Sapp

Understanding and generating multi-person interactions is a fundamental challenge with broad implications for robotics and social computing. While humans naturally coordinate in groups, modeling such interactions remains difficult due to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Vongani H. Maluleke , Kie Horiuchi , Lea Wilken , Evonne Ng , Jitendra Malik , Angjoo Kanazawa

Behavior prediction of traffic actors is an essential component of any real-world self-driving system. Actors' long-term behaviors tend to be governed by their interactions with other actors or traffic elements (traffic lights, stop signs)…

Machine Learning · Computer Science 2020-09-29 Sumit Kumar , Yiming Gu , Jerrick Hoang , Galen Clark Haynes , Micol Marchetti-Bowick

Predicting future motions of road participants is an important task for driving autonomously in urban scenes. Existing models excel at predicting marginal trajectories for single agents, yet it remains an open question to jointly predict…

Robotics · Computer Science 2022-03-29 Qiao Sun , Xin Huang , Junru Gu , Brian C. Williams , Hang Zhao

Predicting the behaviors of other agents on the road is critical for autonomous driving to ensure safety and efficiency. However, the challenging part is how to represent the social interactions between agents and output different possible…

Robotics · Computer Science 2021-09-15 Zhiyu Huang , Xiaoyu Mo , Chen Lv

In a given scenario, simultaneously and accurately predicting every possible interaction of traffic participants is an important capability for autonomous vehicles. The majority of current researches focused on the prediction of an single…

Machine Learning · Computer Science 2018-10-31 Yeping Hu , Wei Zhan , Masayoshi Tomizuka

A scenario-based testing approach can reduce the time required to obtain statistically significant evidence of the safety of Automated Driving Systems (ADS). Identifying these scenarios in an automated manner is a challenging task. Most…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Tobias Hoek , Holger Caesar , Andreas Falkovén , Tommy Johansson

Deepgenerative models havebecomeapromisingapproach for human motion prediction due to their ability to capture multimodal distributions and represent diverse human be haviors. However, generating predictions that are both di verse and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Lei Chu , Yuhuan Zhao

Capturing scene dynamics and predicting the future scene state is challenging but essential for robotic manipulation tasks, especially when the scene contains both rigid and deformable objects. In this work, we contribute a simulation…

Robotics · Computer Science 2021-03-05 Zehang Weng , Fabian Paus , Anastasiia Varava , Hang Yin , Tamim Asfour , Danica Kragic

We propose JFP, a Joint Future Prediction model that can learn to generate accurate and consistent multi-agent future trajectories. For this task, many different methods have been proposed to capture social interactions in the encoding part…

Multiagent Systems · Computer Science 2022-12-20 Wenjie Luo , Cheolho Park , Andre Cornman , Benjamin Sapp , Dragomir Anguelov

This paper introduces a decentralized multi-agent reinforcement learning framework enabling structurally heterogeneous teams of agents to jointly discover and acquire randomly located targets in environments characterized by partial…

Robotics · Computer Science 2026-01-14 Gabriele Calzolari , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos

Social robot navigation can be helpful in various contexts of daily life but requires safe human-robot interactions and efficient trajectory planning. While modeling pairwise relations has been widely studied in multi-agent interacting…

Robotics · Computer Science 2024-11-13 Jiachen Li , Chuanbo Hua , Jianpeng Yao , Hengbo Ma , Jinkyoo Park , Victoria Dax , Mykel J. Kochenderfer

Predicting future trajectories of surrounding obstacles is a crucial task for autonomous driving cars to achieve a high degree of road safety. There are several challenges in trajectory prediction in real-world traffic scenarios, including…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Bo Dong , Hao Liu , Yu Bai , Jinbiao Lin , Zhuoran Xu , Xinyu Xu , Qi Kong

Effective interaction modeling and behavior prediction of dynamic agents play a significant role in interactive motion planning for autonomous robots. Although existing methods have improved prediction accuracy, few research efforts have…

Robotics · Computer Science 2024-01-09 Victoria M. Dax , Jiachen Li , Enna Sachdeva , Nakul Agarwal , Mykel J. Kochenderfer

Accurate prediction of others' trajectories is essential for autonomous driving. Trajectory prediction is challenging because it requires reasoning about agents' past movements, social interactions among varying numbers and kinds of agents,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Tianyang Zhao , Yifei Xu , Mathew Monfort , Wongun Choi , Chris Baker , Yibiao Zhao , Yizhou Wang , Ying Nian Wu

Motion prediction for traffic participants is essential for a safe and robust automated driving system, especially in cluttered urban environments. However, it is highly challenging due to the complex road topology as well as the uncertain…

Robotics · Computer Science 2022-08-02 Lu Zhang , Peiliang Li , Jing Chen , Shaojie Shen

Accurate motion prediction of surrounding traffic participants is crucial for the safe and efficient operation of automated vehicles in dynamic environments. Marginal prediction models commonly forecast each agent's future trajectories…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Fabian Konstantinidis , Ariel Dallari Guerreiro , Raphael Trumpp , Moritz Sackmann , Ulrich Hofmann , Marco Caccamo , Christoph Stiller