English
Related papers

Related papers: PRECOG: PREdiction Conditioned On Goals in Visual …

200 papers

Autonomous systems such as self-driving cars and general-purpose robots are safety-critical systems that operate in highly uncertain and dynamic environments. We propose an interactive multi-agent framework where the system-under-design is…

Machine Learning · Computer Science 2021-07-07 Xin Qin , Nikos Aréchiga , Andrew Best , Jyotirmoy Deshmukh

Autonomous vehicles operating in complex real-world environments require accurate predictions of interactive behaviors between traffic participants. This paper tackles the interaction prediction problem by formulating it with hierarchical…

Robotics · Computer Science 2023-08-15 Zhiyu Huang , Haochen Liu , Chen Lv

This paper presents a method for constructing human-robot interaction policies in settings where multimodality, i.e., the possibility of multiple highly distinct futures, plays a critical role in decision making. We are motivated in this…

Robotics · Computer Science 2017-10-27 Edward Schmerling , Karen Leung , Wolf Vollprecht , Marco Pavone

Maintaining adequate situation awareness (SA) is crucial for the safe operation of conditionally automated vehicles (AVs), which requires drivers to regain control during takeover (TOR) events. This study developed a predictive model for…

Human-Computer Interaction · Computer Science 2024-05-14 Lilit Avetisyan , X. Jessie Yang , Feng Zhou

We propose a Deep RObust Goal-Oriented trajectory prediction Network (DROGON) for accurate vehicle trajectory prediction by considering behavioral intentions of vehicles in traffic scenes. Our main insight is that the behavior (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Chiho Choi , Srikanth Malla , Abhishek Patil , Joon Hee Choi

Motivated by the intuitive understanding humans have about the space of possible interactions, and the ease with which they can generalize this understanding to previously unseen scenes, we develop an approach for learning visual…

Robotics · Computer Science 2023-05-30 Homanga Bharadhwaj , Abhinav Gupta , Shubham Tulsiani

A multi-modal framework to generate user intention distributions when operating a mobile vehicle is proposed in this work. The model learns from past observed trajectories and leverages traversability information derived from the visual…

Robotics · Computer Science 2022-03-17 Kavindie Katuwandeniya , Stefan H. Kiss , Lei Shi , Jaime Valls Miro

We introduce a simple framework for predicting the behavior of an agent in multi-agent settings. In contrast to autoregressive (AR) tasks, such as language processing, our focus is on scenarios with multiple agents whose interactions are…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Neerja Thakkar , Tara Sadjadpour , Jathushan Rajasegaran , Shiry Ginosar , Jitendra Malik

Autonomous vehicles currently suffer from a time-inefficient driving style caused by uncertainty about human behavior in traffic interactions. Accurate and reliable prediction models enabling more efficient trajectory planning could make…

Robotics · Computer Science 2023-02-21 Julian Frederik Schumann , Jens Kober , Arkady Zgonnikov

Autonomous driving is a multi-agent setting where the host vehicle must apply sophisticated negotiation skills with other road users when overtaking, giving way, merging, taking left and right turns and while pushing ahead in unstructured…

Artificial Intelligence · Computer Science 2016-10-12 Shai Shalev-Shwartz , Shaked Shammah , Amnon Shashua

For an autonomous vehicle to plan a path in its environment, it must be able to accurately forecast the trajectory of all dynamic objects in its proximity. While many traditional methods encode observations in the scene to solve this…

Robotics · Computer Science 2024-06-21 Hunter Schofield , Hamidreza Mirkhani , Mohammed Elmahgiubi , Kasra Rezaee , Jinjun Shan

We develop a deep generative model built on a fully differentiable simulator for multi-agent trajectory prediction. Agents are modeled with conditional recurrent variational neural networks (CVRNNs), which take as input an ego-centric…

Machine Learning · Statistics 2021-04-23 Adam Scibior , Vasileios Lioutas , Daniele Reda , Peyman Bateni , Frank Wood

It is crucial to ask how agents can achieve goals by generating action plans using only partial models of the world acquired through habituated sensory-motor experiences. Although many existing robotics studies use a forward model…

Robotics · Computer Science 2020-06-01 Takazumi Matsumoto , Jun Tani

The development of algorithms that learn multi-agent behavioral models using human demonstrations has led to increasingly realistic simulations in the field of autonomous driving. In general, such models learn to jointly predict…

In this paper, we present Goal-GAN, an interpretable and end-to-end trainable model for human trajectory prediction. Inspired by human navigation, we model the task of trajectory prediction as an intuitive two-stage process: (i) goal…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Patrick Dendorfer , Aljoša Ošep , Laura Leal-Taixé

Learning predictive models from interaction with the world allows an agent, such as a robot, to learn about how the world works, and then use this learned model to plan coordinated sequences of actions to bring about desired outcomes.…

Machine Learning · Computer Science 2020-01-01 Karl Schmeckpeper , Annie Xie , Oleh Rybkin , Stephen Tian , Kostas Daniilidis , Sergey Levine , Chelsea Finn

Understanding the interaction between multiple agents is crucial for realistic vehicle trajectory prediction. Existing methods have attempted to infer the interaction from the observed past trajectories of agents using pooling, attention,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Daehee Park , Hobin Ryu , Yunseo Yang , Jegyeong Cho , Jiwon Kim , Kuk-Jin Yoon

Reasoning about the future behavior of other agents is critical to safe robot navigation. The multiplicity of plausible futures is further amplified by the uncertainty inherent to agent state estimation from data, including positions,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Boris Ivanovic , Kuan-Hui Lee , Pavel Tokmakov , Blake Wulfe , Rowan McAllister , Adrien Gaidon , Marco Pavone

Despite the advances in the autonomous driving domain, autonomous vehicles (AVs) are still inefficient and limited in terms of cooperating with each other or coordinating with vehicles operated by humans. A group of autonomous and…

Robotics · Computer Science 2022-04-06 Behrad Toghi , Rodolfo Valiente , Dorsa Sadigh , Ramtin Pedarsani , Yaser P. Fallah

Trajectory prediction is a critical component of autonomous driving, essential for ensuring both safety and efficiency on the road. However, traditional approaches often struggle with the scarcity of labeled data and exhibit suboptimal…

Robotics · Computer Science 2025-09-18 Jianxin Shi , Zengqi Peng , Xiaolong Chen , Tianyu Wo , Jun Ma