English
Related papers

Related papers: PRECOG: PREdiction Conditioned On Goals in Visual …

200 papers

Human pose forecasting garners attention for its diverse applications. However, challenges in modeling the multi-modal nature of human motion and intricate interactions among agents persist, particularly with longer timescales and more…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Jaewoo Jeong , Daehee Park , Kuk-Jin Yoon

In order to enable high-quality decision making and motion planning of intelligent systems such as robotics and autonomous vehicles, accurate probabilistic predictions for surrounding interactive objects is a crucial prerequisite. Although…

Robotics · Computer Science 2019-04-05 Jiachen Li , Hengbo Ma , Masayoshi Tomizuka

Learning an agent model that behaves like humans-capable of jointly perceiving the environment, predicting the future, and taking actions from a first-person perspective-is a fundamental challenge in computer vision. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Lu Chen , Yizhou Wang , Shixiang Tang , Qianhong Ma , Tong He , Wanli Ouyang , Xiaowei Zhou , Hujun Bao , Sida Peng

For motion planning and control of autonomous vehicles to be proactive and safe, pedestrians' and other road users' motions must be considered. In this paper, we present a vehicle motion planning and control framework, based on Model…

Systems and Control · Computer Science 2019-03-20 Ivo Batkovic , Mario Zanon , Mohammad Ali , Paolo Falcone

We describe a robust planning method for autonomous driving that mixes normal and adversarial agent predictions output by a diffusion model trained for motion prediction. We first train a diffusion model to learn an unbiased distribution of…

Robotics · Computer Science 2025-05-20 Albert Zhao , Stefano Soatto

Accurate motion prediction of surrounding traffic participants is crucial for the safe and efficient operation of automated vehicles in dynamic environments. Marginal prediction models commonly forecast each agent's future trajectories…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Fabian Konstantinidis , Ariel Dallari Guerreiro , Raphael Trumpp , Moritz Sackmann , Ulrich Hofmann , Marco Caccamo , Christoph Stiller

In the field of conditional autonomous driving technology, driver perceived risk prediction plays a crucial role in reducing traffic risks and ensuring passenger safety. This study introduces an innovative perceived risk prediction model…

Human-Computer Interaction · Computer Science 2025-03-07 Chenhao Yang , Siwei Huang , Chuan Hu

In this paper, we present a context-free unsupervised approach based on a self-conditioned GAN to learn different modes from 2D trajectories. Our intuition is that each mode indicates a different behavioral moving pattern in the…

Machine Learning · Computer Science 2026-03-10 Tiago Rodrigues de Almeida , Eduardo Gutierrez Maestro , Oscar Martinez Mozos

The ability to plan and execute goal specific actions in varied, unexpected settings is a central requirement of intelligent agents. In this paper, we explore how an agent can be equipped with an internal model of the dynamics of the…

Computer Vision and Pattern Recognition · Computer Science 2016-01-20 Katerina Fragkiadaki , Pulkit Agrawal , Sergey Levine , Jitendra Malik

Our ability to predict the behavior of complex agents turns on the attribution of goals. Probing for goal-directed behavior comes in two flavors: Behavioral and mechanistic. The former proposes that goal-directedness can be estimated…

Multiagent Systems · Computer Science 2025-08-20 Nina Rajcic , Anders Søgaard

The framework of uncoupled online learning in multiplayer games has made significant progress in recent years. In particular, the development of time-varying games has considerably expanded its modeling capabilities. However, current regret…

Computer Science and Game Theory · Computer Science 2025-08-18 Aymeric Capitaine , Etienne Boursier , Eric Moulines , Michael I. Jordan , Alain Durmus

Understanding the intention of vehicles in the surrounding traffic is crucial for an autonomous vehicle to successfully accomplish its driving tasks in complex traffic scenarios such as highway forced merging. In this paper, we consider a…

Artificial Intelligence · Computer Science 2023-09-27 Xiao Li , Kaiwen Liu , H. Eric Tseng , Anouck Girard , Ilya Kolmanovsky

Prediction of future states of the environment and interacting agents is a key competence required for autonomous agents to operate successfully in the real world. Prior work for structured sequence prediction based on latent variable…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Apratim Bhattacharyya , Michael Hanselmann , Mario Fritz , Bernt Schiele , Christoph-Nikolas Straehle

Simulation has the potential to massively scale evaluation of self-driving systems enabling rapid development as well as safe deployment. To close the gap between simulation and the real world, we need to simulate realistic multi-agent…

Robotics · Computer Science 2021-01-19 Simon Suo , Sebastian Regalado , Sergio Casas , Raquel Urtasun

Predicting future trajectories of traffic agents in highly interactive environments is an essential and challenging problem for the safe operation of autonomous driving systems. On the basis of the fact that self-driving vehicles are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chiho Choi , Joon Hee Choi , Jiachen Li , Srikanth Malla

Predicting future trajectories of traffic agents in highly interactive environments is an essential and challenging problem for the safe operation of autonomous driving systems. On the basis of the fact that self-driving vehicles are…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Chiho Choi , Joon Hee Choi , Srikanth Malla , Jiachen Li

Predicting future sensory states is crucial for learning agents such as robots, drones, and autonomous vehicles. In this paper, we couple multiple sensory modalities with exploratory actions and propose a predictive neural network…

Robotics · Computer Science 2021-09-17 Xiaohui Chen , Ramtin Hosseini , Karen Panetta , Jivko Sinapov

Studies have shown that autonomous vehicles (AVs) behave conservatively in a traffic environment composed of human drivers and do not adapt to local conditions and socio-cultural norms. It is known that socially aware AVs can be designed if…

Robotics · Computer Science 2021-11-05 Rohan Chandra , Aniket Bera , Dinesh Manocha

Autonomous vehicles (AVs) rely on environment perception and behavior prediction to reason about agents in their surroundings. These perception systems must be robust to adverse weather such as rain, fog, and snow. However, validation of…

Robotics · Computer Science 2022-03-29 Harrison Delecki , Masha Itkina , Bernard Lange , Ransalu Senanayake , Mykel J. Kochenderfer

We present a new method for multi-agent planning involving human drivers and autonomous vehicles (AVs) in unsignaled intersections, roundabouts, and during merging. In multi-agent planning, the main challenge is to predict the actions of…

Robotics · Computer Science 2022-03-21 Rohan Chandra , Dinesh Manocha