English
Related papers

Related papers: Context-Aware Timewise VAEs for Real-Time Vehicle …

200 papers

A person's gaze offers valuable insights into their focus of attention, level of social engagement, and confidence. In this work, we investigate how contextual cues combined with visual scene and facial information can be effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Surbhi Madan , Shreya Ghosh , Ramanathan Subramanian , Abhinav Dhall , Tom Gedeon

Human motion and behaviour in crowded spaces is influenced by several factors, such as the dynamics of other moving agents in the scene, as well as the static elements that might be perceived as points of attraction or obstacles. In this…

Computer Vision and Pattern Recognition · Computer Science 2017-05-09 Federico Bartoli , Giuseppe Lisanti , Lamberto Ballan , Alberto Del Bimbo

In this paper, we propose a novel approach for agent motion prediction in cluttered environments. One of the main challenges in predicting agent motion is accounting for location and context-specific information. Our main contribution is…

Robotics · Computer Science 2020-07-08 Igor Gilitschenski , Guy Rosman , Arjun Gupta , Sertac Karaman , Daniela Rus

Context plays an important role in visual recognition. Recent studies have shown that visual recognition networks can be fooled by placing objects in inconsistent contexts (e.g., a cow in the ocean). To model the role of contextual…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Mengmi Zhang , Claire Tseng , Gabriel Kreiman

Traffic forecasting, crucial for urban planning, requires accurate predictions of spatial-temporal traffic patterns across urban areas. Existing research mainly focuses on designing complex models that capture spatial-temporal dependencies…

Machine Learning · Computer Science 2024-07-30 Jiarui Sun , Yujie Fan , Chin-Chia Michael Yeh , Wei Zhang , Girish Chowdhary

Autonomous vehicles (AVs) must be both safe and trustworthy to gain social acceptance and become a viable option for everyday public transportation. Explanations about the system behaviour can increase safety and trust in AVs.…

Logic in Computer Science · Computer Science 2025-11-19 Dominik Grundt , Ishan Saxena , Malte Petersen , Bernd Westphal , Eike Möhlmann

Multi-agent behavior modeling and trajectory forecasting are crucial for the safe navigation of autonomous agents in interactive scenarios. Variational Autoencoder (VAE) has been widely applied in multi-agent interaction modeling to…

Machine Learning · Computer Science 2021-12-02 Chen Tang , Wei Zhan , Masayoshi Tomizuka

Predicting future trajectories of surrounding obstacles is a crucial task for autonomous driving cars to achieve a high degree of road safety. There are several challenges in trajectory prediction in real-world traffic scenarios, including…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Bo Dong , Hao Liu , Yu Bai , Jinbiao Lin , Zhuoran Xu , Xinyu Xu , Qi Kong

Trajectory prediction has always been a challenging problem for autonomous driving, since it needs to infer the latent intention from the behaviors and interactions from traffic participants. This problem is intrinsically hard, because each…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Hao He , Hengchen Dai , Naiyan Wang

Predicting the behavior of surrounding traffic participants is crucial for advanced driver assistance systems and autonomous driving. Most researchers however do not consider contextual knowledge when predicting vehicle motion. Extending…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Florian Wirthmüller , Julian Schlechtriemen , Jochen Hipp , Manfred Reichert

A multi-modal framework to generate user intention distributions when operating a mobile vehicle is proposed in this work. The model learns from past observed trajectories and leverages traversability information derived from the visual…

Robotics · Computer Science 2022-03-17 Kavindie Katuwandeniya , Stefan H. Kiss , Lei Shi , Jaime Valls Miro

Accurate prediction of others' trajectories is essential for autonomous driving. Trajectory prediction is challenging because it requires reasoning about agents' past movements, social interactions among varying numbers and kinds of agents,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Tianyang Zhao , Yifei Xu , Mathew Monfort , Wongun Choi , Chris Baker , Yibiao Zhao , Yizhou Wang , Ying Nian Wu

Trajectory prediction is a critical component of autonomous driving, essential for ensuring both safety and efficiency on the road. However, traditional approaches often struggle with the scarcity of labeled data and exhibit suboptimal…

Robotics · Computer Science 2025-09-18 Jianxin Shi , Zengqi Peng , Xiaolong Chen , Tianyu Wo , Jun Ma

Learning-based model predictive control has been widely applied in autonomous racing to improve the closed-loop behaviour of vehicles in a data-driven manner. When environmental conditions change, e.g., due to rain, often only the…

The ability to predict the future trajectories of traffic participants is crucial for the safe and efficient operation of autonomous vehicles. In this paper, a diffusion-based generative model for multi-agent trajectory prediction is…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Theodor Westny , Björn Olofsson , Erik Frisk

We present ConVOI, a novel method for autonomous robot navigation in real-world indoor and outdoor environments using Vision Language Models (VLMs). We employ VLMs in two ways: first, we leverage their zero-shot image classification…

Pedestrian trajectory prediction is an essential task in robotic applications such as autonomous driving and robot navigation. State-of-the-art trajectory predictors use a conditional variational autoencoder (CVAE) with recurrent neural…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Yu Yao , Ella Atkins , Matthew Johnson-Roberson , Ram Vasudevan , Xiaoxiao Du

The prediction of surrounding vehicle trajectories is crucial for collision-free path planning. In this study, we focus on a scenario where a connected and autonomous vehicle (CAV) serves as the central agent, utilizing both sensors and…

Robotics · Computer Science 2024-08-05 Xi Chen , Rahul Bhadani , Zhanbo Sun , Larry Head

Predicting agents' future trajectories plays a crucial role in modern AI systems, yet it is challenging due to intricate interactions exhibited in multi-agent systems, especially when it comes to collision avoidance. To address this…

Robotics · Computer Science 2021-03-29 Xu Xie , Chi Zhang , Yixin Zhu , Ying Nian Wu , Song-Chun Zhu

While most prior research has focused on improving the precision of multimodal trajectory predictions, the explicit modeling of multimodal behavioral intentions (e.g., yielding, overtaking) remains relatively underexplored. This paper…

Robotics · Computer Science 2026-02-19 Jiawei Sun , Xibin Yue , Jiahui Li , Tianle Shen , Chengran Yuan , Shuo Sun , Sheng Guo , Quanyun Zhou , Marcelo H Ang