English
Related papers

Related papers: Vision-Guided Forecasting -- Visual Context for Mu…

200 papers

Scene perception is essential for driving decision-making and traffic safety. However, fog, as a kind of common weather, frequently appears in the real world, especially in the mountain areas, making it difficult to accurately observe the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Jing You , Shaocheng Jia , Xin Pei , Danya Yao

Most state-of-the-art works in trajectory forecasting for automotive target predicting the pose and orientation of the agents in the scene. This represents a particularly useful problem, for instance in autonomous driving, but it does not…

Robotics · Computer Science 2024-10-28 Luca Paparusso , Stefano Melzi , Francesco Braghin

In this paper, we explore the use of vehicle-to-vehicle (V2V) communication to improve the perception and motion forecasting performance of self-driving vehicles. By intelligently aggregating the information received from multiple nearby…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Tsun-Hsuan Wang , Sivabalan Manivasagam , Ming Liang , Bin Yang , Wenyuan Zeng , James Tu , Raquel Urtasun

We propose a novel method to estimate a driver's points-of-gaze using a pair of ordinary cameras mounted on the windshield and dashboard of a car. This is a challenging problem due to the dynamics of traffic environments with 3D scenes of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Dat Viet Thanh Nguyen , Anh Tran , Hoai Nam Vu , Cuong Pham , Minh Hoai

This work proposes a new self-driving framework that uses a human driver control model, whose feature-input values are extracted from images using deep convolutional neural networks (CNNs). The development of image processing techniques…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Justin Zheng , Kazuhide Okamoto , Panagiotis Tsiotras

The ability to predict the future movements of other vehicles is a subconscious and effortless skill for humans and key to safe autonomous driving. Therefore, trajectory prediction for autonomous cars has gained a lot of attention in recent…

Robotics · Computer Science 2021-09-16 Benedikt Mersch , Thomas Höllen , Kun Zhao , Cyrill Stachniss , Ribana Roscher

In recent decades, due to the groundbreaking improvements in machine vision, many daily tasks are performed by computers. One of these tasks is multiple-vehicle tracking, which is widely used in different areas such as video surveillance…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Fateme Bafghi , Bijan Shoushtarian

Understanding road scenes for visual perception remains crucial for intelligent self-driving cars. In particular, it is desirable to detect unexpected small road hazards reliably in real-time, especially under varying adverse conditions…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Jongoh Jeong , Taek-Jin Song , Jong-Hwan Kim , Kuk-Jin Yoon

Vision-based deep learning (DL) methods have made great progress in learning autonomous driving models from large-scale crowd-sourced video datasets. They are trained to predict instantaneous driving behaviors from video data captured by…

Human-Computer Interaction · Computer Science 2021-09-24 Suphanut Jamonnak , Ye Zhao , Xinyi Huang , Md Amiruzzaman

While stochastic video prediction models enable future prediction under uncertainty, they mostly fail to model the complex dynamics of real-world scenes. For example, they cannot provide reliable predictions for scenes with a moving camera…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Adil Kaan Akan , Sadra Safadoust , Fatma Güney

Due to the lack of depth cues in images, multi-frame inputs are important for the success of vision-based perception, prediction, and planning in autonomous driving. Observations from different angles enable the recovery of 3D object states…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Yichen Xie , Hongge Chen , Gregory P. Meyer , Yong Jae Lee , Eric M. Wolff , Masayoshi Tomizuka , Wei Zhan , Yuning Chai , Xin Huang

There is evidence that the driving style of an autonomous vehicle is important to increase the acceptance and trust of the passengers. The driving situation has been found to have a significant influence on human driving behavior. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-27 Johann Haselberger , Bonifaz Stuhr , Bernhard Schick , Steffen Müller

Anticipating the motion of neighboring vehicles is crucial for autonomous driving, especially on congested highways where even slight motion variations can result in catastrophic collisions. An accurate prediction of a future trajectory…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Fuad Hasan , Hailong Huang

A key challenge for autonomous driving lies in maintaining real-time situational awareness regarding surrounding obstacles under strict latency constraints. The high processing requirements coupled with limited onboard computational…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Faisal Hawladera , Rui Meireles , Gamal Elghazaly , Ana Aguiar , Raphaël Frank

Path prediction is a fundamental task for estimating how pedestrians or vehicles are going to move in a scene. Because path prediction as a task of computer vision uses video as input, various information used for prediction, such as the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Tsubasa Hirakawa , Takayoshi Yamashita , Toru Tamaki , Hironobu Fujiyoshi

End-to-end autonomous driving systems are increasingly integrating Vision-Language Model (VLM) architectures, incorporating text reasoning or visual reasoning to enhance the robustness and accuracy of driving decisions. However, the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Lingjun Zhang , Changjie Wu , Linzhe Shi , Jiangyang Li , Jiaxin Liu , Lei Yang , Hang Zhang , Mu Xu , Hong Wang

Traffic accidents are a leading cause of fatalities and injuries across the globe. Therefore, the ability to anticipate hazardous situations in advance is essential. Automated accident anticipation enables timely intervention through driver…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Vipooshan Vipulananthan , Charith D. Chitraranjan

Autonomous driving systems require a comprehensive understanding of the environment, achieved by extracting visual features essential for perception, planning, and control. However, models trained solely on single-task objectives or generic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Huy-Dung Nguyen , Anass Bairouk , Mirjana Maras , Wei Xiao , Tsun-Hsuan Wang , Patrick Chareyre , Ramin Hasani , Marc Blanchon , Daniela Rus

We address the task of aligning CAD models to a video sequence of a complex scene containing multiple objects. Our method can process arbitrary videos and fully automatically recover the 9 DoF pose for each object appearing in it, thus…

Computer Vision and Pattern Recognition · Computer Science 2022-01-26 Kevis-Kokitsi Maninis , Stefan Popov , Matthias Nießner , Vittorio Ferrari

Given a visual history, multiple future outcomes for a video scene are equally probable, in other words, the distribution of future outcomes has multiple modes. Multimodality is notoriously hard to handle by standard regressors or…

Computer Vision and Pattern Recognition · Computer Science 2017-05-08 Katerina Fragkiadaki , Jonathan Huang , Alex Alemi , Sudheendra Vijayanarasimhan , Susanna Ricco , Rahul Sukthankar