English
Related papers

Related papers: A Spatiotemporal Approach to Tri-Perspective Repre…

200 papers

We present an approach that combines appearance and semantic information for 2D image-based localization (2D-VL) across large perceptual changes and time lags. Compared to appearance features, the semantic layout of a scene is generally…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Zachary Seymour , Karan Sikka , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar

Camera-based 3D semantic occupancy prediction offers an efficient and cost-effective solution for perceiving surrounding scenes in autonomous driving. However, existing works rely on explicit occupancy state inference, leading to numerous…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Naiyu Fang , Zheyuan Zhou , Kang Wang , Ruibo Li , Lemiao Qiu , Shuyou Zhang , Zhe Wang , Guosheng Lin

Classification and localization of driving actions over time is important for advanced driver-assistance systems and naturalistic driving studies. Temporal localization is challenging because it requires robustness, reliability, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Erkut Akdag , Zeqi Zhu , Egor Bondarev , Peter H. N. De With

Vision-based 3D semantic scene completion (SSC) describes autonomous driving scenes through 3D volume representations. However, the occlusion of invisible voxels by scene surfaces poses challenges to current SSC methods in hallucinating…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Xiao Zhao , Bo Chen , Mingyang Sun , Dingkang Yang , Youxing Wang , Xukun Zhang , Mingcheng Li , Dongliang Kou , Xiaoyi Wei , Lihua Zhang

Vision-based 3D semantic occupancy prediction is a critical task in 3D vision that integrates volumetric 3D reconstruction with semantic understanding. Existing methods, however, often rely on modular pipelines. These modules are typically…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Dubing Chen , Huan Zheng , Yucheng Zhou , Xianfei Li , Wenlong Liao , Tao He , Pai Peng , Jianbing Shen

Multi-view cooperative perception and multimodal fusion are essential for reliable 3D spatiotemporal understanding in autonomous driving, especially under occlusions, limited viewpoints, and communication delays in V2X scenarios. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Zhenwei Yang , Yibo Ai , Weidong Zhang

LiDAR-based 3D object detection presents significant challenges due to the inherent sparsity of LiDAR points. A common solution involves long-term temporal LiDAR data to densify the inputs. However, efficiently leveraging spatial-temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Chaoqun Wang , Xiaobin Hong , Wenzhong Li , Ruimao Zhang

Seamless integration of virtual and physical worlds in augmented reality benefits from the system semantically "understanding" the physical environment. AR research has long focused on the potential of context awareness, demonstrating novel…

Human-Computer Interaction · Computer Science 2024-10-08 Chengyuan Xu , Radha Kumaran , Noah Stier , Kangyou Yu , Tobias Höllerer

Intelligent Transportation Systems (ITS) demand real-time collision prediction to ensure road safety and reduce accident severity. Conventional approaches rely on transmitting raw video or high-dimensional sensory data from roadside units…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Murat Arda Onsu , Poonam Lohan , Burak Kantarci , Aisha Syed , Matthew Andrews , Sean Kennedy

In this paper, we introduce a non-parametric memory representation for spatio-temporal segmentation that captures the local space and time around an autonomous vehicle (AV). Our representation has three important properties: (i) it…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Min Bai , Shenlong Wang , Kelvin Wong , Ersin Yumer , Raquel Urtasun

Vision-based bird's-eye-view (BEV) 3D object detection has advanced significantly in autonomous driving by offering cost-effectiveness and rich contextual information. However, existing methods often construct BEV representations by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jicheng Yuan , Manh Nguyen Duc , Qian Liu , Manfred Hauswirth , Danh Le Phuoc

Visual-spatial understanding, the ability to infer object relationships and layouts from visual input, is fundamental to downstream tasks such as robotic navigation and embodied interaction. However, existing methods face spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Haoyu Zhang , Meng Liu , Zaijing Li , Haokun Wen , Weili Guan , Yaowei Wang , Liqiang Nie

There exists a correlation between geospatial activity temporal patterns and type of land use. A novel self-supervised approach is proposed to stratify landscape based on mobility activity time series. First, the time series signal is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yi Cao , Swetava Ganguli , Vipul Pandey

Trajectory prediction is a challenging task that aims to predict the future trajectory of vehicles or pedestrians over a short time horizon based on their historical positions. The main reason is that the trajectory is a kind of complex…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Pengqian Han , Jiamou Liu , Tianzhe Bao , Yifei Wang

LiDAR representation learning has emerged as a promising approach to reducing reliance on costly and labor-intensive human annotations. While existing methods primarily focus on spatial alignment between LiDAR and camera sensors, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xiang Xu , Lingdong Kong , Hui Shuai , Wenwei Zhang , Liang Pan , Kai Chen , Ziwei Liu , Qingshan Liu

Semantic occupancy has recently gained significant traction as a prominent 3D scene representation. However, most existing methods rely on large and costly datasets with fine-grained 3D voxel labels for training, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Simon Boeder , Fabian Gigengack , Benjamin Risse

This paper introduces VLMFusionOcc3D, a robust multimodal framework for dense 3D semantic occupancy prediction in autonomous driving. Current voxel-based occupancy models often struggle with semantic ambiguity in sparse geometric grids and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 A. Enes Doruk , Hasan F. Ates

Recent camera-based 3D semantic scene completion (SSC) methods have increasingly explored leveraging temporal cues to enrich the features of the current frame. However, while these approaches primarily focus on enhancing in-frame regions,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jongseong Bae , Junwoo Ha , Jinnyeong Heo , Yeongin Lee , Ha Young Kim

Estimating 3D occupancy and motion at the vehicle's surroundings is essential for autonomous driving, enabling situational awareness in dynamic environments. Existing approaches jointly learn geometry and motion but rely on expensive 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xavier Timoneda , Markus Herb , Fabian Duerr , Daniel Goehring

3D occupancy prediction plays a pivotal role in the realm of autonomous driving, as it provides a comprehensive understanding of the driving environment. Most existing methods construct dense scene representations for occupancy prediction,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Zichen Yu , Quanli Liu , Wei Wang , Liyong Zhang , Xiaoguang Zhao