English
Related papers

Related papers: NMR: Neural Manifold Representation for Autonomous…

200 papers

Accurate prediction of communication link quality metrics is essential for vehicle-to-infrastructure (V2I) systems, enabling smooth handovers, efficient beam management, and reliable low-latency communication. The increasing availability of…

Machine Learning · Computer Science 2025-09-05 Kimia Ehsani , Walid Saad

For an autonomous vehicle to plan a path in its environment, it must be able to accurately forecast the trajectory of all dynamic objects in its proximity. While many traditional methods encode observations in the scene to solve this…

Robotics · Computer Science 2024-06-21 Hunter Schofield , Hamidreza Mirkhani , Mohammed Elmahgiubi , Kasra Rezaee , Jinjun Shan

Understanding and mapping a new environment are core abilities of any autonomously navigating agent. While classical robotics usually estimates maps in a stand-alone manner with SLAM variants, which maintain a topological or metric…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Pierre Marza , Laetitia Matignon , Olivier Simonin , Christian Wolf

Conventional end-to-end autonomous driving methods often rely on explicit global scene representations, which typically consist of 3D object detection, online mapping, and motion prediction. In contrast, human drivers selectively attend to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Ruiqi Song , Xianda Guo , Yanlun Peng , Qinggong Wei , Hangbin Wu , Long Chen

Human drivers adeptly navigate complex scenarios by utilizing rich attentional semantics, but the current autonomous systems struggle to replicate this ability, as they often lose critical semantic information when converting 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Pei Liu , Haipeng Liu , Haichao Liu , Xin Liu , Jinxin Ni , Jun Ma

Navigating narrow roads with oncoming vehicles is a significant challenge that has garnered considerable public interest. These scenarios often involve sections that cannot accommodate two moving vehicles simultaneously due to the presence…

Robotics · Computer Science 2024-12-20 Qianyi Zhang , Jinzheng Guang , Zhenzhong Cao , Jingtai Liu

We present EmerNeRF, a simple yet powerful approach for learning spatial-temporal representations of dynamic driving scenes. Grounded in neural fields, EmerNeRF simultaneously captures scene geometry, appearance, motion, and semantics via…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Jiawei Yang , Boris Ivanovic , Or Litany , Xinshuo Weng , Seung Wook Kim , Boyi Li , Tong Che , Danfei Xu , Sanja Fidler , Marco Pavone , Yue Wang

An accurate model of the environment and the dynamic agents acting in it offers great potential for improving motion planning. We present MILE: a Model-based Imitation LEarning approach to jointly learn a model of the world and a policy for…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Anthony Hu , Gianluca Corrado , Nicolas Griffiths , Zak Murez , Corina Gurau , Hudson Yeo , Alex Kendall , Roberto Cipolla , Jamie Shotton

Bird's-eye-view (BEV) grid is a typical representation of the perception of road components, e.g., drivable area, in autonomous driving. Most existing approaches rely on cameras only to perform segmentation in BEV space, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Shubhankar Borse , Senthil Yogamani , Marvin Klingner , Varun Ravi , Hong Cai , Abdulaziz Almuzairee , Fatih Porikli

Bird's-Eye-View (BEV) perception serves as a cornerstone for autonomous driving, offering a unified spatial representation that fuses surrounding-view images to enable reasoning for various downstream tasks, such as semantic segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yiren Lu , Xin Ye , Burhaneddin Yaman , Jingru Luo , Zhexiao Xiong , Liu Ren , Yu Yin

Aiming for higher-level scene understanding, this work presents a neural network approach that takes a road-layout map in bird's-eye-view as input, and predicts a human-interpretable graph that represents the road's topological layout. Our…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Chenyang Lu , Gijs Dubbelman

Accurate and reliable ego-localization is critical for autonomous driving. In this paper, we present EgoVM, an end-to-end localization network that achieves comparable localization accuracy to prior state-of-the-art methods, but uses…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Yuzhe He , Shuang Liang , Xiaofei Rui , Chengying Cai , Guowei Wan

Perceiving the world and forecasting its future state is a critical task for self-driving. Supervised approaches leverage annotated object labels to learn a model of the world -- traditionally with object detections and trajectory…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Ben Agro , Quinlan Sykora , Sergio Casas , Thomas Gilles , Raquel Urtasun

This work presents a novel method of exploring human brain-visual representations, with a view towards replicating these processes in machines. The core idea is to learn plausible computational and biological representations by correlating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Simone Palazzo , Concetto Spampinato , Isaak Kavasidis , Daniela Giordano , Joseph Schmidt , Mubarak Shah

Bayesian Optimization (BO) is a popular approach to optimizing expensive-to-evaluate black-box functions. Despite the success of BO, its performance may decrease exponentially as the dimensionality increases. A common framework to tackle…

Machine Learning · Computer Science 2024-12-24 Quoc-Anh Hoang Nguyen , The Hung Tran

As the pretraining technique is growing in popularity, little work has been done on pretrained learning-based motion prediction methods in autonomous driving. In this paper, we propose a framework to formalize the pretraining task for…

Robotics · Computer Science 2023-09-19 Yi Yang , Qingwen Zhang , Thomas Gilles , Nazre Batool , John Folkesson

Vision-centric joint perception and prediction (PnP) has become an emerging trend in autonomous driving research. It predicts the future states of the traffic participants in the surrounding environment from raw RGB images. However, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Shaoheng Fang , Zi Wang , Yiqi Zhong , Junhao Ge , Siheng Chen , Yanfeng Wang

Most state-of-the-art works in trajectory forecasting for automotive target predicting the pose and orientation of the agents in the scene. This represents a particularly useful problem, for instance in autonomous driving, but it does not…

Robotics · Computer Science 2024-10-28 Luca Paparusso , Stefano Melzi , Francesco Braghin

Bird's-eye-view (BEV) is a powerful and widely adopted representation for road scenes that captures surrounding objects and their spatial locations, along with overall context in the scene. In this work, we focus on bird's eye semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Mong H. Ng , Kaahan Radia , Jianfei Chen , Dequan Wang , Ionel Gog , Joseph E. Gonzalez

We propose the use of deep neural networks (DNN) for solving the problem of inferring the position and relevant properties of lanes of urban roads with poor or absent horizontal signalization, in order to allow the operation of autonomous…