English
Related papers

Related papers: Navigation-Guided Sparse Scene Representation for …

200 papers

We present Flex, an efficient and effective scene encoder that addresses the computational bottleneck of processing high-volume multi-camera data in end-to-end autonomous driving. Flex employs a small set of learnable scene tokens to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Jiawei Yang , Ziyu Chen , Yurong You , Yan Wang , Yiming Li , Yuxiao Chen , Boyi Li , Boris Ivanovic , Marco Pavone , Yue Wang

Vision-based autonomous driving shows great potential due to its satisfactory performance and low costs. Most existing methods adopt dense representations (e.g., bird's eye view) or sparse representations (e.g., instance boxes) for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Wenzhao Zheng , Junjie Wu , Yao Zheng , Sicheng Zuo , Zixun Xie , Longchao Yang , Yong Pan , Zhihui Hao , Peng Jia , Xianpeng Lang , Shanghang Zhang

Vision-based end-to-end (E2E) driving has garnered significant interest in the research community due to its scalability and synergy with multimodal large language models (MLLMs). However, current E2E driving benchmarks primarily feature…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Runsheng Xu , Hubert Lin , Wonseok Jeon , Hao Feng , Yuliang Zou , Liting Sun , John Gorman , Ekaterina Tolstaya , Sarah Tang , Brandyn White , Ben Sapp , Mingxing Tan , Jyh-Jing Hwang , Dragomir Anguelov

Most current end-to-end (E2E) autonomous driving algorithms are built on standard vehicles in structured transportation scenarios, lacking exploration of robot navigation for unstructured scenarios such as auxiliary roads, campus roads, and…

Robotics · Computer Science 2025-11-18 Yuhang Peng , Sidong Wang , Jihaoyu Yang , Shilong Li , Han Wang , Jiangtao Gong

In autonomous vehicles (AVs), early warning systems rely on collision prediction to ensure occupant safety. However, state-of-the-art methods using deep convolutional networks either fail at modeling collisions or are too expensive/slow,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Arnav V. Malawade , Shih-Yuan Yu , Brandon Hsu , Deepan Muthirayan , Pramod P. Khargonekar , Mohammad A. Al Faruque

Intelligent Transportation Systems (ITS) require reliable environmental perception to support safe and efficient transportation. With the rapid development of Vehicle-to-everything (V2X), roadside perception has become an effective means to…

Robotics · Computer Science 2026-05-08 Yuhan Xia , Runxin Zhao , Hanyang Zhuang , Chunxiang Wang , Ming Yang

Modeling and rendering dynamic urban driving scenes is crucial for self-driving simulation. Current high-quality methods typically rely on costly manual object tracklet annotations, while self-supervised approaches fail to capture dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jiawei Xu , Kai Deng , Zexin Fan , Shenlong Wang , Jin Xie , Jian Yang

A principal barrier to large-scale deployment of urban autonomous driving systems lies in the prevalence of complex scenarios and edge cases. Existing systems fail to effectively interpret semantic information within traffic contexts and…

Robotics · Computer Science 2025-07-09 Yuhang Zhang , Jiaqi Liu , Chengkai Xu , Peng Hang , Jian Sun

Although fully-supervised oriented object detection has made significant progress in multimodal remote sensing image understanding, it comes at the cost of labor-intensive annotation. Recent studies have explored weakly and semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Yu Lin , Jianghang Lin , Kai Ye , You Shen , Yan Zhang , Shengchuan Zhang , Liujuan Cao , Rongrong Ji

Multi-agent trajectory generation is a core problem for autonomous driving and intelligent transportation systems. However, efficiently modeling the dynamic interactions between numerous road users and infrastructures in complex scenes…

Robotics · Computer Science 2025-12-25 Xiaoyu Mo , Jintian Ge , Zifan Wang , Chen Lv , Karl Henrik Johansson

End-to-end scene text spotting has made significant progress due to its intrinsic synergy between text detection and recognition. Previous methods commonly regard manual annotations such as horizontal rectangles, rotated rectangles,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yuliang Liu , Jiaxin Zhang , Dezhi Peng , Mingxin Huang , Xinyu Wang , Jingqun Tang , Can Huang , Dahua Lin , Chunhua Shen , Xiang Bai , Lianwen Jin

Autonomous driving requires a comprehensive understanding of the surrounding environment for reliable trajectory planning. Previous works rely on dense rasterized scene representation (e.g., agent occupancy and semantic map) to perform…

Scene flow allows autonomous vehicles to reason about the arbitrary motion of multiple independent objects which is the key to long-term mobile autonomy. While estimating the scene flow from LiDAR has progressed recently, it remains largely…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Fangqiang Ding , Zhijun Pan , Yimin Deng , Jianning Deng , Chris Xiaoxuan Lu

LiDAR sensor is essential to the perception system in autonomous vehicles and intelligent robots. To fulfill the real-time requirements in real-world applications, it is necessary to efficiently segment the LiDAR scans. Most of previous…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Song Wang , Jianke Zhu , Ruixiang Zhang

Semantic segmentation of road scenes is one of the key technologies for realizing autonomous driving scene perception, and the effectiveness of deep Convolutional Neural Networks(CNNs) for this task has been demonstrated. State-of-art CNNs…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Zhiyuan Wu , Yu Jiang , Chupeng Cui , Zongmin Yang , Xinhui Xue , Hong Qi

Efficient data utilization is crucial for advancing 3D scene understanding in autonomous driving, where reliance on heavily human-annotated LiDAR point clouds challenges fully supervised methods. Addressing this, our study extends into…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Lingdong Kong , Xiang Xu , Jiawei Ren , Wenwei Zhang , Liang Pan , Kai Chen , Wei Tsang Ooi , Ziwei Liu

This article presents a complete semantic scene understanding workflow using only a single 2D lidar. This fills the gap in 2D lidar semantic segmentation, thereby enabling the rethinking and enhancement of existing 2D lidar-based algorithms…

Robotics · Computer Science 2026-01-27 Zhanteng Xie , Yipeng Pan , Yinqiang Zhang , Jia Pan , Philip Dames

Online scene perception and topology reasoning are critical for autonomous vehicles to understand their driving environments, particularly for mapless driving systems that endeavor to reduce reliance on costly High-Definition (HD) maps.…

Robotics · Computer Science 2025-06-27 Muleilan Pei , Jiayao Shan , Peiliang Li , Jieqi Shi , Jing Huo , Yang Gao , Shaojie Shen

Reliable anticipation of traffic accidents is essential for advancing autonomous driving systems. However, this objective is limited by two fundamental challenges: the scarcity of diverse, high-quality training data and the frequent absence…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yanchen Guan , Haicheng Liao , Chengyue Wang , Xingcheng Liu , Jiaxun Zhang , Zhenning Li

High infraction rates remain the primary bottleneck for end-to-end (E2E) autonomous driving, as evidenced by the low driving scores on the CARLA Leaderboard. Despite collision-related infractions being the dominant failure mode in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Alex Koran , Dimitrios Sinodinos , Hadi Hojjati , Takuya Nanri , Fangge Chen , Narges Armanfard