English
Related papers

Related papers: Exploring Contextual Representation and Multi-Moda…

200 papers

The prediction of surrounding vehicle trajectories is crucial for collision-free path planning. In this study, we focus on a scenario where a connected and autonomous vehicle (CAV) serves as the central agent, utilizing both sensors and…

Robotics · Computer Science 2024-08-05 Xi Chen , Rahul Bhadani , Zhanbo Sun , Larry Head

Autonomous vehicles were experiencing rapid development in the past few years. However, achieving full autonomy is not a trivial task, due to the nature of the complex and dynamic driving environment. Therefore, autonomous vehicles are…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Yaodong Cui , Ren Chen , Wenbo Chu , Long Chen , Daxin Tian , Ying Li , Dongpu Cao

To navigate through urban roads, an automated vehicle must be able to perceive and recognize objects in a three-dimensional environment. A high-level contextual understanding of the surroundings is necessary to plan and execute accurate…

Robotics · Computer Science 2020-03-05 Julie Stephany Berrio , Mao Shan , Stewart Worrall , James Ward , Eduardo Nebot

End-to-end autonomous driving aims to generate safe and plausible planning policies from raw sensor input. Driving world models have shown great potential in learning rich representations by predicting the future evolution of a driving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xingtai Gui , Meijie Zhang , Tianyi Yan , Wencheng Han , Jiahao Gong , Feiyang Tan , Cheng-zhong Xu , Jianbing Shen

Infrastructure sensors installed at elevated positions offer a broader perception range and encounter fewer occlusions. Integrating both infrastructure and ego-vehicle data through V2X communication, known as vehicle-infrastructure…

Robotics · Computer Science 2024-08-21 Jiaru Zhong , Haibao Yu , Tianyi Zhu , Jiahui Xu , Wenxian Yang , Zaiqing Nie , Chao Sun

Understanding and addressing corner cases is essential for ensuring the safety and reliability of autonomous driving systems. Vision-language models (VLMs) play a crucial role in enhancing scenario comprehension, yet they face significant…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yujin Wang , Quanfeng Liu , Jiaqi Fan , Jinlong Hong , Hongqing Chu , Mengjian Tian , Bingzhao Gao , Hong Chen

Autonomous vehicles rely extensively on perception systems to navigate and interpret their surroundings. Despite significant advancements in these systems recently, challenges persist under conditions like occlusion, extreme lighting, or in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Tianyuan Yuan , Yucheng Mao , Jiawei Yang , Yicheng Liu , Yue Wang , Hang Zhao

The adoption of self-driving cars will certainly revolutionize our lives, even though they may take more time to become fully autonomous than initially predicted. The first vehicles are already present in certain cities of the world, as…

Human-Computer Interaction · Computer Science 2023-06-07 Carlos Crispim-Junior , Romain Guesdon , Christophe Jallais , Florent Laroche , Stephanie Souche-Le Corvec , Laure Tougne Rodet

Spatial synchronization in roadside scenarios is essential for integrating data from multiple sensors at different locations. Current methods using cascading spatial transformation (CST) often lead to cumulative errors in large-scale…

Signal Processing · Electrical Eng. & Systems 2023-11-09 Yong Li , Zhiguo Zhao , Yunli Chen , Rui Tian

Accurate environment perception is essential for automated vehicles. Since occlusions and inaccuracies regularly occur, the exchange and combination of perception data of multiple vehicles seems promising. This paper describes a method to…

Signal Processing · Electrical Eng. & Systems 2020-05-06 Bastian Lampe , Raphael van Kempen , Timo Woopen , Alexandru Kampmann , Bassam Alrifaee , Lutz Eckstein

We consider a human-assisted autonomy sensor fusion for dynamic target localization in a Bayesian framework. Autonomous sensor-based tracking systems can suffer from observability and target detection failure. Humans possess valuable…

Robotics · Computer Science 2024-10-08 Min-Won Seo , Solmaz S. Kia

Motion planning is a complicated task that requires the combination of perception, map information integration and prediction, particularly when driving in heavy traffic. Developing an extensible and efficient representation that visualizes…

Robotics · Computer Science 2024-10-14 Ren Xin , Sheng Wang , Yingbing Chen , Jie Cheng , Ming Liu , Jun Ma

There are two critical sensors for 3D perception in autonomous driving, the camera and the LiDAR. The camera provides rich semantic information such as color, texture, and the LiDAR reflects the 3D shape and locations of surrounding…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Kaicheng Yu , Tang Tao , Hongwei Xie , Zhiwei Lin , Zhongwei Wu , Zhongyu Xia , Tingting Liang , Haiyang Sun , Jiong Deng , Dayang Hao , Yongtao Wang , Xiaodan Liang , Bing Wang

The large-scale deployment of autonomous vehicles is yet to come, and one of the major remaining challenges lies in urban dense traffic scenarios. In such cases, it remains challenging to predict the future evolution of the scene and future…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Hao Shao , Letian Wang , Ruobing Chen , Steven L. Waslander , Hongsheng Li , Yu Liu

Dynamic scene understanding is the ability of a computer system to interpret and make sense of the visual information present in a video of a real-world scene. In this thesis, we present a series of frameworks for dynamic scene…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Salman Khan

Prior point cloud provides 3D environmental context, which enhances the capabilities of monocular camera in downstream vision tasks, such as 3D object detection, via data fusion. However, the absence of accurate and automated registration…

Robotics · Computer Science 2024-04-09 Yu Sheng , Lu Zhang , Xingchen Li , Yifan Duan , Yanyong Zhang , Yu Zhang , Jianmin Ji

With the recent advances in autonomous driving and the decreasing cost of LiDARs, the use of multimodal sensor systems is on the rise. However, in order to make use of the information provided by a variety of complimentary sensors, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Quentin Herau , Nathan Piasco , Moussab Bennehar , Luis Roldão , Dzmitry Tsishkou , Cyrille Migniot , Pascal Vasseur , Cédric Demonceaux

Vision-based autonomous driving shows great potential due to its satisfactory performance and low costs. Most existing methods adopt dense representations (e.g., bird's eye view) or sparse representations (e.g., instance boxes) for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Wenzhao Zheng , Junjie Wu , Yao Zheng , Sicheng Zuo , Zixun Xie , Longchao Yang , Yong Pan , Zhihui Hao , Peng Jia , Xianpeng Lang , Shanghang Zhang

Autonomous driving systems have made significant advances in Q&A, perception, prediction, and planning based on local visual information, yet they struggle to incorporate broader navigational context that human drivers routinely utilize. We…

Robotics · Computer Science 2025-11-04 Qucheng Peng , Chen Bai , Guoxiang Zhang , Bo Xu , Xiaotong Liu , Xiaoyin Zheng , Chen Chen , Cheng Lu

Efficient data utilization is crucial for advancing 3D scene understanding in autonomous driving, where reliance on heavily human-annotated LiDAR point clouds challenges fully supervised methods. Addressing this, our study extends into…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Lingdong Kong , Xiang Xu , Jiawei Ren , Wenwei Zhang , Liang Pan , Kai Chen , Wei Tsang Ooi , Ziwei Liu