中文
相关论文

相关论文: Perception in Plan: Coupled Perception and Plannin…

200 篇论文

Vision-Language Models(VLMs) excel at autoregressive text generation, yet end-to-end autonomous driving requires multi-task learning with structured outputs and heterogeneous decoding behaviors, such as autoregressive language generation,…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Yiwei Zhang , Xuesong Chen , Jin Gao , Hanshi Wang , Fudong Ge , Weiming Hu , Shaoshuai Shi , Zhipeng Zhang

End-to-end motion planning is promising for simplifying complex autonomous driving pipelines. However, challenges such as scene understanding and effective prediction for decision-making continue to present substantial obstacles to its…

This paper introduces VisionPAD, a novel self-supervised pre-training paradigm designed for vision-centric algorithms in autonomous driving. In contrast to previous approaches that employ neural rendering with explicit depth supervision,…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Haiming Zhang , Wending Zhou , Yiyao Zhu , Xu Yan , Jiantao Gao , Dongfeng Bai , Yingjie Cai , Bingbing Liu , Shuguang Cui , Zhen Li

Autonomous driving requires reliable perception and safe decision-making in complex scenarios. Recent vision-language models (VLMs) demonstrate reasoning and generalization abilities, opening new possibilities for autonomous driving;…

Existing end-to-end autonomous driving methods typically rely on imitation learning (IL) but face a key challenge: the misalignment between open-loop training and closed-loop deployment. This misalignment often triggers driver-initiated…

Visual navigation has been widely used for state estimation of micro aerial vehicles (MAVs). For stable visual navigation, MAVs should generate perception-aware paths which guarantee enough visible landmarks. Many previous works on…

机器人学 · 计算机科学 2021-07-20 Dabin Kim , Gyeong Chan Kim , Youngseok Jang , H. Jin Kim

Cooperatively utilizing both ego-vehicle and infrastructure sensor data via V2X communication has emerged as a promising approach for advanced autonomous driving. However, current research mainly focuses on improving individual modules,…

机器人学 · 计算机科学 2024-12-25 Haibao Yu , Wenxian Yang , Jiaru Zhong , Zhenwei Yang , Siqi Fan , Ping Luo , Zaiqing Nie

Multi-view cooperative perception and multimodal fusion are essential for reliable 3D spatiotemporal understanding in autonomous driving, especially under occlusions, limited viewpoints, and communication delays in V2X scenarios. This paper…

计算机视觉与模式识别 · 计算机科学 2025-12-29 Zhenwei Yang , Yibo Ai , Weidong Zhang

End-to-end autonomous driving demonstrates strong planning capabilities with large-scale data but still struggles in complex, rare scenarios due to limited commonsense. In contrast, Large Vision-Language Models (LVLMs) excel in scene…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Bo Jiang , Shaoyu Chen , Bencheng Liao , Xingyu Zhang , Wei Yin , Qian Zhang , Chang Huang , Wenyu Liu , Xinggang Wang

This comprehensive survey examines the integration of knowledge-based approaches in autonomous driving systems, specifically focusing on trajectory prediction and planning. We extensively analyze various methodologies for incorporating…

人工智能 · 计算机科学 2025-05-23 Kumar Manas , Adrian Paschke

End-to-end autonomous driving increasingly leverages self-supervised video pretraining to learn transferable planning representations. However, pretraining video world models for scene understanding has so far brought only limited…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Linhan Wang , Zichong Yang , Chen Bai , Guoxiang Zhang , Xiaotong Liu , Xiaoyin Zheng , Xiao-Xiao Long , Chang-Tien Lu , Cheng Lu

Reliable planning is crucial for achieving autonomous driving. Rule-based planners are efficient but lack generalization, while learning-based planners excel in generalization yet have limitations in real-time performance and…

机器人学 · 计算机科学 2025-06-02 Yuqi Fan , Zhiyong Cui , Zhenning Li , Yilong Ren , Haiyang Yu

Autonomous vehicles equipped with robust onboard perception, localization, and planning still face limitations in occlusion and non-line-of-sight (NLOS) scenarios, where delayed reactions can increase collision risk. We propose CooperDrive,…

机器人学 · 计算机科学 2026-04-17 Deyuan Qu , Qi Chen , Takayuki Shimizu , Onur Altintas

Practical autonomous driving requires models that generalize by reasoning through spatial-temporal possibilities to exclude unsafe outcomes. While state-of-the-art (SOTA) methods use parallel planning architectures, they fail to explicitly…

机器人学 · 计算机科学 2026-05-12 Yanhao Wu , Haoyang Zhang , Fei He , Rui Wu , Yanhu Shan , Congpei Qiu , Liang Gao , Wei Ke , Tong Zhang

Recent studies have explored leveraging the world knowledge and cognitive capabilities of Vision-Language Models (VLMs) to address the long-tail problem in end-to-end autonomous driving. However, existing methods typically formulate…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Yongkang Li , Kaixin Xiong , Xiangyu Guo , Fang Li , Sixu Yan , Gangwei Xu , Lijun Zhou , Long Chen , Haiyang Sun , Bing Wang , Kun Ma , Guang Chen , Hangjun Ye , Wenyu Liu , Xinggang Wang

In this work, we introduce DeepIPC, a novel end-to-end model tailored for autonomous driving, which seamlessly integrates perception and control tasks. Unlike traditional models that handle these tasks separately, DeepIPC innovatively…

机器人学 · 计算机科学 2024-04-05 Oskar Natan , Jun Miura

In the development of advanced driver-assistance systems (ADAS) and autonomous vehicles, machine learning techniques that are based on deep neural networks (DNNs) have been widely used for vehicle perception. These techniques offer…

机器人学 · 计算机科学 2021-03-02 Ruochen Jiao , Hengyi Liang , Takami Sato , Junjie Shen , Qi Alfred Chen , Qi Zhu

Safety remains one of the most critical challenges in autonomous driving systems. In recent years, the end-to-end driving has shown great promise in advancing vehicle autonomy in a scalable manner. However, existing approaches often face…

机器人学 · 计算机科学 2025-05-12 Zhiwei Zhang , Ruichen Yang , Ke Wu , Zijun Xu , Jingchu Liu , Lisen Mu , Zhongxue Gan , Wenchao Ding

The significant achievements of pre-trained models leveraging large volumes of data in the field of NLP and 2D vision inspire us to explore the potential of extensive data pre-training for 3D perception in autonomous driving. Toward this…

计算机视觉与模式识别 · 计算机科学 2025-04-18 Shumin Wang , Zhuoran Yang , Lidian Wang , Zhipeng Tang , Heng Li , Lehan Pan , Sha Zhang , Jie Peng , Jianmin Ji , Yanyong Zhang

Traditionally, prediction and planning in autonomous driving (AD) have been treated as separate, sequential modules. Recently, there has been a growing shift towards tighter integration of these components, known as Integrated Prediction…

机器人学 · 计算机科学 2025-10-20 Aron Distelzweig , Faris Janjoš , Oliver Scheel , Sirish Reddy Varra , Raghu Rajan , Joschka Boedecker