English
Related papers

Related papers: Collision-Aware Vision-Language Learning for End-t…

200 papers

The planning problem constitutes a fundamental aspect of the autonomous driving framework. Recent strides in representation learning have empowered vehicles to comprehend their surrounding environments, thereby facilitating the integration…

End-to-end (E2E) autonomous driving has recently attracted increasing interest in unifying Vision-Language-Action (VLA) with World Models to enhance decision-making and forward-looking imagination. However, existing methods fail to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Feiyang jia , Lin Liu , Ziying Song , Caiyan Jia , Hangjun Ye , Xiaoshuai Hao , Long Chen

Multi-modal learning has emerged as a key technique for improving performance across domains such as autonomous driving, robotics, and reasoning. However, in certain scenarios, particularly in resource-constrained environments, some…

Robotics · Computer Science 2026-01-01 Rui Liu , Yu Shen , Peng Gao , Pratap Tokekar , Ming Lin

Vision-Language-Action (VLA) models for autonomous driving often hit a performance plateau during Reinforcement Learning (RL) optimization. This stagnation arises from exploration capabilities constrained by previous Supervised Fine-Tuning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yuechen Luo , Qimao Chen , Fang Li , Shaoqing Xu , Jaxin Liu , Ziying Song , Zhi-xin Yang , Fuxi Wen

The latest trend in anomaly detection is to train a unified model instead of training a separate model for each category. However, existing multi-class anomaly detection (MCAD) models perform poorly in multi-view scenarios because they…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Qianzi Yu , Yang Cao , Yu Kang

End-to-end autonomous driving solutions, which directly process multimodal sensory data and output fine-grained control commands, have gradually become a mainstream direction with the development of autonomous driving technology. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Runyi Huang , Ni Ding , Ruidan Xing , Yuheng Shi , Lei He , Keqiang Li

Single-vehicle Vision-Language Models (VLMs) are fundamentally constrained by sensor occlusions. While Vehicle-to-Everything (V2X) systems mitigate this, current benchmarks lack the cooperative reasoning required for resolving ambiguities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Kevin Richard , Alphin Varghese , Colin Pham , David Oh , Srijan Das

Medical students and junior surgeons often rely on senior surgeons and specialists to answer their questions when learning surgery. However, experts are often busy with clinical and academic work, and have little time to give guidance.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Long Bai , Mobarakol Islam , Hongliang Ren

Recent advances in vision language action (VLA) models have shown remarkable potential for autonomous driving by directly mapping multimodal inputs to control signals. However, previous VLA-based methods have not explicitly exploited the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Lijin Yang , Jianing Huang , Zhongzhan Huang , Shu Liu , Hao Yang

Current autonomous driving vehicles rely mainly on their individual sensors to understand surrounding scenes and plan for future trajectories, which can be unreliable when the sensors are malfunctioning or occluded. To address this problem,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Hsu-kuang Chiu , Ryo Hachiuma , Chien-Yi Wang , Stephen F. Smith , Yu-Chiang Frank Wang , Min-Hung Chen

V2X cooperation, through the integration of sensor data from both vehicles and infrastructure, is considered a pivotal approach to advancing autonomous driving technology. Current research primarily focuses on enhancing perception accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Zhiwei Li , Bozhen Zhang , Lei Yang , Tianyu Shen , Nuo Xu , Ruosen Hao , Weiting Li , Tao Yan , Huaping Liu

Vision-language models (VLMs) have significantly advanced autonomous driving (AD) by enhancing reasoning capabilities; however, these models remain highly susceptible to adversarial attacks. While existing research has explored white-box…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Lu Wang , Tianyuan Zhang , Yang Qu , Siyuan Liang , Yuwei Chen , Aishan Liu , Xianglong Liu , Dacheng Tao

Out-of-distribution (OOD) detection is essential in autonomous driving, to determine when learning-based components encounter unexpected inputs. Traditional detectors typically use encoder models with fixed settings, thus lacking effective…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Zhenjiang Mao , Dong-You Jhong , Ao Wang , Ivan Ruchkin

Fine-grained truck classification is critical for intelligent transportation systems (ITS), yet current LiDAR-based methods face scalability challenges due to their reliance on supervised deep learning and labor-intensive manual annotation.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Yiqiao Li , Bo Shang , Jie Wei

Vision-based end-to-end (E2E) driving has garnered significant interest in the research community due to its scalability and synergy with multimodal large language models (MLLMs). However, current E2E driving benchmarks primarily feature…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Runsheng Xu , Hubert Lin , Wonseok Jeon , Hao Feng , Yuliang Zou , Liting Sun , John Gorman , Ekaterina Tolstaya , Sarah Tang , Brandyn White , Ben Sapp , Mingxing Tan , Jyh-Jing Hwang , Dragomir Anguelov

Vision-Language-Action (VLA) driving augments end-to-end (E2E) planning with language-enabled backbones, yet it remains unclear what changes beyond the usual accuracy--cost trade-off. We revisit this question with 3--RQ analysis in…

Embodied visual tracking is crucial for Unmanned Aerial Vehicles (UAVs) executing complex real-world tasks. In dynamic urban scenarios with complex semantic requirements, Vision-Language-Action (VLA) models show great promise due to their…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Qiyao Zhang , Shuhua Zheng , Jianli Sun , Chengxiang Li , Xianke Wu , Zihan Song , Zhiyong Cui , Yisheng Lv , Yonglin Tian

In recent years, vision-based end-to-end autonomous driving has emerged as a new paradigm. However, popular end-to-end approaches typically rely on visual feature extraction networks trained under label supervision. This limited supervision…

Robotics · Computer Science 2025-11-04 Ling Niu , Xiaoji Zheng , Han Wang , Chen Zheng , Ziyuan Yang , Bokui Chen , Jiangtao Gong

Vision-Language-Action (VLA) models extend vision-language models to embodied control by mapping natural-language instructions and visual observations to robot actions. Despite their capabilities, VLA systems face significant challenges due…

Robotics · Computer Science 2025-10-24 Weifan Guan , Qinghao Hu , Aosheng Li , Jian Cheng

Current Vision-Language-Action (VLA) paradigms in end-to-end autonomous driving rely on offline training from static datasets, leaving them vulnerable to distribution shift. Recent post-training methods use takeover data to mitigate this by…