English
Related papers

Related papers: Collision-Aware Vision-Language Learning for End-t…

200 papers

Urban transportation systems face growing safety challenges that require scalable intelligence for emerging smart mobility infrastructures. While recent advances in foundation models and large-scale multimodal datasets have strengthened…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Wenhui Huang , Songyan Zhang , Collister Chua , Yang Liang , Zhiqi Mao , Heng Yang , Chen Lv

End-to-end models for autonomous driving hold the promise of learning complex behaviors directly from sensor data, but face critical challenges in safety and handling long-tail events. Reinforcement Learning (RL) offers a promising path to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Tianyi Yan , Tao Tang , Xingtai Gui , Yongkang Li , Jiasen Zhesng , Weiyao Huang , Lingdong Kong , Wencheng Han , Xia Zhou , Xueyang Zhang , Yifei Zhan , Kun Zhan , Cheng-zhong Xu , Jianbing Shen

Accurate accident anticipation is essential for enhancing the safety of autonomous vehicles (AVs). However, existing methods often assume ideal conditions, overlooking challenges such as sensor failures, environmental disturbances, and data…

Artificial Intelligence · Computer Science 2025-11-11 Xingcheng Liu , Yanchen Guan , Haicheng Liao , Zhengbing He , Zhenning Li

Autonomous car racing is a challenging task, as it requires precise applications of control while the vehicle is operating at cornering speeds. Traditional autonomous pipelines require accurate pre-mapping, localization, and planning which…

Robotics · Computer Science 2023-03-07 Dvij Kalaria , Qin Lin , John M. Dolan

Understanding and addressing corner cases is essential for ensuring the safety and reliability of autonomous driving systems. Vision-language models (VLMs) play a crucial role in enhancing scenario comprehension, yet they face significant…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yujin Wang , Quanfeng Liu , Jiaqi Fan , Jinlong Hong , Hongqing Chu , Mengjian Tian , Bingzhao Gao , Hong Chen

Cooperative perception through vehicle-to-everything (V2X) has garnered significant attention in recent years due to its potential to overcome occlusions and enhance long-distance perception. Great achievements have been made in both…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Rongsong Li , Xin Pei

Ensuring safe, comfortable, and efficient planning is crucial for autonomous driving systems. While end-to-end models trained on large datasets perform well in standard driving scenarios, they struggle with complex low-frequency events.…

Safety-critical corner cases, difficult to collect in the real world, are crucial for evaluating end-to-end autonomous driving. Adversarial interaction is an effective method to generate such safety-critical corner cases. While existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jiaheng Geng , Jiatong Du , Xinyu Zhang , Ye Li , Panqu Wang , Yanjun Huang

Understanding how Vision-Language-Action (VLA) models transform multimodal knowledge into embodied control remains an open challenge. We present VLA-Trace, a progressive diagnostic framework that analyzes VLA models through a unified…

Artificial Intelligence · Computer Science 2026-05-29 Haoyuan Shi , Xiancong Ren , Yingji Zhang , Qinfan Zhang , Jiayu Hu , Haozhe Shan , Han Dong , Jinpeng Lu , Yinda Chen , Yi Zhang , Yong Dai , Xiaozhu Ju

Autonomous driving has progressed from modular pipelines toward end-to-end unification, and Vision-Language-Action (VLA) models are a natural extension of this journey beyond Vision-to-Action (VA). In practice, driving VLAs have often…

Vision-Language Models(VLMs) excel at autoregressive text generation, yet end-to-end autonomous driving requires multi-task learning with structured outputs and heterogeneous decoding behaviors, such as autoregressive language generation,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yiwei Zhang , Xuesong Chen , Jin Gao , Hanshi Wang , Fudong Ge , Weiming Hu , Shaoshuai Shi , Zhipeng Zhang

End-to-end autonomous driving (E2E-AD) has rapidly emerged as a promising approach toward achieving full autonomy. However, existing E2E-AD systems typically adopt a traditional multi-task framework, addressing perception, prediction, and…

Robotics · Computer Science 2025-07-21 Tao Wang , Cong Zhang , Xingguang Qu , Kun Li , Weiwei Liu , Chang Huang

Autonomous driving systems face significant challenges in achieving human-like adaptability, robustness, and interpretability in complex, open-world environments. These challenges stem from fragmented architectures, limited generalization…

Robotics · Computer Science 2025-08-01 Yi Zhang , Erik Leo Haß , Kuo-Yi Chao , Nenad Petrovic , Yinglei Song , Chengdong Wu , Alois Knoll

Video camouflaged object detection (VCOD) is challenging due to dynamic environments. Existing methods face two main issues: (1) SAM-based methods struggle to separate camouflaged object edges due to model freezing, and (2) MLLM-based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Hua Zhang , Changjiang Luo , Ruoyu Chen

Zero-shot anomaly detection (ZSAD) requires detecting and localizing anomalies without access to target-class anomaly samples. Mainstream methods rely on vision-language models (VLMs) such as CLIP: they build hand-crafted or learned prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yanning Hou , Peiyuan Li , Zirui Liu , Yitong Wang , Yanran Ruan , Jianfeng Qiu , Ke Xu

Vision-language models (VLMs) such as CLIP demonstrate strong generalization in zero-shot classification but remain highly vulnerable to adversarial perturbations. Existing methods primarily focus on adversarial fine-tuning or prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xingyu Zhu , Beier Zhu , Shuo Wang , Kesen Zhao , Hanwang Zhang

Vision-Language Models (VLMs) achieve strong cross-modal performance, yet recent evidence suggests they over-rely on textual descriptions while under-utilizing visual evidence -- a phenomenon termed ``text shortcut learning.'' We propose an…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Lijie Zhou

In today's digital world, the generation of vast amounts of streaming data in various domains has become ubiquitous. However, many of these data are unlabeled, making it challenging to identify events, particularly anomalies. This task…

Machine Learning · Computer Science 2026-02-16 Jin Li , Kleanthis Malialis , Christos G. Panayiotou , Marios M. Polycarpou

Vision Language Action (VLA) models are mainstream in embodied intelligence but face high inference costs. Edge-Cloud Collaborative (ECC) inference offers an effective fix by easing edge-device computing pressure to meet real-time needs.…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-13 Zihao Zheng , Sicheng Tian , Hangyu Cao , Chenyue Li , Jiayu Chen , Maoliang Li , Xinhao Sun , Hailong Zou , Guojie Luo , Xiang Chen

Image and language modeling is of crucial importance for vision-language pre-training (VLP), which aims to learn multi-modal representations from large-scale paired image-text data. However, we observe that most existing VLP methods focus…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Sunan He , Taian Guo , Tao Dai , Ruizhi Qiao , Chen Wu , Xiujun Shu , Bo Ren