中文
相关论文

相关论文: Edge-Based Multimodal Sensor Data Fusion with Visi…

200 篇论文

Vision-Language Models (VLMs) and Multi-Modal Language models (MMLMs) have become prominent in autonomous driving research, as these models can provide interpretable textual reasoning and responses for end-to-end autonomous driving safety…

计算机视觉与模式识别 · 计算机科学 2024-05-10 Akshay Gopalkrishnan , Ross Greer , Mohan Trivedi

Formation control of wheeled mobile robots (WMRs) has been extensively studied due to its broad applications in fields such as logistics transportation, environmental monitoring, and search and rescue. However, most existing works mainly…

机器人学 · 计算机科学 2026-05-19 Jianghong Dong , Yifeng Zhang , Jiawei Wang , Mengchi Cai , Keqiang Li , Guillaume Sartoretti

Autonomous edge computing in robotics, smart cities, and autonomous vehicles relies on the seamless integration of sensing, processing, and actuation for real-time decision-making in dynamic environments. At its core is the…

The safe deployment of autonomous driving systems (ADSs) relies on comprehensive testing and evaluation. However, safety-critical scenarios that can effectively expose system vulnerabilities are extremely sparse in the real world. Existing…

机器人学 · 计算机科学 2025-12-03 Xinzheng Wu , Junyi Chen , Naiting Zhong , Yong Shen

In this paper, we propose a novel framework for enhancing visual comprehension in autonomous driving systems by integrating visual language models (VLMs) with additional visual perception module specialised in object detection. We extend…

计算机视觉与模式识别 · 计算机科学 2024-11-12 Linfeng He , Yiming Sun , Sihao Wu , Jiaxu Liu , Xiaowei Huang

Embodied outdoor scene understanding forms the foundation for autonomous agents to perceive, analyze, and react to dynamic driving environments. However, existing 3D understanding is predominantly based on 2D Vision-Language Models (VLMs),…

计算机视觉与模式识别 · 计算机科学 2025-09-15 Runwei Guan , Jianan Liu , Ningwei Ouyang , Shaofeng Liang , Daizong Liu , Xiaolou Sun , Lianqing Zheng , Ming Xu , Yutao Yue , Guoqiang Mao , Hui Xiong

Moving Object Detection (MOD) is a critical vision task for successfully achieving safe autonomous driving. Despite plausible results of deep learning methods, most existing approaches are only frame-based and may fail to reach reasonable…

计算机视觉与模式识别 · 计算机科学 2023-03-10 Zhuyun Zhou , Zongwei Wu , Rémi Boutteau , Fan Yang , Cédric Demonceaux , Dominique Ginhac

Accurate accident anticipation is essential for enhancing the safety of autonomous vehicles (AVs). However, existing methods often assume ideal conditions, overlooking challenges such as sensor failures, environmental disturbances, and data…

人工智能 · 计算机科学 2025-11-11 Xingcheng Liu , Yanchen Guan , Haicheng Liao , Zhengbing He , Zhenning Li

Traffic collision reconstruction traditionally relies on human expertise and can be accurate, but pre-crash reconstruction is more challenging. This study develops a multi-agent AI framework that reconstructs pre-crash scenarios and infers…

人工智能 · 计算机科学 2026-04-03 Gerui Xu , Boyou Chen , Huizhong Guo , Dave LeBlanc , Arpan Kusari , Efe Yarbasi , Ananna Ahmed , Zhaonan Sun , Shan Bao

Integrating large language models (LLMs) into autonomous driving motion planning has recently emerged as a promising direction, offering enhanced interpretability, better controllability, and improved generalization in rare and long-tail…

人工智能 · 计算机科学 2025-07-29 Zhipeng Tang , Sha Zhang , Jiajun Deng , Chenjie Wang , Guoliang You , Yuting Huang , Xinrui Lin , Yanyong Zhang

V2X cooperation, through the integration of sensor data from both vehicles and infrastructure, is considered a pivotal approach to advancing autonomous driving technology. Current research primarily focuses on enhancing perception accuracy,…

计算机视觉与模式识别 · 计算机科学 2024-05-08 Zhiwei Li , Bozhen Zhang , Lei Yang , Tianyu Shen , Nuo Xu , Ruosen Hao , Weiting Li , Tao Yan , Huaping Liu

In this work, we study how vision-language models (VLMs) can be utilized to enhance the safety for the autonomous driving system, including perception, situational understanding, and path planning. However, existing research has largely…

人工智能 · 计算机科学 2025-07-30 Hao Ye , Mengshi Qi , Zhaohong Liu , Liang Liu , Huadong Ma

Current LLM-based driving agents that rely on unstructured plain-text memory suffer from low-precision scene retrieval and inefficient reflection. To address this limitation, we present RESPOND, a structured decision-making framework for…

人机交互 · 计算机科学 2025-12-24 Dan Chen , Heye Huang , Tiantian Chen , Zheng Li , Yongji Li , Yuhui Xu , Sikai Chen

End-to-end autonomous driving systems promise stronger performance through unified optimization of perception, motion forecasting, and planning. However, vision-based approaches face fundamental limitations in adverse weather conditions,…

计算机视觉与模式识别 · 计算机科学 2025-08-15 Philipp Wolters , Johannes Gilg , Torben Teepe , Gerhard Rigoll

Reinforcement Learning (RL) has emerged as a dominant paradigm for end-to-end autonomous driving (AD). However, RL suffers from sample inefficiency and a lack of semantic interpretability in complex scenarios. Foundation Models,…

人工智能 · 计算机科学 2026-02-12 Yansong Qu , Zihao Sheng , Zilin Huang , Jiancong Chen , Yuhao Luo , Tianyi Wang , Yiheng Feng , Samuel Labi , Sikai Chen

Vision-language models (VLMs) serve as general-purpose end-to-end models in autonomous driving, performing subtasks such as prediction, planning, and perception through question-and-answer interactions. However, most existing methods rely…

计算机视觉与模式识别 · 计算机科学 2025-05-22 Enming Zhang , Xingyuan Dai , Min Huang , Yisheng Lv , Qinghai Miao

Single-vehicle Vision-Language Models (VLMs) are fundamentally constrained by sensor occlusions. While Vehicle-to-Everything (V2X) systems mitigate this, current benchmarks lack the cooperative reasoning required for resolving ambiguities…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Kevin Richard , Alphin Varghese , Colin Pham , David Oh , Srijan Das

End-to-end autonomous driving (AD) systems increasingly adopt vision-language-action (VLA) models, yet they typically ignore the passenger's emotional state, which is central to comfort and AD acceptance. We introduce Open-Domain End-to-End…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Yihong Tang , Haicheng Liao , Tong Nie , Junlin He , Ao Qu , Kehua Chen , Wei Ma , Zhenning Li , Lijun Sun , Chengzhong Xu

Vision-Language Action (VLA) models unify perception, reasoning, and trajectory generation for autonomous driving, but suffer from significant inference latency due to deep transformer stacks. We present DeeAD, a training-free,…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Haibo HU , Lianming Huang , Nan Guan , Chun Jason Xue

Occlusion is a major challenge for LiDAR-based object detection methods. This challenge becomes safety-critical in urban traffic where the ego vehicle must have reliable object detection to avoid collision while its field of view is…

机器人学 · 计算机科学 2023-09-20 Minh-Quan Dao , Julie Stephany Berrio , Vincent Frémont , Mao Shan , Elwan Héry , Stewart Worrall