中文
相关论文

相关论文: Edge-Based Multimodal Sensor Data Fusion with Visi…

200 篇论文

Multi-view cooperative perception and multimodal fusion are essential for reliable 3D spatiotemporal understanding in autonomous driving, especially under occlusions, limited viewpoints, and communication delays in V2X scenarios. This paper…

计算机视觉与模式识别 · 计算机科学 2025-12-29 Zhenwei Yang , Yibo Ai , Weidong Zhang

Vision-Language Models (VLMs) enable multimodal reasoning for robotic perception and interaction, but their deployment in real-world systems remains constrained by latency, limited onboard resources, and privacy risks of cloud offloading.…

机器人学 · 计算机科学 2026-01-22 Sarat Ahmad , Maryam Hafeez , Syed Ali Raza Zaidi

Cooperative perception enhances autonomous driving by leveraging Vehicle-to-Everything (V2X) communication for multi-agent sensor fusion. However, most existing methods rely on single-modal data sharing, limiting fusion performance,…

机器人学 · 计算机科学 2025-09-25 Lantao Li , Kang Yang , Wenqi Zhang , Xiaoxue Wang , Chen Sun

This paper introduces VLMFusionOcc3D, a robust multimodal framework for dense 3D semantic occupancy prediction in autonomous driving. Current voxel-based occupancy models often struggle with semantic ambiguity in sparse geometric grids and…

计算机视觉与模式识别 · 计算机科学 2026-03-04 A. Enes Doruk , Hasan F. Ates

Environmental perception is a key element of autonomous driving because the information received from the perception module influences core driving decisions. An outstanding challenge in real-time perception for autonomous driving lies in…

计算机视觉与模式识别 · 计算机科学 2023-08-11 Faisal Hawlader , François Robinet , Raphaël Frank

Vision-Language-Action (VLA) models have emerged as a promising paradigm for end-to-end autonomous driving, yet their reliance on implicit parametric knowledge limits generalization in long-tail scenarios. While Retrieval-Augmented…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Rui Zhao , Haofeng Hu , Zhenhai Gao , Jiaqiao Liu , Gao Fei

Neural Networks (NNs) trained through supervised learning struggle with managing edge-case scenarios common in real-world driving due to the intractability of exhaustive datasets covering all edge-cases, making knowledge-driven approaches,…

人工智能 · 计算机科学 2025-04-17 Nicolas Baumann , Cheng Hu , Paviththiren Sivasothilingam , Haotong Qin , Lei Xie , Michele Magno , Luca Benini

Temporal perception, defined as the capability to detect and track objects across temporal sequences, serves as a fundamental component in autonomous driving systems. While single-vehicle perception systems encounter limitations, stemming…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Zhenwei Yang , Jilei Mao , Wenxian Yang , Yibo Ai , Yu Kong , Haibao Yu , Weidong Zhang

Recent advancements in end-to-end autonomous driving systems (ADSs) underscore their potential for perception and planning capabilities. However, challenges remain. Complex driving scenarios contain rich semantic information, yet ambiguous…

机器人学 · 计算机科学 2025-11-18 Haowen Jiang , Xinyu Huang , You Lu , Dingji Wang , Yuheng Cao , Chaofeng Sha , Bihuan Chen , Keyu Chen , Xin Peng

Autonomous cars need geometric accuracy and semantic understanding to navigate complex environments, yet most stacks handle them separately. We present XYZ-Drive, a single vision-language model that reads a front-camera frame, a 25m…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Santosh Patapati , Trisanth Srinivasan , Murari Ambati

Real-time urban traffic surveillance is vital for Intelligent Transportation Systems (ITS) to ensure road safety, optimize traffic flow, track vehicle trajectories, and prevent collisions in smart cities. Deploying edge cameras across urban…

网络与互联网体系结构 · 计算机科学 2025-09-26 Murat Arda Onsu , Poonam Lohan , Burak Kantarci , Aisha Syed , Matthew Andrews , Sean Kennedy

This paper presents EdgeLoc, an infrastructure-assisted, real-time localization system for autonomous driving that addresses the incompatibility between traditional localization methods and deep learning approaches. The system is built on…

分布式、并行与集群计算 · 计算机科学 2024-06-11 Boyi Liu , Jingwen Tong , Yufan Zhuang

Effectively integrating Large Language Models (LLMs) into autonomous driving requires a balance between leveraging high-level reasoning and maintaining real-time efficiency. Existing approaches either activate LLMs too frequently, causing…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Ruifei Zhang , Junlin Xie , Wei Zhang , Weikai Chen , Xiao Tan , Xiang Wan , Guanbin Li

For end-to-end autonomous driving (E2E-AD), the evaluation system remains an open problem. Existing closed-loop evaluation protocols usually rely on simulators like CARLA being less realistic; while NAVSIM using real-world vision data, yet…

机器人学 · 计算机科学 2024-12-16 Junqi You , Xiaosong Jia , Zhiyuan Zhang , Yutao Zhu , Junchi Yan

This paper addresses the problem of 3D referring expression comprehension (REC) in autonomous driving scenario, which aims to ground a natural language to the targeted region in LiDAR point clouds. Previous approaches for REC usually focus…

计算机视觉与模式识别 · 计算机科学 2023-05-26 Wenhao Cheng , Junbo Yin , Wei Li , Ruigang Yang , Jianbing Shen

Recently, data-driven trajectory prediction methods have achieved remarkable results, significantly advancing the development of autonomous driving. However, the instability of single-vehicle perception introduces certain limitations to…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Kangyu Wu , Jiaqi Qiao , Ya Zhang

A key challenge for autonomous driving lies in maintaining real-time situational awareness regarding surrounding obstacles under strict latency constraints. The high processing requirements coupled with limited onboard computational…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Faisal Hawladera , Rui Meireles , Gamal Elghazaly , Ana Aguiar , Raphaël Frank

Vision-Language-Action (VLA) driving augments end-to-end (E2E) planning with language-enabled backbones, yet it remains unclear what changes beyond the usual accuracy--cost trade-off. We revisit this question with 3--RQ analysis in…

机器人学 · 计算机科学 2026-02-12 Sining Ang , Yuguang Yang , Chenxu Dang , Canyu Chen , Cheng Chi , Haiyan Liu , Xuanyao Mao , Jason Bao , Xuliang , Bingchuan Sun , Yan Wang

End-to-End (E2E) solutions have emerged as a mainstream approach for autonomous driving systems, with Vision-Language-Action (VLA) models representing a new paradigm that leverages pre-trained multimodal knowledge from Vision-Language…

机器人学 · 计算机科学 2025-09-25 Pengxiang Li , Yinan Zheng , Yue Wang , Huimin Wang , Hang Zhao , Jingjing Liu , Xianyuan Zhan , Kun Zhan , Xianpeng Lang

Multimodal large language models (MLLMs) have shown strong capability in semantic understanding and visual reasoning, yet their use on continuous video streams in bandwidth-constrained edge-cloud systems incurs prohibitive computation and…

多媒体 · 计算机科学 2026-04-08 Qi Guo , Zheming Yang , Yunqing Hu , Chang Zhao , Wen Ji