中文
相关论文

相关论文: BEV-LLM: Leveraging Multimodal BEV Maps for Scene …

200 篇论文

Autonomous vehicles demand detailed maps to maneuver reliably through traffic, which need to be kept up-to-date to ensure a safe operation. A promising way to adapt the maps to the ever-changing road-network is to use crowd-sourced data…

机器人学 · 计算机科学 2024-10-11 Markus Herb , Nassir Navab , Federico Tombari

3D visual perception tasks, including 3D detection and map segmentation based on multi-camera images, are essential for autonomous driving systems. In this work, we present a new framework termed BEVFormer, which learns unified BEV…

计算机视觉与模式识别 · 计算机科学 2022-07-14 Zhiqi Li , Wenhai Wang , Hongyang Li , Enze Xie , Chonghao Sima , Tong Lu , Qiao Yu , Jifeng Dai

Accurate environment perception is essential for automated driving. When using monocular cameras, the distance estimation of elements in the environment poses a major challenge. Distances can be more easily estimated when the camera…

计算机视觉与模式识别 · 计算机科学 2020-05-11 Lennart Reiher , Bastian Lampe , Lutz Eckstein

Image captioning models tend to describe images in an object-centric way, emphasising visible objects. But image descriptions can also abstract away from objects and describe the type of scene depicted. In this paper, we explore the…

计算与语言 · 计算机科学 2022-11-11 Michele Cafagna , Kees van Deemter , Albert Gatt

Accurate prediction of communication link quality metrics is essential for vehicle-to-infrastructure (V2I) systems, enabling smooth handovers, efficient beam management, and reliable low-latency communication. The increasing availability of…

机器学习 · 计算机科学 2025-09-05 Kimia Ehsani , Walid Saad

Bird's-eye-view (BEV) representation is crucial for the perception function in autonomous driving tasks. It is difficult to balance the accuracy, efficiency and range of BEV representation. The existing works are restricted to a limited…

计算机视觉与模式识别 · 计算机科学 2024-07-12 Hang Wu , Zhenghao Zhang , Siyuan Lin , Tong Qin , Jin Pan , Qiang Zhao , Chunjing Xu , Ming Yang

Accurate localization in challenging garage environments -- marked by poor lighting, sparse textures, repetitive structures, dynamic scenes, and the absence of GPS -- is crucial for automated valet parking (AVP) tasks. Addressing these…

机器人学 · 计算机科学 2024-07-02 Ye Li , Wenchao Yang , Dekun Lin , Qianlei Wang , Zhe Cui , Xiaolin Qin

Autonomous mobile robots deployed in urban environments must be context-aware, i.e., able to distinguish between different semantic entities, and robust to occlusions. Current approaches like semantic scene completion (SSC) require…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Arthur Zhang , Rainier Heijne , Joydeep Biswas

Bird's-eye-view (BEV) semantic segmentation is becoming crucial in autonomous driving systems. It realizes ego-vehicle surrounding environment perception by projecting 2D multi-view images into 3D world space. Recently, BEV segmentation has…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Jian Sun , Yuqi Dai , Chi-Man Vong , Qing Xu , Shengbo Eben Li , Jianqiang Wang , Lei He , Keqiang Li

Existing LiDAR-based 3D object detection methods for autonomous driving scenarios mainly adopt the training-from-scratch paradigm. Unfortunately, this paradigm heavily relies on large-scale labeled data, whose collection can be expensive…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Zhiwei Lin , Yongtao Wang , Shengxiang Qi , Nan Dong , Ming-Hsuan Yang

The rise of multimodal large language models (MLLMs) has spurred interest in language-based driving tasks. However, existing research typically focuses on limited tasks and often omits key multi-view and temporal information which is…

计算机视觉与模式识别 · 计算机科学 2024-01-03 Xinpeng Ding , Jinahua Han , Hang Xu , Xiaodan Liang , Wei Zhang , Xiaomeng Li

Accurate localization ability is fundamental in autonomous driving. Traditional visual localization frameworks approach the semantic map-matching problem with geometric models, which rely on complex parameter tuning and thus hinder…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Zhihuang Zhang , Meng Xu , Wenqiang Zhou , Tao Peng , Liang Li , Stefan Poslad

In the landscape of autonomous driving, Bird's-Eye-View (BEV) representation has recently garnered substantial academic attention, serving as a transformative framework for the fusion of multi-modal sensor inputs. This BEV paradigm…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Yuxin Li , Yiheng Li , Xulei Yang , Mengying Yu , Zihang Huang , Xiaojun Wu , Chai Kiat Yeo

Scene simulation in autonomous driving has gained significant attention because of its huge potential for generating customized data. However, existing editable scene simulation approaches face limitations in terms of user interaction…

计算机视觉与模式识别 · 计算机科学 2024-06-27 Yuxi Wei , Zi Wang , Yifan Lu , Chenxin Xu , Changxing Liu , Hao Zhao , Siheng Chen , Yanfeng Wang

The task of image captioning demands an algorithm to generate natural language descriptions of visual inputs. Recent advancements have seen a convergence between image captioning research and the development of Large Language Models (LLMs)…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Davide Bucciarelli , Nicholas Moratelli , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Visual bird's eye view (BEV) semantic segmentation helps autonomous vehicles understand the surrounding environment only from images, including static elements (e.g., roads) and dynamic elements (e.g., vehicles, pedestrians). However, the…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Junyu Zhu , Lina Liu , Yu Tang , Feng Wen , Wanlong Li , Yong Liu

We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different view…

计算机视觉与模式识别 · 计算机科学 2021-10-20 Sudeep Fadadu , Shreyash Pandey , Darshan Hegde , Yi Shi , Fang-Chieh Chou , Nemanja Djuric , Carlos Vallespi-Gonzalez

Learning powerful representations in bird's-eye-view (BEV) for perception tasks is trending and drawing extensive attention both from industry and academia. Conventional approaches for most autonomous driving algorithms perform detection,…

Bird's-Eye View (BEV) maps provide a structured, top-down abstraction that is crucial for autonomous-driving perception. In this work, we employ Cross-View Transformers (CVT) for learning to map camera images to three BEV's channels - road,…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Felipe Carlos dos Santos , Eric Aislan Antonelo , Gustavo Claudio Karl Couto

In recent years, there has been a notable increase in the development of autonomous vehicle (AV) technologies aimed at improving safety in transportation systems. While AVs have been deployed in the real-world to some extent, a full-scale…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Shounak Sural , Naren , Ragunathan Rajkumar