中文
相关论文

相关论文: Can Vision-Language Models Understand and Interpre…

200 篇论文

Recent developments in vision language models (VLM) have shown great potential for diverse applications related to image understanding. In this study, we have explored state-of-the-art VLM models for vision-based transportation engineering…

计算机视觉与模式识别 · 计算机科学 2024-09-05 Sanjita Prajapati , Tanu Singh , Chinmay Hegde , Pranamesh Chakraborty

Pedestrian gestures play an important role in traffic communication, particularly in interactions with autonomous vehicles (AVs), yet their subtle, ambiguous, and context-dependent nature poses persistent challenges for machine…

Predicting pedestrian behavior is the key to ensure safety and reliability of autonomous vehicles. While deep learning methods have been promising by learning from annotated video frame sequences, they often fail to fully grasp the dynamic…

计算机视觉与模式识别 · 计算机科学 2024-01-29 Jia Huang , Peng Jiang , Alvika Gautam , Srikanth Saripalli

Vision-language models (VLMs) have become a promising approach to enhancing perception and decision-making in autonomous driving. The gap remains in applying VLMs to understand complex scenarios interacting with pedestrians and efficient…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Haoxiang Gao , Li Zhang , Yu Zhao , Zhou Yang , Jinghan Cao

Vision-Language Models (VLMs) have recently shown remarkable progress in multimodal reasoning, yet their applications in autonomous driving remain limited. In particular, the ability to understand road topology, a key requirement for safe…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Xin Chen , Jia He , Maozheng Li , Dongliang Xu , Tianyu Wang , Yixiao Chen , Zhixin Lin , Yue Yao

Pedestrian safety is a critical component of urban mobility and is strongly influenced by the interactions between pedestrian decision-making and driver yielding behavior at crosswalks. Modeling driver--pedestrian interactions at…

计算与语言 · 计算机科学 2025-09-25 Yicheng Yang , Zixian Li , Jean Paul Bizimana , Niaz Zafri , Yongfeng Dong , Tianyi Li

As robotics become increasingly integrated into construction workflows, their ability to interpret and respond to human behavior will be essential for enabling safe and effective collaboration. Vision-Language Models (VLMs) have emerged as…

计算机视觉与模式识别 · 计算机科学 2026-01-19 Hieu Bui , Nathaniel E. Chodosh , Arash Tavakoli

Visual perspective-taking (VPT), the ability to understand the viewpoint of another person, enables individuals to anticipate the actions of other people. For instance, a driver can avoid accidents by assessing what pedestrians see. Humans…

计算与语言 · 计算机科学 2024-09-23 Gracjan Góral , Alicja Ziarko , Michal Nauman , Maciej Wołczyk

Effectively understanding urban scenes requires fine-grained spatial reasoning about objects, layouts, and depth cues. However, how well current vision-language models (VLMs), pretrained on general scenes, transfer these abilities to urban…

计算机视觉与模式识别 · 计算机科学 2025-09-01 Juneyoung Ro , Namwoo Kim , Yoonjin Yoon

Vision Language Models (VLMs) have been successful at many chart comprehension tasks that require attending to both the images of charts and their accompanying textual descriptions. However, it is not well established how VLM performance…

人工智能 · 计算机科学 2024-11-04 Grace Guo , Jenna Jiayi Kang , Raj Sanjay Shah , Hanspeter Pfister , Sashank Varma

Driver visual attention prediction is a critical task in autonomous driving and human-computer interaction (HCI) research. Most prior studies focus on estimating attention allocation at a single moment in time, typically using static RGB…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Kaiser Hamid , Khandakar Ashrafi Akbar , Nade Liang

Large-scale Vision Language Models (LVLMs) exhibit advanced capabilities in tasks that require visual information, including object detection. These capabilities have promising applications in various industrial domains, such as autonomous…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Haruki Sakajo , Hiroshi Takato , Hiroshi Tsutsui , Komei Soda , Hidetaka Kamigaito , Taro Watanabe

Vision-language models (VLMs) have recently emerged as powerful representation learning systems that align visual observations with natural language concepts, offering new opportunities for semantic reasoning in safety-critical autonomous…

计算机视觉与模式识别 · 计算机科学 2026-02-19 Ross Greer , Maitrayee Keskar , Angel Martinez-Sanchez , Parthib Roy , Shashank Shriram , Mohan Trivedi

Following road safety norms is non-negotiable not only for humans but also for the AI systems that govern autonomous vehicles. In this work, we evaluate how well multi-modal large language models (LLMs) understand road safety concepts,…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Chalamalasetti Kranti

Addressing hard cases in autonomous driving, such as anomalous road users, extreme weather conditions, and complex traffic interactions, presents significant challenges. To ensure safety, it is crucial to detect and manage these scenarios…

计算机视觉与模式识别 · 计算机科学 2024-06-03 Yi Yang , Qingwen Zhang , Kei Ikemura , Nazre Batool , John Folkesson

Vision-Language Models (VLMs) are becoming increasingly powerful, demonstrating strong performance on a variety of tasks that require both visual and textual understanding. Their strong generalisation abilities make them a promising…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Nikos Theodoridis , Tim Brophy , Reenu Mohandas , Ganesh Sistu , Fiachra Collins , Anthony Scanlan , Ciaran Eising

The use of Vision-Language Models (VLMs) in automated driving applications is becoming increasingly common, with the aim of leveraging their reasoning and generalisation capabilities to handle long tail scenarios. However, these models…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Nikos Theodoridis , Reenu Mohandas , Ganesh Sistu , Anthony Scanlan , Ciarán Eising , Tim Brophy

Temporal understanding in autonomous driving (AD) remains a significant challenge, even for recent state-of-the-art (SoTA) Vision-Language Models (VLMs). Prior work has introduced datasets and benchmarks aimed at improving temporal…

Urban monitoring of public infrastructure (such as waste bins, road signs, vegetation, sidewalks, and construction sites) poses significant challenges due to the diversity of objects, environments, and contextual conditions involved.…

计算机视觉与模式识别 · 计算机科学 2025-10-15 André Torneiro , Diogo Monteiro , Paulo Novais , Pedro Rangel Henriques , Nuno F. Rodrigues

Autonomous driving systems often infer pedestrian yielding behavior from geometric and kinematic cues alone, limiting their ability to reason about visual scene context and age-dependent behavioral variability. This limitation can produce…

系统与控制 · 电气工程与系统科学 2026-04-28 Qingwen Pu , Kun Xie , Yuxiang Liu
‹ 上一页 1 2 3 10 下一页 ›