English
Related papers

Related papers: Bridging Structure and Language: Graph-Based Visua…

200 papers

Vision-language models (VLMs) have shown a promising ability in image geolocation, but they still lack structured geographic reasoning and the capacity for autonomous self-evolution. Existing methods predominantly rely on implicit…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Chenjie Yang , Yutian Jiang , Yutong Deng , Chenyu Wu

Coverage analysis is essential for validating the safety of autonomous driving systems, yet existing approaches typically assess coverage factors individually or in limited combinations, struggling to capture the complex interactions…

Methodology · Statistics 2026-02-03 Thomas Muehlenstädt , Marius Bause

Crash detection from video feeds is a critical problem in intelligent transportation systems. Recent developments in large language models (LLMs) and vision-language models (VLMs) have transformed how we process, reason about, and summarize…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Sanjeda Akter , Ibne Farabi Shihab , Anuj Sharma

Cross-view geo-localization (CVGL) aims to estimate the geographic location of a street image by matching it with a corresponding aerial image. This is critical for autonomous navigation and mapping in complex real-world scenarios. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Songsong Ouyang , Yingying Zhu

While Graph Foundation Models (GFMs) have achieved remarkable success in homogeneous graphs, extending them to multi-domain heterogeneous graphs (MDHGs) remains a formidable challenge due to cross-type feature shifts and intra-domain…

Social and Information Networks · Computer Science 2026-05-04 Ziyu Zheng , Yaming Yang , Zhe Wang , Ziyu Guan , Wei Zhao

Topology is critical in tubular structures such as blood vessels, nerve fibers, and road networks, where connectivity and loop structure govern downstream functional analysis. Vision-Language Models (VLMs) are promising candidates for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Meilong Xu , Qingqiao Hu , Xiaoling Hu , Shahira Abousamra , Xin Yu , Weimin Lyu , Kehan Qi , Dimitris Samaras , Chao Chen

Vision-language models (VLMs) have shown promise in graph structure understanding, but remain limited by input-token constraints, facing scalability bottlenecks and lacking effective mechanisms to coordinate textual and visual modalities.…

Artificial Intelligence · Computer Science 2026-01-12 Shuo Han , Yukun Cao , Zezhong Ding , Zengyi Gao , S Kevin Zhou , Xike Xie

Referential grounding in outdoor driving scenes is challenging due to large scene variability, many visually similar objects, and dynamic elements that complicate resolving natural-language references (e.g., "the black car on the right").…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Pranav Saxena , Avigyan Bhattacharya , Ji Zhang , Wenshan Wang

Automated perception of urban roadside infrastructure is crucial for smart city management, yet general-purpose models often struggle to capture the necessary fine-grained attributes and domain rules. While Large Vision Language Models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Luxuan Fu , Chong Liu , Bisheng Yang , Zhen Dong

Direction reasoning is essential for intelligent systems to understand the real world. While existing work focuses primarily on spatial reasoning, compass direction reasoning remains underexplored. To address this, we propose the Compass…

Artificial Intelligence · Computer Science 2024-12-24 Hang Yin , Zhifeng Lin , Xin Liu , Bin Sun , Kan Li

Current Visual Simultaneous Localization and Mapping (VSLAM) systems often struggle to create maps that are both semantically rich and easily interpretable. While incorporating semantic scene knowledge aids in building richer maps with…

Graph-based representations such as Scene Graphs enable localization in structured indoor environments by matching a locally observed graph, constructed from sensor data, to a prior map. This process is particularly challenging in…

Recent years have witnessed rapid advances in graph representation learning, with the continuous embedding approach emerging as the dominant paradigm. However, such methods encounter issues regarding parameter efficiency, interpretability,…

Machine Learning · Computer Science 2026-01-22 Qika Lin , Zhen Peng , Kaize Shi , Kai He , Yiming Xu , Jian Zhang , Erik Cambria , Mengling Feng

Large Language Models (LLMs) show potential for enhancing robotic path planning. This paper assesses visual input's utility for multimodal LLMs in such tasks via a comprehensive benchmark. We evaluated 15 multimodal LLMs on generating valid…

Robotics · Computer Science 2025-07-17 Jacinto Colan , Ana Davila , Yasuhisa Hasegawa

Top-view perspective denotes a typical way in which humans read and reason over different types of maps, and it is vital for localization and navigation of humans as well as of `non-human' agents, such as the ones backed by large…

Computation and Language · Computer Science 2024-06-05 Chengzu Li , Caiqi Zhang , Han Zhou , Nigel Collier , Anna Korhonen , Ivan Vulić

Large language models have shown impressive results for multi-hop mathematical reasoning when the input question is only textual. Many mathematical reasoning problems, however, contain both text and image. With the ever-increasing adoption…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Mehran Kazemi , Hamidreza Alvari , Ankit Anand , Jialin Wu , Xi Chen , Radu Soricut

Large vision-language models (VLMs) have garnered increasing interest in autonomous driving areas, due to their advanced capabilities in complex reasoning tasks essential for highly autonomous vehicle behavior. Despite their potential,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ming Nie , Renyuan Peng , Chunwei Wang , Xinyue Cai , Jianhua Han , Hang Xu , Li Zhang

Autonomous driving systems depend on on models that can reason about high-level scene contexts and accurately predict the dynamics of their surrounding environment. Vision- Language Models (VLMs) have recently emerged as promising tools for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Stefan Englmeier , Katharina Winter , Fabian B. Flohr

The integration of electric vehicles (EVs) into smart grids presents unique opportunities to enhance both transportation systems and energy networks. However, ensuring safe and interpretable interactions between drivers, vehicles, and the…

Artificial Intelligence · Computer Science 2025-10-06 Jean Douglas Carvalho , Hugo Kenji , Ahmad Mohammad Saber , Glaucia Melo , Max Mauro Dias Santos , Deepa Kundur

Laboratories are prone to severe injuries from minor unsafe actions, yet continuous safety monitoring -- beyond mandatory pre-lab safety training -- is limited by human availability. Vision language models (VLMs) offer promise for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Trishna Chakraborty , Udita Ghosh , Aldair Ernesto Gongora , Ruben Glatt , Yue Dong , Jiachen Li , Amit K. Roy-Chowdhury , Chengyu Song