English
Related papers

Related papers: DVGBench: Implicit-to-Explicit Visual Grounding Be…

200 papers

Recent advancements in Large Vision-Language Models (LVLMs) have demonstrated remarkable multimodal perception capabilities, garnering significant attention. While numerous evaluation studies have emerged, assessing LVLMs both holistically…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Hong-Tao Yu , Yuxin Peng , Serge Belongie , Xiu-Shen Wei

Fine-grained multimodal capability in Multimodal Large Language Models (MLLMs) has emerged as a critical research direction, particularly for tackling the visual grounding (VG) problem. Despite the strong performance achieved by existing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Weitai Kang , Weiming Zhuang , Zhizhong Li , Yan Yan , Lingjuan Lyu

Vision-Language Navigation (VLN) aims to guide agents by leveraging language instructions and visual cues, playing a pivotal role in embodied AI. Indoor VLN has been extensively studied, whereas outdoor aerial VLN remains underexplored. The…

Vision-Language Models (VLMs) have emerged as powerful tools for image understanding tasks, yet their practical deployment remains hindered by significant architectural heterogeneity across model families. This paper introduces UVLM…

Machine Learning · Computer Science 2026-03-17 Joan Perez , Giovanni Fusco

Vision-language generative reward models (VL-GenRMs) play a crucial role in aligning and evaluating multimodal AI systems, yet their own evaluation remains under-explored. Current assessment methods primarily rely on AI-annotated preference…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Lei Li , Yuancheng Wei , Zhihui Xie , Xuqing Yang , Yifan Song , Peiyi Wang , Chenxin An , Tianyu Liu , Sujian Li , Bill Yuchen Lin , Lingpeng Kong , Qi Liu

Visual target navigation is a critical capability for autonomous robots operating in unknown environments, particularly in human-robot interaction scenarios. While classical and learning-based methods have shown promise, most existing…

Robotics · Computer Science 2025-05-07 Bangguo Yu , Qihao Yuan , Kailai Li , Hamidreza Kasaei , Ming Cao

Large Vision-Language Models (LVLMs) often produce responses that misalign with factual information, a phenomenon known as hallucinations. While hallucinations are well-studied, the exact causes behind them remain underexplored. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Sreyan Ghosh , Chandra Kiran Reddy Evuru , Sonal Kumar , Utkarsh Tyagi , Oriol Nieto , Zeyu Jin , Dinesh Manocha

We introduce RGB-Th-Bench, the first benchmark designed to evaluate the ability of Vision-Language Models (VLMs) to comprehend RGB-Thermal image pairs. While VLMs have demonstrated remarkable progress in visual reasoning and multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Mehdi Moshtaghi , Siavash H. Khajavi , Joni Pajarinen

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance in complex multimodal tasks. However, these models still suffer from hallucinations, particularly when required to implicitly recognize or infer diverse visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ashish Seth , Dinesh Manocha , Chirag Agarwal

Visual grounding (VG) aims at locating the foreground entities that match the given natural language expressions. Previous datasets and methods for classic VG task mainly rely on the prior assumption that the given expression must literally…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Wenxuan Wang , Yisi Zhang , Xingjian He , Yichen Yan , Zijia Zhao , Xinlong Wang , Jing Liu

Grounding language in the physical world requires AI systems to interpret references that emerge dynamically during conversation. While current vision-language models (VLMs) excel at static image tasks, they struggle to resolve ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Anna Deichler , Jim O'Regan , Fethiye Irmak Dogan , Lubos Marcinek , Anna Klezovich , Iolanda Leite , Jonas Beskow

Recent advancements in Large Vision-Language Models (VLMs), have greatly enhanced their capability to jointly process text and images. However, despite extensive benchmarks evaluating visual comprehension (e.g., diagrams, color schemes, OCR…

Computation and Language · Computer Science 2025-05-27 Benjamin Clavié , Florian Brand

Assessing progress toward the Sustainable Development Goals (SDGs) requires multi-step reasoning over visual cues, contextual knowledge, and development indicators, where incomplete evidence use and imperfect evidence integration can…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Zihang Lin , Huaiyuan Qin , Muli Yang , Hongyuan Zhu

Recent advancements in Large Vision-Language Models (VLMs) have shown great promise in natural image domains, allowing users to hold a dialogue about given visual content. However, such general-domain VLMs perform poorly for Remote Sensing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Kartik Kuckreja , Muhammad Sohail Danish , Muzammal Naseer , Abhijit Das , Salman Khan , Fahad Shahbaz Khan

While numerous recent benchmarks focus on evaluating generic Vision-Language Models (VLMs), they do not effectively address the specific challenges of geospatial applications. Generic VLM benchmarks are not designed to handle the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Muhammad Sohail Danish , Muhammad Akhtar Munir , Syed Roshaan Ali Shah , Kartik Kuckreja , Fahad Shahbaz Khan , Paolo Fraccaro , Alexandre Lacoste , Salman Khan

Recent advancements in Vision Language Models (VLMs) have demonstrated remarkable promise in generating visually grounded responses. However, their application in the medical domain is hindered by unique challenges. For instance, most VLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Lingxiao Luo , Bingda Tang , Xuanzhong Chen , Rong Han , Ting Chen

Vision-language models (VLMs) have achieved remarkable success in scene understanding and perception tasks, enabling robots to plan and execute actions adaptively in dynamic environments. However, most multimodal large language models lack…

Robotics · Computer Science 2025-02-14 Guoqin Tang , Qingxuan Jia , Zeyuan Huang , Gang Chen , Ning Ji , Zhipeng Yao

Vision-Language Models (VLMs) enable multimodal reasoning for robotic perception and interaction, but their deployment in real-world systems remains constrained by latency, limited onboard resources, and privacy risks of cloud offloading.…

Robotics · Computer Science 2026-01-22 Sarat Ahmad , Maryam Hafeez , Syed Ali Raza Zaidi

Synergistic spatial intelligence between UAVs and satellites is indispensable for emergency response and security operations, as it uniquely integrates macro-scale global coverage with dynamic, real-time local perception. However, the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Dian Liu , Jie Feng , Di Li , Yuhui Zheng , Guanbin Li , Weisheng Dong , Guangming Shi

Grounding large language models (LLMs) in domain-specific tasks like post-hoc dash-cam driving video analysis is challenging due to their general-purpose training and lack of structured inductive biases. As vision is often the sole modality…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Manyi Yao , Bingbing Zhuang , Sparsh Garg , Amit Roy-Chowdhury , Christian Shelton , Manmohan Chandraker , Abhishek Aich