English
Related papers

Related papers: DVGBench: Implicit-to-Explicit Visual Grounding Be…

200 papers

Visual grounding is a common vision task that involves grounding descriptive sentences to the corresponding regions of an image. Most existing methods use independent image-text encoding and apply complex hand-crafted modules or…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Ming Dai , Lingfeng Yang , Yihao Xu , Zhenhua Feng , Wankou Yang

Vision-Language Models (VLMs) frequently misread values, hallucinate details, and confuse overlapping elements in charts. Current approaches rely solely on pixel interpretation, creating a Pixel-Only Bottleneck: agents treat interactive…

Computation and Language · Computer Science 2026-04-24 Yiyang Lu , Woong Shin , Ahmad Maroof Karimi , Feiyi Wang , Jie Ren , Evgenia Smirni

AI models have achieved state-of-the-art results in textual reasoning; however, their ability to reason over spatial and relational structures remains a critical bottleneck -- particularly in early-grade maths, which relies heavily on…

Large Vision-Language Models (LVLMs) achieve impressive performance across multiple tasks. A significant challenge, however, is their prohibitive inference cost when processing high-resolution visual inputs. While visual token pruning has…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Zhichao Sun , Yidong Ma , Gang Liu , Yibo Chen , Xu Tang , Yao Hu , Yongchao Xu

Medical Vision-Language Models (Med-VLMs) have achieved expert-level proficiency in interpreting diagnostic imaging. However, current models are predominantly trained on professional literature, limiting their ability to communicate…

Computation and Language · Computer Science 2026-04-08 Han Jang , Junhyeok Lee , Heeseong Eum , Kyu Sung Choi

While multimodal large language models (MLLMs) have demonstrated extraordinary vision-language understanding capabilities, their abilities to solve instance-level visual-language problems beyond a single image warrant further exploration.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Yunqiu Xu , Linchao Zhu , Yi Yang

Vision-language models (VLMs) have recently shown remarkable zero-shot performance in medical image understanding, yet their grounding ability, the extent to which textual concepts align with visual evidence, remains underexplored. In the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Haozhe Luo , Shelley Zixin Shu , Ziyu Zhou , Sebastian Otalora , Mauricio Reyes

With recent advances in Multimodal Large Language Models (MLLMs), grounding and referring capabilities have gained increasing attention for achieving detailed understanding and flexible user interaction. However, these capabilities still…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Yinan Zhou , Yuxin Chen , Haokun Lin , Yichen Wu , Shuyu Yang , Zhongang Qi , Chen Ma , Li Zhu , Ying Shan

While Visual Large Language Models (VLLMs) show great promise as embodied agents, they continue to face substantial challenges in spatial reasoning. Existing embodied benchmarks largely focus on passive, static household environments and…

Robotics · Computer Science 2025-11-24 Yifan Li , Lichi Li , Anh Dao , Xinyu Zhou , Yicheng Qiao , Zheda Mai , Daeun Lee , Zichen Chen , Zhen Tan , Mohit Bansal , Yu Kong

Constructing 4D language fields is crucial for embodied AI, augmented/virtual reality, and 4D scene understanding, as they provide enriched semantic representations of dynamic environments and enable open-vocabulary querying in complex…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Xianfeng Wu , Yajing Bai , Minghan Li , Xianzu Wu , Xueqi Zhao , Zhongyuan Lai , Wenyu Liu , Xinggang Wang

Lately, researchers in artificial intelligence have been really interested in how language and vision come together, giving rise to the development of multimodal models that aim to seamlessly integrate textual and visual information.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Rajat Chawla , Arkajit Datta , Tushar Verma , Adarsh Jha , Anmol Gautam , Ayush Vatsal , Sukrit Chaterjee , Mukunda NS , Ishaan Bhola

Visual grounding, the task of localizing objects described by natural-language expressions, is a foundational capability for agricultural AI systems, enabling applications such as selective weeding, disease monitoring, and targeted…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Haocheng Li , Juepeng Zheng , Zenghao Yang , Kaiqi Du , Guilong Xiao , Gengmeng Pu , Haohuan Fu , Jianxi Huang

Recently, researchers have attempted to investigate the capability of LLMs in handling videos and proposed several video LLM models. However, the ability of LLMs to handle video grounding (VG), which is an important time-related video task…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Wei Feng , Xin Wang , Hong Chen , Zeyang Zhang , Houlun Chen , Zihan Song , Yuwei Zhou , Yuekui Yang , Haiyang Wu , Wenwu Zhu

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance across diverse tasks. Despite great success, recent studies show that LVLMs encounter substantial limitations when engaging with visual graphs. To study the…

Computation and Language · Computer Science 2025-06-09 Yingjie Zhu , Xuefeng Bai , Kehai Chen , Yang Xiang , Jun Yu , Min Zhang

While reinforcement learning (RL) over chains of thought has significantly advanced language models in tasks such as mathematics and coding, visual reasoning introduces added complexity by requiring models to direct visual attention,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Gabriel Sarch , Snigdha Saha , Naitik Khandelwal , Ayush Jain , Michael J. Tarr , Aviral Kumar , Katerina Fragkiadaki

We present a conceptual framework for training Vision-Language Models (VLMs) to perform Visual Perspective Taking (VPT), a core capability for embodied cognition essential for Human-Robot Interaction (HRI). As a first step toward this goal,…

Artificial Intelligence · Computer Science 2025-05-21 Joel Currie , Gioele Migno , Enrico Piacenti , Maria Elena Giannaccini , Patric Bach , Davide De Tommaso , Agnieszka Wykowska

Vision-language models (VLMs) have shown impressive zero- and few-shot performance on real-world visual question answering (VQA) benchmarks, alluding to their capabilities as visual reasoning engines. However, the benchmarks being used…

Computation and Language · Computer Science 2024-09-04 Aishik Nagar , Shantanu Jaiswal , Cheston Tan

Visual grounding is essential for precise perception and reasoning in multimodal large language models (MLLMs), especially in medical imaging domains. While existing medical visual grounding benchmarks primarily focus on single-image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Jingkun Yue , Siqi Zhang , Zinan Jia , Huihuan Xu , Zongbo Han , Xiaohong Liu , Guangyu Wang

As Vision-Language Models (VLMs) grow in sophistication, their ability to perform reasoning is coming under increasing supervision. While they excel at many tasks, their grasp of fundamental scientific principles, such as physics, remains…

Machine Learning · Computer Science 2025-09-11 Pranav Pawar , Kavish Shah , Akshat Bhalani , Komal Kasat , Dev Mittal , Hadi Gala , Deepali Patil , Nikita Raichada , Monali Deshmukh

Existing UAV vision-language navigation (VLN) benchmarks have enabled language-guided flight, but they largely focus on long, step-wise route descriptions with goal-centric evaluation, making them less diagnostic for real operations where…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Jingyu Guo , Ziye Chen , Ziwen Li , Zhengqing Gao , Jiaxin Huang , Hanlue Zhang , Fengming Huang , Yu Yao , Tongliang Liu , Mingming Gong