English
Related papers

Related papers: Step-Level Visual Grounding Faithfulness Predicts …

200 papers

Vision-language-action models must enable agents to execute long-horizon tasks under partial observability. However, most existing approaches remain observation-driven, relying on short context windows or repeated queries to vision-language…

Artificial Intelligence · Computer Science 2026-02-26 Vaidehi Bagaria , Bijo Sebastian , Nirav Kumar Patel

Vision-Language Models (VLMs) demonstrate impressive capabilities across multimodal tasks, yet exhibit systematic spatial reasoning failures, achieving only 49% (CLIP) to 54% (BLIP-2) accuracy on basic directional relationships. For safe…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Muhammad Imran , Yugyung Lee

Hallucination, where models generate fluent text unsupported by visual evidence, remains a major flaw in vision-language models and is particularly critical in sign language translation (SLT). In SLT, meaning depends on precise grounding in…

A reliable driving assistant should provide consistent responses based on temporally grounded reasoning derived from observed information. In this work, we investigate whether Vision-Language Models (VLMs), when applied as driving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Chun-Peng Chang , Chen-Yu Wang , Holger Caesar , Alain Pagani

Large vision-and-language models (VLMs) trained to match images with text on large-scale datasets of image-text pairs have shown impressive generalization ability on several vision and language tasks. Several recent works, however, showed…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Navid Rajabi , Jana Kosecka

Large language models have achieved significant reasoning improvements through reinforcement learning with verifiable rewards (RLVR). Yet as model capabilities grow, constructing high-quality reward signals becomes increasingly difficult,…

Machine Learning · Computer Science 2026-04-21 Salman Rahman , Jingyan Shen , Anna Mordvina , Hamid Palangi , Saadia Gabriel , Pavel Izmailov

Multimodal reasoning models (MRMs) trained with reinforcement learning with verifiable rewards (RLVR) show improved accuracy on visual reasoning benchmarks. However, we observe that accuracy gains often come at the cost of reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Sai Srinivas Kancheti , Aditya Kanade , Rohit Sinha , Vineeth N Balasubramanian , Tanuja Ganu

Vision-language models (VLMs) are increasingly proposed as general-purpose tools for scientific data interpretation, yet their reliability on real astronomical observations across diverse modalities remains untested. We present…

Artificial Intelligence · Computer Science 2026-04-28 Wenke Ren , Hengxiao Guo , Wenwen Zuo , Xiaoman Zhang

Despite rapid progress, pretrained vision-language models still struggle when answers depend on tiny visual details or on combining clues spread across multiple regions, as in documents and compositional queries. We address this by framing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Marcel Gröpl , Jaewoo Jung , Seungryong Kim , Marc Pollefeys , Sunghwan Hong

In the field of multimodal chain-of-thought (CoT) reasoning, existing approaches predominantly rely on reasoning on pure language space, which inherently suffers from language bias and is largely confined to math or science domains. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Jiacong Wang , Zijian Kang , Haochen Wang , Haiyong Jiang , Jiawen Li , Bohong Wu , Ya Wang , Jiao Ran , Xiao Liang , Chao Feng , Jun Xiao

Mathematical reasoning models are widely deployed in education, automated tutoring, and decision support systems despite exhibiting fundamental computational instabilities. We demonstrate that state-of-the-art models (Qwen2.5-Math-7B)…

Machine Learning · Computer Science 2026-03-05 Subramanyam Sahoo , Aman Chadha , Vinija Jain , Divya Chaudhary

Reinforcement learning from verifiable rewards (RLVR) is a promising paradigm for improving large language model (LLM) agents on long-horizon interactive tasks. However, in partially observable environments, incomplete observations cause…

Computation and Language · Computer Science 2026-05-20 Wenjie Tang , Minne Li , Sijie Huang , Liquan Xiao , Yuan Zhou

The robustness of Vision Language Models (VLMs) is commonly assessed through output-level invariance, implicitly assuming that stable predictions reflect stable multimodal processing. In this work, we argue that this assumption is…

When answering questions about an image, it not only needs knowing what -- understanding the fine-grained contents (e.g., objects, relationships) in the image, but also telling why -- reasoning over grounding visual cues to derive the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Jianwei Yang , Jiayuan Mao , Jiajun Wu , Devi Parikh , David D. Cox , Joshua B. Tenenbaum , Chuang Gan

Multi-step zoom-in pipelines are widely used for GUI grounding, yet the intermediate predictions they produce are typically discarded after coordinate remapping. We observe that these intermediate outputs contain a useful confidence signal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Keon Kim , Krish Chelikavada

Steering vectors (SVs) have been proposed as an effective approach to adjust language model behaviour at inference time by intervening on intermediate model activations. They have shown promise in terms of improving both capabilities and…

Machine Learning · Computer Science 2025-05-06 Daniel Tan , David Chanin , Aengus Lynch , Dimitrios Kanoulas , Brooks Paige , Adria Garriga-Alonso , Robert Kirk

Large Reasoning Models (LRMs) exhibit strong performance, yet often produce rationales that sound plausible but fail to reflect their true decision process, undermining reliability and trust. We introduce a formal framework for reasoning…

Artificial Intelligence · Computer Science 2026-02-24 Yunseok Han , Yejoon Lee , Jaeyoung Do

We investigate the robustness of Large Language Models (LLMs) to structural interventions by deleting and swapping adjacent layers during inference. Surprisingly, models retain 72-95% of their original top-1 prediction accuracy without any…

Machine Learning · Computer Science 2025-06-17 Vedang Lad , Jin Hwa Lee , Wes Gurnee , Max Tegmark

Large vision-language models suffer from visual ungroundedness: they can produce a fluent, confident, and even correct response driven entirely by language priors, with the image contributing nothing to the prediction. Existing confidence…

Computation and Language · Computer Science 2026-05-18 Reza Khanmohammadi , Erfan Miahi , Simerjot Kaur , Charese H. Smiley , Ivan Brugere , Kundan Thind , Mohammad M. Ghassemi

Recent advances in Multimodal Large Language Models (MLLMs) have significantly improved performance on tasks such as visual grounding and visual question answering. However, the reasoning processes of these models remain largely opaque;…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Haobo Yuan , Yueyi Sun , Yanwei Li , Tao Zhang , Xueqing Deng , Henghui Ding , Lu Qi , Anran Wang , Xiangtai Li , Ming-Hsuan Yang
‹ Prev 1 2 3 10 Next ›