English
Related papers

Related papers: Do Reasoning Vision-Language Models Inversely Scal…

200 papers

The dual thinking framework considers fast, intuitive, and slower logical processing. The perception of dual thinking in vision requires images where inferences from intuitive and logical processing differ, and the latter is under-explored…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Kailas Dayanandan , Nikhil Kumar , Anand Sinha , Brejesh Lall

Recent advances in vision language models (VLMs) offer reasoning capabilities, yet how these unfold and integrate visual and textual information remains unclear. We analyze reasoning dynamics in 18 VLMs covering instruction-tuned and…

Computation and Language · Computer Science 2026-04-28 Danae Sánchez Villegas , Samuel Lewis-Lim , Nikolaos Aletras , Desmond Elliott

A reliable driving assistant should provide consistent responses based on temporally grounded reasoning derived from observed information. In this work, we investigate whether Vision-Language Models (VLMs), when applied as driving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Chun-Peng Chang , Chen-Yu Wang , Holger Caesar , Alain Pagani

As textual reasoning with large language models (LLMs) has advanced significantly, there has been growing interest in enhancing the multimodal reasoning capabilities of large vision-language models (LVLMs). However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Junfei Wu , Jian Guan , Kaituo Feng , Qiang Liu , Shu Wu , Liang Wang , Wei Wu , Tieniu Tan

Large Language Models (LLMs) are important tools for reasoning and problem-solving, while they often operate passively, answering questions without actively discovering new ones. This limitation reduces their ability to simulate human-like…

Computational Engineering, Finance, and Science · Computer Science 2025-09-26 Hong Su

In the picture-word interference paradigm, participants name pictures while ignoring a written or spoken distractor word. Naming times to the pictures are slowed down by the presence of the distractor word. Various properties of the…

Neurons and Cognition · Quantitative Biology 2023-03-17 Audrey Bürki , F. -Xavier Alario , Shravan Vasishth

Large Vision-Language Models (LVLMs) are an extension of Large Language Models (LLMs) that facilitate processing both image and text inputs, expanding AI capabilities. However, LVLMs struggle with object hallucinations due to their reliance…

Computation and Language · Computer Science 2024-08-12 Avshalom Manevich , Reut Tsarfaty

Test-time scaling (TTS) has emerged as a powerful paradigm for improving the reasoning ability of Large Language Models (LLMs) by allocating additional computation at inference, yet its application to multimodal systems such as…

Distractor generation (DG) remains a labor-intensive task that still significantly depends on domain experts. The task focuses on generating plausible yet incorrect options, known as distractors, for multiple-choice questions. A reliable…

Computation and Language · Computer Science 2026-04-21 Elaf Alhazmi , Quan Z. Sheng , Wei Emma Zhang

Recent advancements in Large Language Models (LLMs) have demonstrated enhanced reasoning capabilities, evolving from Chain-of-Thought (CoT) prompting to advanced, product-oriented solutions like OpenAI o1. During our re-implementation of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Hai-Long Sun , Zhun Sun , Houwen Peng , Han-Jia Ye

Where someone looks is a nonverbal communication cue that children and adults readily use. How well can Vision-Language Models (VLMs) infer gaze targets? To construct evaluation stimuli, we captured 1,360 real-world photos of scenes in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Zory Zhang , Pinyuan Feng , Bingyang Wang , Tianwei Zhao , Suyang Yu , Qingying Gao , Hokin Deng , Ziqiao Ma , Yijiang Li , Dezhi Luo

While large language models (LLMs) excel in mathematical and code reasoning, we observe they struggle with social reasoning tasks, exhibiting cognitive confusion, logical inconsistencies, and conflation between objective world states and…

Computation and Language · Computer Science 2025-10-14 Jialu Du , Guiyang Hou , Yihui Fu , Chen Wu , Wenqi Zhang , Yongliang Shen , Weiming Lu

The lack of reasoning capabilities in Vision-Language Models (VLMs) has remained at the forefront of research discourse. We posit that this behavior stems from a reporting bias in their training data. That is, how people communicate about…

Computation and Language · Computer Science 2026-02-27 Amita Kamath , Jack Hessel , Khyathi Chandu , Jena D. Hwang , Kai-Wei Chang , Ranjay Krishna

Large language models (LLMs) and vision-language models (VLMs) have demonstrated remarkable performance across a wide range of tasks and domains. Despite this promise, spatial understanding and reasoning -- a fundamental component of human…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Jiayu Wang , Yifei Ming , Zhenmei Shi , Vibhav Vineet , Xin Wang , Yixuan Li , Neel Joshi

Recent advances in large reasoning models (LRMs) have enabled remarkable performance on complex tasks such as mathematics and coding by generating long Chain-of-Thought (CoT) traces. In this paper, we identify and systematically analyze a…

Artificial Intelligence · Computer Science 2025-10-21 Zhehao Zhang , Weijie Xu , Shixian Cui , Chandan K. Reddy

Vision-Language Models (VLMs) have demonstrated strong capability in a wide range of tasks such as visual recognition, document parsing, and visual grounding. Nevertheless, recent work shows that while VLMs often manage to capture the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Chengxin Liu , Wonseok Choi , Chenshuang Zhang , Tae-Hyun Oh

Vision-Language Models (VLMs) occasionally generate outputs that contradict input images, constraining their reliability in real-world applications. While visual prompting is reported to suppress hallucinations by augmenting prompts with…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Masayo Tomita , Katsuhiko Hayashi , Tomoyuki Kaneko

We uncover a surprising multilingual bias occurring in a popular class of multimodal vision-language models (VLMs). Including an image in the query to a LLaVA-style VLM significantly increases the likelihood of the model returning an…

Visual abductive reasoning (VAR) is a challenging task that requires AI systems to infer the most likely explanation for incomplete visual observations. While recent MLLMs develop strong general-purpose multimodal reasoning capabilities,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Boyu Chang , Qi Wang , Xi Guo , Zhixiong Nan , Yazhou Yao , Tianfei Zhou

Understanding neural networks is becoming increasingly important. Over the last few years different types of visualisation and explanation methods have been proposed. However, none of them explicitly considered the behaviour in the presence…

Machine Learning · Statistics 2016-11-23 Pieter-Jan Kindermans , Kristof Schütt , Klaus-Robert Müller , Sven Dähne