English
Related papers

Related papers: Think Visually, Reason Textually: Vision-Language …

200 papers

Despite recent successes, test-time scaling - i.e., dynamically expanding the token budget during inference as needed - remains brittle for vision-language models (VLMs): unstructured chains-of-thought about images entangle perception and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Niccolo Avogaro , Nayanika Debnath , Li Mi , Thomas Frick , Junling Wang , Zexue He , Hang Hua , Konrad Schindler , Mattia Rigotti

Visual reasoning is a core component of human intelligence and a critical capability for advanced multimodal models. Yet current reasoning evaluations of multimodal large language models (MLLMs) often rely on text descriptions and allow…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Weiye Xu , Jiahao Wang , Weiyun Wang , Zhe Chen , Wengang Zhou , Aijun Yang , Lewei Lu , Houqiang Li , Xiaohua Wang , Xizhou Zhu , Wenhai Wang , Jifeng Dai , Jinguo Zhu

Despite recent progress in multimodal large language models (MLLMs), reliable visual question answering in aerial scenes remains challenging. In such scenes, task-critical evidence is often carried by small objects, explicit quantities,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Junxiao Xue , Quan Deng , Tingqi Hu , Meicong Si , Xinyi Yin , Yunyun Shi , Xuecheng Wu

CoT has significantly enhanced the reasoning ability of LLMs while it faces challenges when extended to multimodal domains, particularly in mathematical tasks. Existing MLLMs typically perform textual reasoning solely from a single static…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Lihong Wang , Liangqi Li , Weiwei Feng , Jiamin Wu , Changtao Miao , Tieru Wu , Rui Ma , Bo Zhang , Zhe Li

Unified multimodal understanding and generation models recently have achieve significant improvement in image generation capability, yet a large gap remains in instruction following and detail preservation compared to systems that tightly…

Vision-Language Models often struggle with complex visual reasoning due to the visual information loss in textual CoT. Existing methods either add the cost of tool calls or rely on localized patch-based embeddings that are insufficient to…

Computation and Language · Computer Science 2026-04-10 Mengdan Zhu , Senhao Cheng , Liang Zhao

Lip Reading, or Visual Automatic Speech Recognition (V-ASR), is a complex task requiring the interpretation of spoken language exclusively from visual cues, primarily lip movements and facial expressions. This task is especially challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Marshall Thomas , Edward Fish , Richard Bowden

The rapid advancement of generative models has intensified the challenge of detecting and interpreting visual forgeries, necessitating robust frameworks for image forgery detection while providing reasoning as well as localization. While…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Ipsita Praharaj , Yukta Butala , Badrikanath Praharaj , Yash Butala

Image-text matching has been a hot research topic bridging the vision and language areas. It remains challenging because the current representation of image usually lacks global semantic concepts as in its corresponding text caption. To…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Kunpeng Li , Yulun Zhang , Kai Li , Yuanyuan Li , Yun Fu

Sophisticated text-centric forgeries, fueled by rapid AIGC advancements, pose a significant threat to societal security and information authenticity. Current methods for text-centric forgery analysis are often limited to coarse-grained…

Artificial Intelligence · Computer Science 2025-12-29 Fanwei Zeng , Changtao Miao , Jing Huang , Zhiya Tan , Shutao Gong , Xiaoming Yu , Yang Wang , Huazhe Tan , Weibin Yao , Jianshu Li

Visual reasoning, often interleaved with intermediate visual states, has emerged as a promising direction in the field. A straightforward approach is to directly generate images via unified models during reasoning, but this is…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Ziyu Guo , Rain Liu , Xinyan Chen , Pheng-Ann Heng

DeepSeek-R1 has demonstrated powerful reasoning capabilities in the text domain through stable reinforcement learning (RL). Recently, in the multimodal domain, works have begun to directly apply RL to generate R1-like free-form reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Chuming Shen , Wei Wei , Xiaoye Qu , Yu Cheng

Grounding natural language in images, such as localizing "the black dog on the left of the tree", is one of the core problems in artificial intelligence, as it needs to comprehend the fine-grained and compositional language space. However,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Richang Hong , Daqing Liu , Xiaoyu Mo , Xiangnan He , Hanwang Zhang

Grounding language in vision is an active field of research seeking to construct cognitively plausible word and sentence representations by incorporating perceptual knowledge from vision into text-based representations. Despite many…

Computation and Language · Computer Science 2023-11-01 Hassan Shahmohammadi , Maria Heitmeier , Elnaz Shafaei-Bajestan , Hendrik P. A. Lensch , Harald Baayen

Tiny Recursive Models (TRM) were proposed as a parameter-efficient alternative to large language models for solving Abstraction and Reasoning Corpus (ARC) style tasks. The original work reports strong performance and suggests that recursive…

Machine Learning · Computer Science 2026-01-12 Antonio Roye-Azar , Santiago Vargas-Naranjo , Dhruv Ghai , Nithin Balamurugan , Rayan Amir

Vision-language models (VLMs) have demonstrated strong reasoning abilities in literal multimodal tasks such as visual mathematics and science question answering. However, figurative language, such as sarcasm, humor, and metaphor, remains a…

Computation and Language · Computer Science 2026-01-27 Seyyed Saeid Cheshmi , Hahnemann Ortiz , James Mooney , Dongyeop Kang

Machine Interpreting systems are currently implemented as unimodal, real-time speech-to-speech architectures, processing translation exclusively on the basis of the linguistic signal. Such reliance on a single modality, however, constrains…

Computation and Language · Computer Science 2025-09-30 Claudio Fantinuoli

The ARC-AGI benchmark series serves as a critical measure of few-shot generalization on novel tasks, a core aspect of intelligence. The ARC Prize 2025 global competition targeted the newly released ARC-AGI-2 dataset, which features greater…

Artificial Intelligence · Computer Science 2026-01-19 François Chollet , Mike Knoop , Gregory Kamradt , Bryan Landers

Vision Language Navigation (VLN) typically requires agents to navigate to specified objects or remote regions in unknown scenes by obeying linguistic commands. Such tasks require organizing historical visual observations for linguistic…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Bolei Chen , Jiaxu Kang , Yifei Wang , Ping Zhong , Qi Wu , Jianxin Wang

Vision-language models (VLMs) have achieved remarkable success across diverse tasks. However, concerns about their trustworthiness persist, particularly regarding tendencies to lean more on textual cues than visual evidence and the risk of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Shizhan Gong , Minda Hu , Qiyuan Zhang , Chen Ma , Qi Dou