English
Related papers

Related papers: ERGO: Efficient High-Resolution Visual Understandi…

200 papers

Spatial reasoning is a core component of human cognition, enabling individuals to perceive, comprehend, and interact with the physical world. It relies on a nuanced understanding of spatial structures and inter-object relationships, serving…

Artificial Intelligence · Computer Science 2025-08-27 Zesen Lyu , Dandan Zhang , Wei Ye , Fangdi Li , Zhihang Jiang , Yao Yang

Unified multimodal understanding and generation models recently have achieve significant improvement in image generation capability, yet a large gap remains in instruction following and detail preservation compared to systems that tightly…

Multi-modal Large Language Models (MLLMs) have advanced greatly in general tasks. However, they still face challenges in geometric reasoning, a task that requires synergistic integration of visual recognition proficiency and complex…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Zhihao Li , Yao Du , Yang Liu , Yan Zhang , Yufang Liu , Mengdi Zhang , Xunliang Cai , Charles Ling , Boyu Wang

Vision-centric retrieval for VQA requires retrieving images to supply missing visual cues and integrating them into the reasoning process. However, selecting the right images and integrating them effectively into the model's reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Zhuohong Chen , Zhengxian Wu , Zirui Liao , Shenao Jiang , Hangrui Xu , Yang Chen , Chaokui Su , Xiaoyu Liu , Haoqian Wang

Large Vision-Language Models (LVLMs) have become powerful general-purpose assistants, yet their predictions often lack reliability and interpretability due to insufficient grounding in visual evidence. The emerging thinking-with-images…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Meng Cao , Haoze Zhao , Can Zhang , Xiaojun Chang , Ian Reid , Xiaodan Liang

Recent advances in vision-language models (VLMs) have demonstrated strong generalization in natural image tasks. However, their performance often degrades on unmanned aerial vehicle (UAV)-based aerial imagery, which features high…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jiajin Guan , Haibo Mei , Bonan Zhang , Dan Liu , Yuanshuang Fu , Yue Zhang

This study investigates the spatial reasoning capabilities of vision-language models (VLMs) through Chain-of-Thought (CoT) prompting and reinforcement learning. We begin by evaluating the impact of different prompting strategies and find…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Binbin Ji , Siddharth Agrawal , Qiance Tang , Yvonne Wu

The rapid advancement of Large Vision Language Models (LVLMs) has demonstrated excellent abilities in various visual tasks. Building upon these developments, the thinking with images paradigm has emerged, enabling models to dynamically edit…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yujin Zhou , Pengcheng Wen , Jiale Chen , Boqin Yin , Han Zhu , Jiaming Ji , Juntao Dai , Chi-Min Chan , Sirui Han

Visual reasoning refers to the task of solving questions about visual information. Current visual reasoning methods typically employ pre-trained vision-language model (VLM) strategies or deep neural network approaches. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Chao Wang , Chunbai Zhang , Yongxiao Tian , Yang Zhou , Yan Peng

Vision language models (VLMs) are increasingly capable of reasoning over images, but robust visual reasoning often requires re-grounding intermediate steps in the underlying visual evidence. Recent approaches typically rely on external…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zeru Shi , Kai Mei , Yihao Quan , Dimitris N. Metaxas , Ruixiang Tang

Recent advancements in reinforcement learning, particularly through Group Relative Policy Optimization (GRPO), have significantly improved multimodal large language models for complex reasoning tasks. However, two critical limitations…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jisheng Dang , Jingze Wu , Teng Wang , Xuanhui Lin , Nannan Zhu , Hongbo Chen , Wei-Shi Zheng , Meng Wang , Tat-Seng Chua

Visual generation models have made remarkable progress in creating realistic images from text prompts, yet struggle with complex prompts that specify multiple objects with precise spatial relationships and attributes. Effective handling of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Chengqi Duan , Rongyao Fang , Yuqing Wang , Kun Wang , Linjiang Huang , Xingyu Zeng , Hongsheng Li , Xihui Liu

Open-Vocabulary Segmentation (OVS) has drawn increasing attention for its capacity to generalize segmentation beyond predefined categories. However, existing methods typically predict segmentation masks with simple forward inference,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Zongyan Han , Jiale Cao , Shuo Chen , Tong Wang , Jorma Laaksonen , Rao Muhammad Anwer

The diagnosis of pathological images is often limited by expert availability and regional disparities, highlighting the importance of automated diagnosis using Vision-Language Models (VLMs). Traditional multimodal models typically emphasize…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Jianyu Wu , Hao Yang , Xinhua Zeng , Guibing He , Zhiyu Chen , Zihui Li , Xiaochuan Zhang , Yangyang Ma , Run Fang , Yang Liu

Existing Multimodal Large Language Models (MLLMs) suffer from increased inference costs due to the additional vision tokens introduced by image inputs. In this work, we propose Visual Consistency Learning (ViCO), a novel training algorithm…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Long Cui , Weiyun Wang , Jie Shao , Zichen Wen , Gen Luo , Linfeng Zhang , Yanting Zhang , Yu Qiao , Wenhai Wang

Beneath the stunning visual fidelity of modern AIGC models lies a "logical desert", where systems fail tasks that require physical, causal, or complex spatial reasoning. Current evaluations largely rely on superficial metrics or fragmented…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Haonan Han , Jiancheng Huang , Xiaopeng Sun , Junyan He , Rui Yang , Jie Hu , Xiaojiang Peng , Lin Ma , Xiaoming Wei , Xiu Li

Learning general-purpose reasoning capabilities has long been a challenging problem in AI. Recent research in large language models (LLMs), such as DeepSeek-R1, has shown that reinforcement learning techniques like GRPO can enable…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jiaer Xia , Yuhang Zang , Peng Gao , Sharon Li , Kaiyang Zhou

Referring Expression Comprehension (REC) links language to region level visual perception. Standard benchmarks (RefCOCO, RefCOCO+, RefCOCOg) have progressed rapidly with multimodal LLMs but remain weak tests of visual reasoning and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Qihua Dong , Kuo Yang , Lin Ju , Handong Zhao , Yitian Zhang , Yizhou Wang , Huimin Zeng , Jianglin Lu , Yun Fu

Visual grounding is an essential capability of Visual Language Models (VLMs) to understand the real physical world. Previous state-of-the-art grounding visual language models usually have large model sizes, making them heavy for deployment…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Guanqi Zhan , Changye Li , Zhijian Liu , Yao Lu , Yi Wu , Song Han , Ligeng Zhu

Visual Language Models (VLMs) are essential for various tasks, particularly visual reasoning tasks, due to their robust multi-modal information integration, visual reasoning capabilities, and contextual awareness. However, existing \VLMs{}'…

Computation and Language · Computer Science 2024-09-13 Zaiqiao Meng , Hao Zhou , Yifang Chen