English
Related papers

Related papers: VTPerception-R1: Enhancing Multimodal Reasoning vi…

200 papers

Multimodal Large Language Models (MLLMs) have powered Graphical User Interface (GUI) Agents, showing promise in automating tasks on computing devices. Recent works have begun exploring reasoning in GUI tasks with encouraging results.…

Artificial Intelligence · Computer Science 2025-04-22 Yuhang Liu , Pengxiang Li , Congkai Xie , Xavier Hu , Xiaotian Han , Shengyu Zhang , Hongxia Yang , Fei Wu

Enhancing reasoning in Large Multimodal Models (LMMs) faces unique challenges from the complex interplay between visual perception and logical reasoning, particularly in compact 3B-parameter architectures where architectural constraints…

Computation and Language · Computer Science 2025-03-12 Yingzhe Peng , Gongrui Zhang , Miaosen Zhang , Zhiyuan You , Jie Liu , Qipeng Zhu , Kai Yang , Xingzhong Xu , Xin Geng , Xu Yang

Multimodal Large Language Model (MLLMs) leverages Large Language Models as a cognitive framework for diverse visual-language tasks. Recent efforts have been made to equip MLLMs with visual perceiving and grounding capabilities. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Junwen He , Yifan Wang , Lijun Wang , Huchuan Lu , Jun-Yan He , Jin-Peng Lan , Bin Luo , Xuansong Xie

Recent advancements in Vision-Language (VL) research have sparked new benchmarks for complex visual reasoning, challenging models' advanced reasoning ability. Traditional Vision-Language Models (VLMs) perform well in visual perception tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zhiyuan Li , Dongnan Liu , Chaoyi Zhang , Heng Wang , Tengfei Xue , Weidong Cai

As Large Vision-Language Models (LVLMs) are increasingly deployed in domains such as shopping, health, and news, they are exposed to pervasive persuasive content. A critical question is how these models function as persuadees-how and why…

Computation and Language · Computer Science 2025-10-28 Haoyi Qiu , Yilun Zhou , Pranav Narayanan Venkit , Kung-Hsiang Huang , Jiaxin Zhang , Nanyun Peng , Chien-Sheng Wu

Vision--language models (VLMs) are increasingly aligned via Group Relative Policy Optimization (GRPO)-style training. However, relying solely on terminal outcome rewards yields sparse credit assignment in multi-step reasoning, weakening the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Feiding , Yongkang Zhang , Yuhao Liao , Zijian Zeng , Chunzheng Zhu , Yaozong Zheng , Yafei Liu , Yeling Peng , Youwei Wang , Sibo Wang , Huiming Yang , Linglin Liao , Shunzhi Yang

Vision-language process reward models (VL-PRMs) are increasingly used to score intermediate reasoning steps and rerank candidates under test-time scaling. However, they often function as black-box judges: a low step score may reflect a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Junxin Wang , Dai Guan , Weijie Qiu , Zhihang Li , Yongbo Gai , Zhengyi Yang , Mengyu Zhou , Erchao Zhao , Xiaoxi Jiang , Guanjun Jiang

Humans can perceive and reason about spatial relationships from sequential visual observations, such as egocentric video streams. However, how pretrained models acquire such abilities, especially high-level reasoning, remains unclear. This…

Artificial Intelligence · Computer Science 2025-04-18 Baining Zhao , Ziyou Wang , Jianjie Fang , Chen Gao , Fanhang Man , Jinqiang Cui , Xin Wang , Xinlei Chen , Yong Li , Wenwu Zhu

While multimodal large language models excel at tasks that integrate visual perception with symbolic reasoning, their performance is often undermined by a critical vulnerability: perception-induced errors that propagate through the…

Multimedia · Computer Science 2025-09-29 Songjun Tu , Qichao Zhang , Jingbo Sun , Yuqian Fu , Linjing Li , Xiangyuan Lan , Dongmei Jiang , Yaowei Wang , Dongbin Zhao

Large vision-language models (LVLMs) struggle to reliably detect visual primitives in charts and align them with semantic representations, which severely limits their performance on complex visual reasoning. This lack of perceptual…

Artificial Intelligence · Computer Science 2026-03-13 Eunsoo Lee , Jeongwoo Lee , Minki Hong , Jangho Choi , Jihie Kim

Recent advancements in Large Vision Language Models (LVLMs) have significantly improved performance in Visual Question Answering (VQA) tasks through multimodal Retrieval-Augmented Generation (RAG). However, existing methods still face…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Qi Yang , Chenghao Zhang , Lubin Fan , Kun Ding , Jieping Ye , Shiming Xiang

Despite impressive advancements in Visual-Language Models (VLMs) for multi-modal tasks, their reliance on RGB inputs limits precise spatial understanding. Existing methods for integrating spatial cues, such as point clouds or depth, either…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Yang Liu , Ming Ma , Xiaomin Yu , Pengxiang Ding , Han Zhao , Mingyang Sun , Siteng Huang , Donglin Wang

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in vision-language answering tasks. Despite their strengths, these models often encounter challenges in achieving complex reasoning tasks such as…

Artificial Intelligence · Computer Science 2025-11-11 Jinhao Chen , Zhen Yang , Jianxin Shi , Tianyu Wo , Jie Tang

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) for multimodal large language models (MLLMs) have mainly focused on improving final answer correctness and strengthening visual grounding. However, a critical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jinda Lu , Junkang Wu , Jinghan Li , Kexin Huang , Shuo Yang , Mingzhu Chen , Jiancan Wu , Kuien Liu , Xiang Wang

Large vision-language models (VLMs) fine-tuned on specialized visual instruction-following data have exhibited impressive language reasoning capabilities across various scenarios. However, this fine-tuning paradigm may not be able to…

Artificial Intelligence · Computer Science 2024-10-10 Yuexiang Zhai , Hao Bai , Zipeng Lin , Jiayi Pan , Shengbang Tong , Yifei Zhou , Alane Suhr , Saining Xie , Yann LeCun , Yi Ma , Sergey Levine

With recent advancements in Large Multimodal Models (LMMs) across various domains, a novel prompting method called visual referring prompting has emerged, showing significant potential in enhancing human-computer interaction within…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Zongjie Li , Chaozheng Wang , Chaowei Liu , Pingchuan Ma , Daoyuan Wu , Shuai Wang , Cuiyun Gao

Language models have recently advanced into the realm of reasoning, yet it is through multimodal reasoning that we can fully unlock the potential to achieve more comprehensive, human-like cognitive capabilities. This survey provides a…

Computation and Language · Computer Science 2025-03-25 Zhiyu Lin , Yifei Gao , Xian Zhao , Yunfan Yang , Jitao Sang

The advancement of multimodal large language models (MLLMs) has enabled impressive perception capabilities. However, their reasoning process often remains a "fast thinking" paradigm, reliant on end-to-end generation or explicit,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Yiming Zhang , Qiangyu Yan , Borui Jiang , Kai Han

Multimodal embeddings are widely used in downstream tasks such as multimodal retrieval, enabling alignment of interleaved modalities in a shared representation space. While recent studies show that Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Chunxu Liu , Jiyuan Yang , Ruopeng Gao , Yuhan Zhu , Feng Zhu , Rui Zhao , Limin Wang

Remote Sensing Visual Grounding (RSVG) aims to localize target objects in large-scale aerial imagery based on natural language descriptions. Owing to the vast spatial scale and high semantic ambiguity of remote sensing scenes, these…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Shiqi Huang , Shuting He , Bihan Wen