English
Related papers

Related papers: ROVER: Routing Object-Centric Visual Evidence for …

200 papers

Multimodal language models (MLMs) integrate visual and textual information by coupling a vision encoder with a large language model through the specific adapter. While existing approaches commonly rely on a single pre-trained vision…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Matvey Skripkin , Elizaveta Goncharova , Dmitrii Tarasov , Andrey Kuznetsov

Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced the reasoning capabilities of Large Language Models (LLMs) by optimizing them against factual outcomes. However, this paradigm falters in long-context…

Computation and Language · Computer Science 2026-03-03 Guanzheng Chen , Michael Qizhe Shieh , Lidong Bing

Large Multimodal Models (LMMs) have recently demonstrated remarkable visual understanding performance on both vision-language and vision-centric tasks. However, they often fall short in integrating advanced, task-specific capabilities for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Yufei Zhan , Hongyin Zhao , Yousong Zhu , Shurong Zheng , Fan Yang , Ming Tang , Jinqiao Wang

Recent deep research systems have improved the ability of large language models to produce long, grounded reports through iterative retrieval and reasoning. However, most text-centered systems rely mainly on textual evidence, while…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zhuofan Shi , Peilun Jia , Baoqin Sun , Haiyang Shen , Sixiong Xie , Yun Ma , Xiang Jing

Multimodal emotion analysis is shifting from static classification to generative reasoning. Beyond simple label prediction, robust affective reasoning must synthesize fine-grained signals such as facial micro-expressions and prosodic which…

Multimedia · Computer Science 2026-02-05 Zhixian Zhao , Wenjie Tian , Lei Xie

Multi-modal large language models (MLLMs) have achieved remarkable capabilities by integrating visual perception with language understanding, enabling applications such as image-grounded dialogue, visual question answering, and scientific…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Tianyi Bai , Zengjie Hu , Fupeng Sun , Jiantao Qiu , Yizhen Jiang , Guangxin He , Bohan Zeng , Conghui He , Binhang Yuan , Wentao Zhang

Multimodal Large Language Models (MLLMs) have demonstrated impressive progress in single-image grounding and general multi-image understanding. Recently, some methods begin to address multi-image grounding. However, they are constrained by…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Shurong Zheng , Yousong Zhu , Hongyin Zhao , Fan Yang , Yufei Zhan , Ming Tang , Jinqiao Wang

Models like OpenAI-o3 pioneer visual grounded reasoning by dynamically referencing visual regions, just like human "thinking with images". However, no benchmark exists to evaluate these capabilities holistically. To bridge this gap, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Haochen Wang , Xiangtai Li , Zilong Huang , Anran Wang , Jiacong Wang , Tao Zhang , Jiani Zheng , Sule Bai , Zijian Kang , Jiashi Feng , Zhuochen Wang , Zhaoxiang Zhang

Referring Expression Comprehension (REC) links language to region level visual perception. Standard benchmarks (RefCOCO, RefCOCO+, RefCOCOg) have progressed rapidly with multimodal LLMs but remain weak tests of visual reasoning and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Qihua Dong , Kuo Yang , Lin Ju , Handong Zhao , Yitian Zhang , Yizhou Wang , Huimin Zeng , Jianglin Lu , Yun Fu

Multimodal intelligence development recently show strong progress in visual understanding and high level reasoning. Though, most reasoning system still reply on textual information as the main medium for inference. This limit their…

Machine Learning · Computer Science 2026-01-01 Soham Pahari , M. Srinivas

Complex video reasoning remains a significant challenge for Multimodal Large Language Models (MLLMs), as current R1-based methodologies often prioritize text-centric reasoning derived from text-based and image-based developments. In video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Bo Fang , Yuxin Song , Qiangqiang Wu , Haoyuan Sun , Wenhao Wu , Antoni B. Chan

While rule-based reinforcement learning has recently catalyzed explicit reasoning in multimodal models, tactile reasoning remains largely underexplored. Existing tactile-language models primarily rely on supervised or contrastive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yingxin Lai , Yafei Zhou , Fucai Zhu , Siyu Zhu , Weihao Yuan

Grounding referring expressions in images aims to locate the object instance in an image described by a referring expression. It involves a joint understanding of natural language and image content, and is essential for a range of visual…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Sibei Yang , Guanbin Li , Yizhou Yu

Visual spatial reasoning (VSR) remains challenging for modern vision-language models (VLMs), despite advances in multimodal architectures. A common strategy is to inject additional information at inference time, such as explicit spatial…

Computation and Language · Computer Science 2026-02-26 Muku Akasaka , Soyeon Caren Han

The application of reinforcement learning (RL) to enhance the reasoning capabilities of Multimodal Large Language Models (MLLMs) constitutes a rapidly advancing research area. While MLLMs extend Large Language Models (LLMs) to handle…

Artificial Intelligence · Computer Science 2025-05-22 Guanghao Zhou , Panjia Qiu , Cen Chen , Jie Wang , Zheming Yang , Jian Xu , Minghui Qiu

Recent studies demonstrate that multimodal large language models (MLLMs) can proficiently evaluate visual quality through interpretable assessments. However, existing approaches typically treat quality scoring and reasoning descriptions as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Zhuoxuan Cai , Jian Zhang , Xinbin Yuan , Peng-Tao Jiang , Wenxiang Chen , Bowen Tang , Lujian Yao , Qiyuan Wang , Jinwen Chen , Bo Li

Recent advancements in reinforcement learning, particularly through Group Relative Policy Optimization (GRPO), have significantly improved multimodal large language models for complex reasoning tasks. However, two critical limitations…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jisheng Dang , Jingze Wu , Teng Wang , Xuanhui Lin , Nannan Zhu , Hongbo Chen , Wei-Shi Zheng , Meng Wang , Tat-Seng Chua

Vision-Language Models (VLMs) excel at many multimodal tasks, yet they frequently struggle with tasks requiring precise understanding and handling of fine-grained visual elements. This is mainly due to information loss during image encoding…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Xuchen Li , Xuzhao Li , Jiahui Gao , Renjie Pi , Shiyu Hu , Wentao Zhang

Vision-language navigation (VLN) is the task of navigating an embodied agent to carry out natural language instructions inside real 3D environments. In this paper, we study how to address three critical challenges for this task: the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Xin Wang , Qiuyuan Huang , Asli Celikyilmaz , Jianfeng Gao , Dinghan Shen , Yuan-Fang Wang , William Yang Wang , Lei Zhang

Recent advancements in multimodal reward models (RMs) have substantially improved post-training for visual generative models. However, current RMs face inherent limitations: (1) visual inputs consume large context budgets, forcing fewer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Qunzhong Wang , Jie Liu , Jiajun Liang , Yilei Jiang , Yuanxing Zhang , Yaozhi Zheng , Xintao Wang , Pengfei Wan , Xiangyu Yue , Jiaheng Liu