English
Related papers

Related papers: Look on Demand: A Cognitive Scheduling Framework f…

200 papers

Visual reasoning is challenging, requiring both precise object grounding and understanding complex spatial relationships. Existing methods fall into two camps: language-only chain-of-thought approaches, which demand large-scale (image,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Damiano Marsili , Georgia Gkioxari

Time series forecasting traditionally relies on unimodal numerical inputs, which often struggle to capture high-level semantic patterns due to their dense and unstructured nature. While recent approaches have explored representing time…

Machine Learning · Computer Science 2025-07-02 Sixun Dong , Wei Fan , Teresa Wu , Yanjie Fu

Current multimodal LLMs encode images as static visual prefixes and rely on text-based reasoning, lacking goal-driven and adaptive visual access. Inspired by human visual perception-where attention is selectively and sequentially shifted…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Guangfu Guo , Xiaoqian Lu , Yue Feng , Mingming Sun

Existing Multimodal Large Language Models (MLLMs) suffer from significant performance degradation on the long document understanding task as document length increases. This stems from two fundamental challenges: 1) a low Signal-to-Noise…

Artificial Intelligence · Computer Science 2026-05-12 Hao Yan , Yuliang Liu , Xingchen Liu , Yuyi Zhang , Minghui Liao , Jihao Wu , Wei Chen , Xiang Bai

Visual Commonsense Reasoning (VCR) remains a significant yet challenging research problem in the realm of visual reasoning. A VCR model generally aims at answering a textual question regarding an image, followed by the rationale prediction…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Zhenyang Li , Yangyang Guo , Kejie Wang , Fan Liu , Liqiang Nie , Mohan Kankanhalli

Large Language Models have demonstrated remarkable reasoning capability in complex textual tasks. However, multimodal reasoning, which requires integrating visual and textual information, remains a significant challenge. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yi Yang , Xiaoxuan He , Hongkun Pan , Xiyan Jiang , Yan Deng , Xingtao Yang , Haoyu Lu , Dacheng Yin , Fengyun Rao , Minfeng Zhu , Bo Zhang , Wei Chen

Recent advancements in Large Language Models (LLMs) and their multimodal extensions (MLLMs) have substantially enhanced machine reasoning across diverse tasks. However, these models predominantly rely on pure text as the medium for both…

Machine Learning · Computer Science 2026-02-23 Yi Xu , Chengzu Li , Han Zhou , Xingchen Wan , Caiqi Zhang , Anna Korhonen , Ivan Vulić

Building on the success of text-based reasoning models like DeepSeek-R1, extending these capabilities to multimodal reasoning holds great promise. While recent works have attempted to adapt DeepSeek-R1-style reinforcement learning (RL)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jie Yang , Feipeng Ma , Zitian Wang , Dacheng Yin , Kang Rong , Fengyun Rao , Ruimao Zhang

Despite significant advancements, current large language models (LLMs) and vision-language models (LVLMs) continue to struggle with complex, multi-step, cross-modal common sense reasoning tasks, often exhibiting a lack of "deliberative…

Computation and Language · Computer Science 2025-08-06 Wenjie Luo , Ruocheng Li , Shanshan Zhu , Julian Perry

Understanding causal relationships across modalities is a core challenge for multimodal models operating in real-world environments. We introduce ISO-Bench, a benchmark for evaluating whether models can infer causal dependencies between…

Computation and Language · Computer Science 2025-08-01 Ananya Sadana , Yash Kumar Lal , Jiawei Zhou

In recent years, cross-modal reasoning (CMR), the process of understanding and reasoning across different modalities, has emerged as a pivotal area with applications spanning from multimedia analysis to healthcare diagnostics. As the…

Artificial Intelligence · Computer Science 2023-09-15 Dizhan Xue , Shengsheng Qian , Zuyi Zhou , Changsheng Xu

We introduce Contrastive Region Masking (CRM), a training free diagnostic that reveals how multimodal large language models (MLLMs) depend on specific visual regions at each step of chain-of-thought (CoT) reasoning. Unlike prior approaches…

Machine Learning · Computer Science 2025-12-19 Isha Chaturvedi , Anjana Nair , Yushen Li , Adhitya Rajendra Kumar , Kevin Zhu , Sunishchal Dev , Ashwinee Panda , Vasu Sharma

We present a central-peripheral vision-inspired framework (CVP), a simple yet effective multimodal model for spatial reasoning that draws inspiration from the two types of human visual fields -- central vision and peripheral vision.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Zeyuan Chen , Xiang Zhang , Haiyang Xu , Jianwen Xie , Zhuowen Tu

Neural Module Networks (NMN) are a compelling method for visual question answering, enabling the translation of a question into a program consisting of a series of reasoning sub-tasks that are sequentially executed on the image to produce…

Computation and Language · Computer Science 2023-10-25 Wafa Aissa , Marin Ferecatu , Michel Crucianu

Multi-modal large language models (MLLMs) have achieved remarkable capabilities by integrating visual perception with language understanding, enabling applications such as image-grounded dialogue, visual question answering, and scientific…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Tianyi Bai , Zengjie Hu , Fupeng Sun , Jiantao Qiu , Yizhen Jiang , Guangxin He , Bohan Zeng , Conghui He , Binhang Yuan , Wentao Zhang

Anomaly detection is vital in various industrial scenarios, including the identification of unusual patterns in production lines and the detection of manufacturing defects for quality control. Existing techniques tend to be specialized in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Xiaohao Xu , Yunkang Cao , Huaxin Zhang , Nong Sang , Xiaonan Huang

Visual reasoning is a core component of human intelligence and a critical capability for advanced multimodal models. Yet current reasoning evaluations of multimodal large language models (MLLMs) often rely on text descriptions and allow…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Weiye Xu , Jiahao Wang , Weiyun Wang , Zhe Chen , Wengang Zhou , Aijun Yang , Lewei Lu , Houqiang Li , Xiaohua Wang , Xizhou Zhu , Wenhai Wang , Jifeng Dai , Jinguo Zhu

Multi-modal Large Language Models (MLLMs) have demonstrated remarkable reasoning capability while lack explicit mechanisms for visual grounding and segmentation, creating a gap between cognitive reasoning and visual perception. To bridge…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Yi Lu , Jiawang Cao , Yongliang Wu , Bozheng Li , Licheng Tang , Yangguang Ji , Chong Wu , Jay Wu , Wenbo Zhu

Multimodal Large Language Models (MLLMs) have showcased exceptional Chain-of-Thought (CoT) reasoning ability in complex textual inference tasks including causal reasoning. However, will these causalities remain straightforward when crucial…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Zhiyuan Li , Heng Wang , Dongnan Liu , Chaoyi Zhang , Ao Ma , Jieting Long , Weidong Cai

Unified multimodal models aim to jointly enable visual understanding and generation, yet current benchmarks rarely examine their true integration. Existing evaluations either treat the two abilities in isolation or overlook tasks that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Kai Zou , Ziqi Huang , Yuhao Dong , Shulin Tian , Dian Zheng , Hongbo Liu , Jingwen He , Bin Liu , Yu Qiao , Ziwei Liu