English
Related papers

Related papers: Enhancing Human-like Multi-Modal Reasoning: A New …

200 papers

Recently, inference-time scaling of chain-of-thought (CoT) has been demonstrated as a promising approach for addressing multi-modal reasoning tasks. While existing studies have predominantly centered on text-based thinking, the integration…

Computation and Language · Computer Science 2025-05-27 Yujie Lin , Ante Wang , Moye Chen , Jingyao Liu , Hao Liu , Jinsong Su , Xinyan Xiao

Large Vision-Language Models (LVLMs) have recently demonstrated amazing success in multi-modal tasks, including advancements in Multi-modal Chain-of-Thought (MCoT) reasoning. Despite these successes, current benchmarks still follow a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Zihui Cheng , Qiguang Chen , Jin Zhang , Hao Fei , Xiaocheng Feng , Wanxiang Che , Min Li , Libo Qin

Recent advancements in multimodal large language models (MLLMs) have demonstrated exceptional performance in multimodal perception and understanding. However, leading open-source MLLMs exhibit significant limitations in complex and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Jingjing Jiang , Chao Ma , Xurui Song , Hanwang Zhang , Jun Luo

Recent advancements in deep learning have led to the development of powerful language models (LMs) that excel in various tasks. Despite these achievements, there is still room for improvement, particularly in enhancing reasoning abilities…

Computation and Language · Computer Science 2023-12-27 Abhinav Arun , Dipendra Singh Mal , Mehul Soni , Tomohiro Sawada

Chain-of-Thought (CoT) prompting has proven highly effective for enhancing complex reasoning in Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs). Yet, it struggles in complex spatial reasoning tasks. Nonetheless,…

Computation and Language · Computer Science 2025-01-14 Chengzu Li , Wenshan Wu , Huanyu Zhang , Yan Xia , Shaoguang Mao , Li Dong , Ivan Vulić , Furu Wei

Composed Image Retrieval (CIR), which aims to find a target image from a reference image and a modification text, presents the core challenge of performing unified reasoning across visual and semantic modalities. While current approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Weihuang Lin , Yiwei Ma , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

Many reasoning techniques for large multimodal models adapt language model approaches, such as Chain-of-Thought (CoT) prompting, which express reasoning as word sequences. While effective for text, these methods are suboptimal for…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Tan-Hanh Pham , Chris Ngo

Reasoning capabilities in large language models (LLMs) have substantially advanced through methods such as chain-of-thought and explicit step-by-step explanations. However, these improvements have not yet fully transitioned to multimodal…

Computation and Language · Computer Science 2025-08-07 Nima Iji , Kia Dashtipour

Answering questions with Chain-of-Thought (CoT) has significantly enhanced the reasoning capabilities of Large Language Models (LLMs), yet its impact on Large Multimodal Models (LMMs) still lacks a systematic assessment and in-depth…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Dongzhi Jiang , Renrui Zhang , Ziyu Guo , Yanwei Li , Yu Qi , Xinyan Chen , Liuhui Wang , Jianhan Jin , Claire Guo , Shen Yan , Bo Zhang , Chaoyou Fu , Peng Gao , Hongsheng Li

The advancement of Large Language Models (LLMs) has brought substantial attention to the Chain of Thought (CoT) approach, primarily due to its ability to enhance the capability of LLMs on complex reasoning tasks. Moreover, the significance…

Computation and Language · Computer Science 2024-03-05 Bingshuai Liu , Chenyang Lyu , Zijun Min , Zhanyu Wang , Jinsong Su , Longyue Wang

Human problem-solving is never the repetition of a single mindset, by which we mean a distinct mode of cognitive processing. When tackling a specific task, we do not rely on a single mindset; instead, we integrate multiple mindsets within…

Recently, Chain-of-Thought (CoT) prompting has delivered success on complex reasoning tasks, which aims at designing a simple prompt like ``Let's think step by step'' or multiple in-context exemplars with well-designed rationales to elicit…

Computation and Language · Computer Science 2024-06-04 Jianing Wang , Qiushi Sun , Xiang Li , Ming Gao

Chain-of-thought (CoT) reasoning boosts large language models' (LLMs) performance on complex tasks but faces two key limitations: a lack of reliability when solely relying on LLM-generated reasoning chains and lower reasoning performance…

Computation and Language · Computer Science 2025-09-11 Feiyang Li , Peng Fang , Zhan Shi , Arijit Khan , Fang Wang , Weihao Wang , Xin Zhang , Yongjian Cui

Visual Question Answering (VQA) often involves diverse reasoning scenarios across Vision and Language (V&L). Most prior VQA studies, however, have merely focused on assessing the model's overall accuracy without evaluating it on different…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jihyung Kil , Farideh Tavazoee , Dongyeop Kang , Joo-Kyung Kim

Multimodal reasoning is a challenging task that requires models to reason across multiple modalities to answer questions. Existing approaches have made progress by incorporating language and visual modalities into a two-stage reasoning…

Artificial Intelligence · Computer Science 2024-07-04 Cheng Tan , Jingxuan Wei , Zhangyang Gao , Linzhuang Sun , Siyuan Li , Ruifeng Guo , Bihui Yu , Stan Z. Li

Image editing with natural language has gained significant popularity, yet existing methods struggle with intricate object intersections and fine-grained spatial relationships due to the lack of an explicit reasoning process. While…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Zhentao Zou , Zhengrong Yue , Kunpeng Du , Binlei Bao , Hanting Li , Haizhen Xie , Guozheng Xu , Yue Zhou , Yali Wang , Jie Hu , Xue Jiang , Xinghao Chen

Multi-Modal Large Language Models (MLLMs) have demonstrated impressive performance in various VQA tasks. However, they often lack interpretability and struggle with complex visual inputs, especially when the resolution of the input image is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Hao Shao , Shengju Qian , Han Xiao , Guanglu Song , Zhuofan Zong , Letian Wang , Yu Liu , Hongsheng Li

Existing works of reasoning segmentation often fall short in complex cases, particularly when addressing complicated queries and out-of-domain images. Inspired by the chain-of-thought reasoning, where harder problems require longer thinking…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Shiu-hong Kao , Chak Ho Huang , Huaiqian Liu , Yu-Wing Tai , Chi-Keung Tang

In recent years, cross-modal reasoning (CMR), the process of understanding and reasoning across different modalities, has emerged as a pivotal area with applications spanning from multimedia analysis to healthcare diagnostics. As the…

Artificial Intelligence · Computer Science 2023-09-15 Dizhan Xue , Shengsheng Qian , Zuyi Zhou , Changsheng Xu

Due to the proliferation of short-form content and the rapid adoption of AI, opportunities for deep, reflective thinking have significantly diminished, undermining users' critical thinking and reducing engagement with the reasoning behind…

Computation and Language · Computer Science 2025-04-28 Seunghyun Yoo