中文
相关论文

相关论文: Enhancing Human-like Multi-Modal Reasoning: A New …

200 篇论文

Recent advances in multimodal Reward Models (RMs) have shown significant promise in delivering reward signals to align vision models with human preferences. However, current RMs are generally restricted to providing direct responses or…

计算机视觉与模式识别 · 计算机科学 2025-10-30 Yibin Wang , Zhimin Li , Yuhang Zang , Chunyu Wang , Qinglin Lu , Cheng Jin , Jiaqi Wang

Commonsense reasoning is a critical AI capability, but it is difficult to construct challenging datasets that test common sense. Recent neural question answering systems, based on large pre-trained models of language, have already achieved…

计算与语言 · 计算机科学 2019-07-29 Michael Chen , Mike D'Arcy , Alisa Liu , Jared Fernandez , Doug Downey

When exploring the development of Artificial General Intelligence (AGI), a critical task for these models involves interpreting and processing information from multiple image inputs. However, Large Multimodal Models (LMMs) encounter two…

计算机视觉与模式识别 · 计算机科学 2024-01-08 Daoan Zhang , Junming Yang , Hanjia Lyu , Zijian Jin , Yuan Yao , Mingkai Chen , Jiebo Luo

Large language models (LLMs) have demonstrated remarkable capabilities in tasks requiring reasoning and multi-step problem-solving through the use of chain-of-thought (CoT) prompting. However, generating the full CoT process results in…

计算与语言 · 计算机科学 2024-09-16 Tianqiao Liu , Zui Chen , Zitao Liu , Mi Tian , Weiqi Luo

Chain-of-thought (CoT) reasoning has been highly successful in solving complex tasks in natural language processing, and recent multimodal large language models (MLLMs) have extended this paradigm to video reasoning. However, these models…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Yiwu Zhong , Zi-Yuan Hu , Yin Li , Liwei Wang

Reasoning ability is one of the most crucial capabilities of a foundation model, signifying its capacity to address complex reasoning tasks. Chain-of-Thought (CoT) technique is widely regarded as one of the effective methods for enhancing…

计算与语言 · 计算机科学 2023-08-14 Fanglong Yao , Changyuan Tian , Jintao Liu , Zequn Zhang , Qing Liu , Li Jin , Shuchao Li , Xiaoyu Li , Xian Sun

Despite significant advancements, current large language models (LLMs) and vision-language models (LVLMs) continue to struggle with complex, multi-step, cross-modal common sense reasoning tasks, often exhibiting a lack of "deliberative…

计算与语言 · 计算机科学 2025-08-06 Wenjie Luo , Ruocheng Li , Shanshan Zhu , Julian Perry

Reasoning methods, best exemplified by the well-known Chain-of-Thought (CoT), empower the reasoning abilities of Large Language Models (LLMs) by eliciting them to solve complex tasks in a step-by-step manner. Although they are achieving…

计算与语言 · 计算机科学 2024-06-24 Leonardo Ranaldi , Giulia Pucci , Federico Ranaldi , Elena Sofia Ruzzetti , Fabio Massimo Zanzotto

Humans construct internal world models and reason by manipulating the concepts within these models. Recent advances in AI, particularly chain-of-thought (CoT) reasoning, approximate such human cognitive abilities, where world models are…

Mathematical reasoning remains a significant challenge for large language models (LLMs), despite progress in prompting techniques such as Chain-of-Thought (CoT). We present **Chain of Mathematically Annotated Thought (CoMAT)**, which…

人工智能 · 计算机科学 2026-01-16 Joshua Ong Jun Leang , Aryo Pradipta Gema , Shay B. Cohen

Language models have recently advanced into the realm of reasoning, yet it is through multimodal reasoning that we can fully unlock the potential to achieve more comprehensive, human-like cognitive capabilities. This survey provides a…

计算与语言 · 计算机科学 2025-03-25 Zhiyu Lin , Yifei Gao , Xian Zhao , Yunfan Yang , Jitao Sang

Although large language models (LLMs) have achieved excellent performance in a variety of evaluation benchmarks, they still struggle in complex reasoning tasks which require specific knowledge and multi-hop reasoning. To improve the…

计算与语言 · 计算机科学 2023-11-07 Zhipeng Chen , Kun Zhou , Beichen Zhang , Zheng Gong , Wayne Xin Zhao , Ji-Rong Wen

Video content comprehension is essential for various applications, ranging from video analysis to interactive systems. Despite advancements in large-scale vision-language models (VLMs), these models often struggle to capture the nuanced,…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Shuyi Zhang , Xiaoshuai Hao , Yingbo Tang , Lingfeng Zhang , Pengwei Wang , Zhongyuan Wang , Hongxuan Ma , Shanghang Zhang

Real-world reasoning often requires combining information across modalities, connecting textual context with visual cues in a multi-hop process. Yet, most multimodal benchmarks fail to capture this ability: they typically rely on single…

机器学习 · 计算机科学 2026-04-03 Junyoung Sung , Seungwoo Lyu , Minjun Kim , Sumin An , Arsha Nagrani , Paul Hongsuck Seo

Mathematical reasoning is regarded as a necessary ability for Language Models (LMs). Recent works demonstrate large LMs' impressive performance in solving math problems. The success is attributed to their Chain-of-Thought (CoT) reasoning…

计算与语言 · 计算机科学 2023-06-08 Tianduo Wang , Wei Lu

Recently, Interleaved-modal Chain-of-Thought (ICoT) reasoning has achieved remarkable success by leveraging both multimodal inputs and outputs, attracting increasing attention. While achieving promising performance, current ICoT methods…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Xu Liu , Yongheng Zhang , Qiguang Chen , Yao Li , Sheng Wang , Libo Qin

Large language models (LLMs) can achieve highly effective performance on various reasoning tasks by incorporating step-by-step chain-of-thought (CoT) prompting as demonstrations. However, the reasoning chains of demonstrations generated by…

计算与语言 · 计算机科学 2024-03-18 Jiashuo Sun , Yi Luo , Yeyun Gong , Chen Lin , Yelong Shen , Jian Guo , Nan Duan

Large language models (LLMs) have shown impressive capabilities in handling complex tasks through long-chain reasoning. However, the extensive reasoning steps involved can significantly increase computational costs, posing challenges for…

计算与语言 · 计算机科学 2025-05-28 Yunhao Wang , Yuhao Zhang , Tinghao Yu , Can Xu , Feng Zhang , Fengzong Lian

The rapid advancement of Large Multi-modal Models (LMMs) has enabled their application in scientific problem-solving, yet their fine-grained capabilities remain under-explored. In this paper, we introduce SciVerse, a multi-modal scientific…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Ziyu Guo , Ray Zhang , Hao Chen , Jialin Gao , Dongzhi Jiang , Jiaze Wang , Pheng-Ann Heng

While Chain-of-Thought (CoT) prompting has significantly advanced the reasoning capabilities of Multimodal Large Language Models (MLLMs), relying solely on linear text sequences remains a bottleneck for complex tasks. We observe that even…