中文
相关论文

相关论文: Thinking with Images as Continuous Actions: Numeri…

200 篇论文

Multi-modal reasoning requires the seamless integration of visual and linguistic cues, yet existing Chain-of-Thought methods suffer from two critical limitations in cross-modal scenarios: (1) over-reliance on single coarse-grained image…

计算机视觉与模式识别 · 计算机科学 2026-01-07 Wenting Lu , Didi Zhu , Tao Shen , Donglin Zhu , Ayong Ye , Chao Wu

In recent advancements, multimodal large language models (MLLMs) have been fine-tuned on specific medical image datasets to address medical visual question answering (Med-VQA) tasks. However, this common approach of task-specific…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Lai Wei , Wenkai Wang , Xiaoyu Shen , Yu Xie , Zhihao Fan , Xiaojin Zhang , Zhongyu Wei , Wei Chen

Numerous applications of large language models (LLMs) rely on their ability to perform step-by-step reasoning. However, the reasoning behavior of LLMs remains poorly understood, posing challenges to research, development, and safety. To…

机器学习 · 计算机科学 2026-03-04 Zhanke Zhou , Zhaocheng Zhu , Xuan Li , Mikhail Galkin , Xiao Feng , Sanmi Koyejo , Jian Tang , Bo Han

While Large Language Models (LLMs) have excelled in textual reasoning, they struggle with mathematical domains like geometry that intrinsically rely on visual aids. Existing approaches to Visual Chain-of-Thought (VCoT) are often limited by…

计算机视觉与模式识别 · 计算机科学 2025-10-17 Weikang Shi , Aldrich Yu , Rongyao Fang , Houxing Ren , Ke Wang , Aojun Zhou , Changyao Tian , Xinyu Fu , Yuxuan Hu , Zimu Lu , Linjiang Huang , Si Liu , Rui Liu , Hongsheng Li

While previous multimodal slow-thinking methods have demonstrated remarkable success in single-image understanding scenarios, their effectiveness becomes fundamentally constrained when extended to more complex multi-image comprehension…

计算机视觉与模式识别 · 计算机科学 2025-12-05 Guanghao Zhang , Tao Zhong , Yan Xia , Mushui Liu , Zhelun Yu , Haoyuan Li , Wanggui He , Fangxun Shu , Dong She , Yi Wang , Hao Jiang

Graph Chain-of-Thought (Graph-CoT) enables large language models (LLMs) to perform step-by-step reasoning over graph-structured knowledge, but existing pipelines suffer from low accuracy, excessive token usage, high latency, and low…

Medical Vision-Language Models have shown promising potential in clinical decision support, yet they remain prone to factual hallucinations due to insufficient grounding in localized pathological evidence. Existing medical alignment methods…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Xiwei Liu , Yulong Li , Xinlin Zhuang , Xuhui Li , Jianxu Chen , Haolin Yang , Imran Razzak , Yutong Xie

Chain-of-Thought (CoT) prompting helps models think step by step. But naive CoT breaks down in visually grounded social tasks, where models must perceive, understand, and judge all at once; bridging perception with norm-grounded reasoning.…

计算与语言 · 计算机科学 2026-04-21 Eunkyu Park , Wesley Hanwen Deng , Gunhee Kim , Motahhare Eslami , Maarten Sap

While multimodal large language models (MLLMs) have made groundbreaking progress in embodied intelligence, they still face significant challenges in spatial reasoning for complex long-horizon tasks. To address this gap, we propose…

Recently, Chain-of-Thought (CoT) reasoning has significantly enhanced the capabilities of large language models (LLMs), but Vision-Language Models (VLMs) still struggle with multi-step reasoning tasks due to limited multimodal reasoning…

计算与语言 · 计算机科学 2026-03-23 Yuliang Zhan , Xinyu Tang , Han Wan , Jian Li , Ji-Rong Wen , Hao Sun

Multi-modal Chain-of-Thought (MCoT) requires models to leverage knowledge from both textual and visual modalities for step-by-step reasoning, which gains increasing attention. Nevertheless, the current MCoT benchmark still faces some…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Qiguang Chen , Libo Qin , Jin Zhang , Zhi Chen , Xiao Xu , Wanxiang Che

Recent advancements in deep learning have led to the development of powerful language models (LMs) that excel in various tasks. Despite these achievements, there is still room for improvement, particularly in enhancing reasoning abilities…

计算与语言 · 计算机科学 2023-12-27 Abhinav Arun , Dipendra Singh Mal , Mehul Soni , Tomohiro Sawada

With the remarkable success of Multimodal Large Language Models (MLLMs) in perception tasks, enhancing their complex reasoning capabilities has emerged as a critical research focus. Existing models still suffer from challenges such as…

计算与语言 · 计算机科学 2025-12-01 Wenxin Zhu , Andong Chen , Yuchen Song , Kehai Chen , Conghui Zhu , Ziyan Chen , Tiejun Zhao

Spatial reasoning from monocular images is essential for autonomous driving, yet current Vision-Language Models (VLMs) still struggle with fine-grained geometric perception, particularly under large scale variation and ambiguous object…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Yanchun Cheng , Rundong Wang , Xulei Yang , Alok Prakash , Daniela Rus , Marcelo H Ang , ShiJie Li

Large Language Models (LLMs) have achieved remarkable reliability and advanced capabilities through extended test-time reasoning. However, extending these capabilities to Multi-modal Large Language Models (MLLMs) remains a significant…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Yuhao Dong , Zuyan Liu , Shulin Tian , Yongming Rao , Ziwei Liu

Recent advancements in Chain-of-Thought (CoT) and related rationale-based works have significantly improved the performance of Large Language Models (LLMs) in complex reasoning tasks. With the evolution of Multimodal Large Language Models…

人工智能 · 计算机科学 2024-05-30 Qiji Zhou , Ruochen Zhou , Zike Hu , Panzhong Lu , Siyang Gao , Yue Zhang

Although data visualization is powerful for revealing patterns and communicating insights, creating effective visualizations requires familiarity with authoring tools and often disrupts the analysis flow. While large language models show…

人工智能 · 计算机科学 2025-12-16 Zhihao Shuai , Boyan Li , Siyu Yan , Yuyu Luo , Weikai Yang

While the recent Chain-of-Thought (CoT) technique enhances the reasoning ability of large language models (LLMs) with the theory of mind, it might still struggle in handling logical reasoning that relies much on symbolic expressions and…

计算与语言 · 计算机科学 2024-06-12 Jundong Xu , Hao Fei , Liangming Pan , Qian Liu , Mong-Li Lee , Wynne Hsu

In this work, we study the problem of Text-to-Image In-Context Learning (T2I-ICL). While Unified Multimodal LLMs (MLLMs) have advanced rapidly in recent years, they struggle with contextual reasoning in T2I-ICL scenarios. To address this…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Jiaqi Liao , Zhengyuan Yang , Linjie Li , Dianqi Li , Kevin Lin , Yu Cheng , Lijuan Wang

Many reasoning techniques for large multimodal models adapt language model approaches, such as Chain-of-Thought (CoT) prompting, which express reasoning as word sequences. While effective for text, these methods are suboptimal for…

计算机视觉与模式识别 · 计算机科学 2025-09-25 Tan-Hanh Pham , Chris Ngo