中文
相关论文

相关论文: AIM-CoT: Active Information-driven Multimodal Chai…

200 篇论文

Recent advances in multimodal techniques have led to significant progress in Medical Visual Question Answering (Med-VQA). However, most existing models focus on global image features rather than localizing disease-specific regions crucial…

计算工程、金融与科学 · 计算机科学 2025-06-30 Yuan Wang , Jiaxiang Liu , Shujian Gao , Bin Feng , Zhihang Tang , Xiaotang Gai , Jian Wu , Zuozhu Liu

Zero-shot Chain-of-Thought (CoT) prompting emerges as a simple and effective strategy for enhancing the performance of large language models (LLMs) in real-world reasoning tasks. Nonetheless, the efficacy of a singular, task-level prompt…

计算与语言 · 计算机科学 2024-11-01 Xiaosong Yuan , Chen Shen , Shaotian Yan , Xiaofeng Zhang , Liang Xie , Wenxiao Wang , Renchu Guan , Ying Wang , Jieping Ye

Chain-of-Thought (CoT) reasoning has proven effective in natural language tasks but remains underexplored in multimodal alignment. This study investigates its integration into 3D vision-language learning by embedding structured reasoning…

计算与语言 · 计算机科学 2025-03-18 Yanjun Chen , Yirong Sun , Xinghao Chen , Jian Wang , Xiaoyu Shen , Wenjie Li , Wei Zhang

Despite great progress, existing multimodal large language models (MLLMs) are prone to visual hallucination, greatly impeding their trustworthy applications. In this paper, we study this problem from the perspective of visual-spatial…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Qiong Wu , Xiangcong Yang , Yiyi Zhou , Chenxin Fang , Baiyang Song , Xiaoshuai Sun , Rongrong Ji

Recent large vision-language models (LVLMs) have demonstrated impressive reasoning ability by generating long chain-of-thought (CoT) responses. However, CoT reasoning in multimodal contexts is highly vulnerable to visual hallucination…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Yongchang Zhang , Oliver Ma , Tianyi Liu , Guangquan Zhou , Yang Chen

While Chain-of-Thought (CoT) prompting has significantly advanced the reasoning capabilities of Multimodal Large Language Models (MLLMs), relying solely on linear text sequences remains a bottleneck for complex tasks. We observe that even…

Recently, the introduction of Chain-of-Thought (CoT) has largely improved the generation ability of unified models. However, it is observed that the current thinking process during generation mainly focuses on the text consistency with the…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Zixuan Ye , Quande Liu , Cong Wei , Yuanxing Zhang , Xintao Wang , Pengfei Wan , Kun Gai , Wenhan Luo

While large multi-modal models (LMMs) have exhibited impressive capabilities across diverse tasks, their effectiveness in handling complex tasks has been limited by the prevailing single-step reasoning paradigm. To this end, this paper…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Zejun Li , Ruipu Luo , Jiwen Zhang , Minghui Qiu , Xuanjing Huang , Zhongyu Wei

Since the resurgence of deep learning, vision-language models (VLMs) enhanced by large language models (LLMs) have grown exponentially in popularity. However, while LLMs can utilize extensive background knowledge and task information with…

计算与语言 · 计算机科学 2024-03-21 Haozhe Zhao , Zefan Cai , Shuzheng Si , Xiaojian Ma , Kaikai An , Liang Chen , Zixuan Liu , Sheng Wang , Wenjuan Han , Baobao Chang

Image Quality Assessment (IQA) models are increasingly deployed as perceptual critics to guide generative models and image restoration. This role demands not only accurate scores but also actionable, localized feedback. However, current…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Xudong Li , Jiaxi Tan , Ziyin Zhou , Yan Zhong , Zihao Huang , Jingyuan Zheng , Yan Zhang , Xiawu Zheng , Rongrong Ji

Chain-of-thought (CoT) reasoning enhances performance of large language models, but questions remain about whether these reasoning traces faithfully reflect the internal processes of the model. We present the first comprehensive study of…

计算与语言 · 计算机科学 2025-11-04 Sriram Balasubramanian , Samyadeep Basu , Soheil Feizi

Implicit Chain-of-Thought (CoT) methods offer a token-efficient alternative to explicit CoT reasoning in Large Language Models (LLMs), but a persistent performance gap has limited their adoption. We identify a core latent instability issue…

计算与语言 · 计算机科学 2025-09-26 Xilin Wei , Xiaoran Liu , Yuhang Zang , Xiaoyi Dong , Yuhang Cao , Jiaqi Wang , Xipeng Qiu , Dahua Lin

Multimodal reasoning is a critical component in the pursuit of artificial intelligence systems that exhibit human-like intelligence, especially when tackling complex tasks. While the chain-of-thought (CoT) technique has gained considerable…

人工智能 · 计算机科学 2023-09-26 Jingxuan Wei , Cheng Tan , Zhangyang Gao , Linzhuang Sun , Siyuan Li , Bihui Yu , Ruifeng Guo , Stan Z. Li

Multimodal reasoning aims to enhance the capabilities of MLLMs by incorporating intermediate reasoning steps before reaching the final answer. It has evolved from text-only reasoning to the integration of visual information, enabling the…

计算机视觉与模式识别 · 计算机科学 2026-01-29 Chao Chen , Zhixin Ma , Yongqi Li , Yupeng Hu , Yinwei Wei , Wenjie Li , Liqiang Nie

Video Question Answering (VideoQA) aims to answer natural language questions based on the given video, with prior work primarily focusing on identifying the duration of relevant segments, referred to as explicit visual evidence. However,…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Tieyuan Chen , Huabin Liu , Yi Wang , Chaofan Gan , Mingxi Lyu , Ziran Qin , Shijie Li , Liquan Shen , Junhui Hou , Zheng Wang , Weiyao Lin

In recent advancements, multimodal large language models (MLLMs) have been fine-tuned on specific medical image datasets to address medical visual question answering (Med-VQA) tasks. However, this common approach of task-specific…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Lai Wei , Wenkai Wang , Xiaoyu Shen , Yu Xie , Zhihao Fan , Xiaojin Zhang , Zhongyu Wei , Wei Chen

Complex Visual Question Answering (Complex VQA) tasks, which demand sophisticated multi-modal reasoning and external knowledge integration, present significant challenges for existing large vision-language models (LVLMs) often limited by…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Jingwei Peng , Jiehao Chen , Mateo Alejandro Rojas , Meilin Zhang

Recent large language models achieve strong reasoning performance by generating detailed chain-of-thought traces, but this often leads to excessive token use and high inference latency. Existing efficiency approaches typically focus on…

计算与语言 · 计算机科学 2025-12-01 Lukas Struppek , Dominik Hintersdorf , Hannah Struppek , Daniel Neider , Kristian Kersting

The increasing availability of multimodal data across text, tables, and images presents new challenges for developing models capable of complex cross-modal reasoning. Existing methods for Multimodal Multi-hop Question Answering (MMQA) often…

计算机视觉与模式识别 · 计算机科学 2025-04-14 Qi Zhi Lim , Chin Poo Lee , Kian Ming Lim , Kalaiarasi Sonai Muthu Anbananthen

Multimodal Large Language Models (MLLMs) have shown impressive performance on vision-language tasks, but their long Chain-of-Thought (CoT) capabilities in multimodal scenarios remain underexplored. Inspired by OpenAI's o3 model, which…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Ye Wang , Qianglong Chen , Zejun Li , Siyuan Wang , Shijie Guo , Zhirui Zhang , Zhongyu Wei