中文
相关论文

相关论文: Socratic Questioning: Learn to Self-guide Multimod…

200 篇论文

Multimodal large language models (MLLMs) show promise in tasks like visual question answering (VQA) but still face challenges in multimodal reasoning. Recent works adapt agentic frameworks or chain-of-thought (CoT) reasoning to improve…

The development of Reasoning Large Language Models (RLLMs) has significantly improved multi-step reasoning capabilities, but it has also made hallucination problems more frequent and harder to eliminate. While existing approaches mitigate…

计算机与社会 · 计算机科学 2025-12-29 Haolang Lu , Yilian Liu , Jingxin Xu , Guoshun Nan , Yuanlong Yu , Zhican Chen , Kun Wang

Large Multimodal Models (LMMs) have achieved impressive progress in visual perception and reasoning. However, when confronted with visually ambiguous or non-semantic scene text, they often struggle to accurately spot and understand the…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Yan Shu , Hangui Lin , Yexin Liu , Yan Zhang , Gangyan Zeng , Yan Li , Yu Zhou , Ser-Nam Lim , Harry Yang , Nicu Sebe

Large Language Models (LLMs) demonstrate impressive reasoning ability and the maintenance of world knowledge not only in natural language tasks, but also in some vision-language tasks such as open-domain knowledge-based visual question…

计算与语言 · 计算机科学 2024-06-11 Ziyue Wang , Chi Chen , Peng Li , Yang Liu

Reasoning Vision-Language Models (VLMs) have shown promising performance on complex multimodal tasks. However, they still face significant challenges: they are highly sensitive to reasoning errors, require large volumes of annotated data or…

计算机视觉与模式识别 · 计算机科学 2025-10-24 Yi Ding , Ruqi Zhang

In recent advancements, multimodal large language models (MLLMs) have been fine-tuned on specific medical image datasets to address medical visual question answering (Med-VQA) tasks. However, this common approach of task-specific…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Lai Wei , Wenkai Wang , Xiaoyu Shen , Yu Xie , Zhihao Fan , Xiaojin Zhang , Zhongyu Wei , Wei Chen

Chain-of-thought (CoT) reasoning has exhibited impressive performance in language models for solving complex tasks and answering questions. However, many real-world questions require multi-modal information, such as text and images.…

人工智能 · 计算机科学 2023-12-15 Liqi He , Zuchao Li , Xiantao Cai , Ping Wang

Multimodal Large Language Models (MLLMs) have achieved remarkable progress in multimodal reasoning. However, they often excessively rely on textual information during the later stages of inference, neglecting the crucial integration of…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Shuo Yang , Yuwei Niu , Yuyang Liu , Yang Ye , Bin Lin , Li Yuan

Large Vision Language Models (LVLMs) achieve strong multimodal reasoning but frequently exhibit hallucinations and incorrect responses with high certainty, which hinders their usage in high-stakes domains. Existing verbalized confidence…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Wenyi Xiao , Xinchi Xu , Leilei Gan

While visual question-answering (VQA) benchmarks have catalyzed the development of reasoning techniques, they have focused on vertical thinking. Effective problem-solving also necessitates lateral thinking, which remains understudied in AI…

计算机视觉与模式识别 · 计算机科学 2024-12-23 Koen Kraaijveld , Yifan Jiang , Kaixin Ma , Filip Ilievski

Vision-language models (VLMs) have demonstrated strong reasoning abilities in literal multimodal tasks such as visual mathematics and science question answering. However, figurative language, such as sarcasm, humor, and metaphor, remains a…

计算与语言 · 计算机科学 2026-01-27 Seyyed Saeid Cheshmi , Hahnemann Ortiz , James Mooney , Dongyeop Kang

While Multimodal Large Language Models (MLLMs) have achieved remarkable progress in open-ended visual question answering, they remain vulnerable to hallucinations. These are outputs that contradict or misrepresent input semantics, posing a…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Jianjiang Yang , Yanshu li , Ziyan Huang

Recently evolved large reasoning models (LRMs) show powerful performance in solving complex tasks with long chain-of-thought (CoT) reasoning capability. As these LRMs are mostly developed by post-training on formal reasoning tasks, whether…

计算与语言 · 计算机科学 2025-05-30 Zijun Yao , Yantao Liu , Yanxu Chen , Jianhui Chen , Junfeng Fang , Lei Hou , Juanzi Li , Tat-Seng Chua

While Multimodal Large Language Models (MLLMs) offer strong perception and reasoning capabilities for image-text input, Visual Question Answering (VQA) focusing on small image details still remains a challenge. Although visual cropping…

计算机视觉与模式识别 · 计算机科学 2025-10-30 Liangyu Zhong , Fabio Rosenthal , Joachim Sicking , Fabian Hüger , Thorsten Bagdonat , Hanno Gottschalk , Leo Schwinn

Comprehensively understanding surgical scenes in Surgical Visual Question Answering (Surgical VQA) requires reasoning over multiple objects. Previous approaches address this task using cross-modal fusion strategies to enhance reasoning…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Wenjun Hou , Yi Cheng , Kaishuai Xu , Yan Hu , Wenjie Li , Jiang Liu

Visual Question Answering (VQA) often involves diverse reasoning scenarios across Vision and Language (V&L). Most prior VQA studies, however, have merely focused on assessing the model's overall accuracy without evaluating it on different…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Jihyung Kil , Farideh Tavazoee , Dongyeop Kang , Joo-Kyung Kim

Recent advancements in reinforcement learning (RL) have enhanced the reasoning abilities of large language models (LLMs), yet the impact on multimodal LLMs (MLLMs) is limited. Particularly in vision-intensive tasks like geometric reasoning,…

计算与语言 · 计算机科学 2025-09-23 Guizhen Chen , Weiwen Xu , Hao Zhang , Hou Pong Chan , Deli Zhao , Anh Tuan Luu , Yu Rong

Multilingual Large Language Models(MLLMs) demonstrate strong generalization across languages, yet they remain prone to hallucinations, especially in low-resource languages, due to training data imbalances. These hallucinations, which…

计算与语言 · 计算机科学 2025-07-22 Weihua Zheng , Roy Ka-Wei Lee , Zhengyuan Liu , Kui Wu , AiTi Aw , Bowei Zou

Large Language Models (LLMs) have demonstrated impressive progress in complex reasoning tasks, largely driven by the Chain-of-Thought (CoT) paradigm, which decomposes difficult problems into intermediate steps. However, CoT reasoning…

符号计算 · 计算机科学 2026-05-26 Rui Wang , Zeming Wei , Yihao Zhang , Xiaokun Luan

Multimodal large language models (MLLMs) perform well on many vision-language tasks but often struggle with vision-centric problems that require fine-grained visual reasoning. Recent evidence suggests that this limitation arises not from…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Sophia Sirko-Galouchenko , Monika Wysoczanska , Andrei Bursuc , Nicolas Thome , Spyros Gidaris