English
Related papers

Related papers: Socratic Questioning: Learn to Self-guide Multimod…

200 papers

Multimodal large language models (MLLMs) show promise in tasks like visual question answering (VQA) but still face challenges in multimodal reasoning. Recent works adapt agentic frameworks or chain-of-thought (CoT) reasoning to improve…

Artificial Intelligence · Computer Science 2025-03-12 Zhuo Zhi , Chen Feng , Adam Daneshmend , Mine Orlu , Andreas Demosthenous , Lu Yin , Da Li , Ziquan Liu , Miguel R. D. Rodrigues

The development of Reasoning Large Language Models (RLLMs) has significantly improved multi-step reasoning capabilities, but it has also made hallucination problems more frequent and harder to eliminate. While existing approaches mitigate…

Computers and Society · Computer Science 2025-12-29 Haolang Lu , Yilian Liu , Jingxin Xu , Guoshun Nan , Yuanlong Yu , Zhican Chen , Kun Wang

Large Multimodal Models (LMMs) have achieved impressive progress in visual perception and reasoning. However, when confronted with visually ambiguous or non-semantic scene text, they often struggle to accurately spot and understand the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Yan Shu , Hangui Lin , Yexin Liu , Yan Zhang , Gangyan Zeng , Yan Li , Yu Zhou , Ser-Nam Lim , Harry Yang , Nicu Sebe

Large Language Models (LLMs) demonstrate impressive reasoning ability and the maintenance of world knowledge not only in natural language tasks, but also in some vision-language tasks such as open-domain knowledge-based visual question…

Computation and Language · Computer Science 2024-06-11 Ziyue Wang , Chi Chen , Peng Li , Yang Liu

Reasoning Vision-Language Models (VLMs) have shown promising performance on complex multimodal tasks. However, they still face significant challenges: they are highly sensitive to reasoning errors, require large volumes of annotated data or…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Yi Ding , Ruqi Zhang

In recent advancements, multimodal large language models (MLLMs) have been fine-tuned on specific medical image datasets to address medical visual question answering (Med-VQA) tasks. However, this common approach of task-specific…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Lai Wei , Wenkai Wang , Xiaoyu Shen , Yu Xie , Zhihao Fan , Xiaojin Zhang , Zhongyu Wei , Wei Chen

Chain-of-thought (CoT) reasoning has exhibited impressive performance in language models for solving complex tasks and answering questions. However, many real-world questions require multi-modal information, such as text and images.…

Artificial Intelligence · Computer Science 2023-12-15 Liqi He , Zuchao Li , Xiantao Cai , Ping Wang

Multimodal Large Language Models (MLLMs) have achieved remarkable progress in multimodal reasoning. However, they often excessively rely on textual information during the later stages of inference, neglecting the crucial integration of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Shuo Yang , Yuwei Niu , Yuyang Liu , Yang Ye , Bin Lin , Li Yuan

Large Vision Language Models (LVLMs) achieve strong multimodal reasoning but frequently exhibit hallucinations and incorrect responses with high certainty, which hinders their usage in high-stakes domains. Existing verbalized confidence…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Wenyi Xiao , Xinchi Xu , Leilei Gan

While visual question-answering (VQA) benchmarks have catalyzed the development of reasoning techniques, they have focused on vertical thinking. Effective problem-solving also necessitates lateral thinking, which remains understudied in AI…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Koen Kraaijveld , Yifan Jiang , Kaixin Ma , Filip Ilievski

Vision-language models (VLMs) have demonstrated strong reasoning abilities in literal multimodal tasks such as visual mathematics and science question answering. However, figurative language, such as sarcasm, humor, and metaphor, remains a…

Computation and Language · Computer Science 2026-01-27 Seyyed Saeid Cheshmi , Hahnemann Ortiz , James Mooney , Dongyeop Kang

While Multimodal Large Language Models (MLLMs) have achieved remarkable progress in open-ended visual question answering, they remain vulnerable to hallucinations. These are outputs that contradict or misrepresent input semantics, posing a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Jianjiang Yang , Yanshu li , Ziyan Huang

Recently evolved large reasoning models (LRMs) show powerful performance in solving complex tasks with long chain-of-thought (CoT) reasoning capability. As these LRMs are mostly developed by post-training on formal reasoning tasks, whether…

Computation and Language · Computer Science 2025-05-30 Zijun Yao , Yantao Liu , Yanxu Chen , Jianhui Chen , Junfeng Fang , Lei Hou , Juanzi Li , Tat-Seng Chua

While Multimodal Large Language Models (MLLMs) offer strong perception and reasoning capabilities for image-text input, Visual Question Answering (VQA) focusing on small image details still remains a challenge. Although visual cropping…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Liangyu Zhong , Fabio Rosenthal , Joachim Sicking , Fabian Hüger , Thorsten Bagdonat , Hanno Gottschalk , Leo Schwinn

Comprehensively understanding surgical scenes in Surgical Visual Question Answering (Surgical VQA) requires reasoning over multiple objects. Previous approaches address this task using cross-modal fusion strategies to enhance reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Wenjun Hou , Yi Cheng , Kaishuai Xu , Yan Hu , Wenjie Li , Jiang Liu

Visual Question Answering (VQA) often involves diverse reasoning scenarios across Vision and Language (V&L). Most prior VQA studies, however, have merely focused on assessing the model's overall accuracy without evaluating it on different…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jihyung Kil , Farideh Tavazoee , Dongyeop Kang , Joo-Kyung Kim

Recent advancements in reinforcement learning (RL) have enhanced the reasoning abilities of large language models (LLMs), yet the impact on multimodal LLMs (MLLMs) is limited. Particularly in vision-intensive tasks like geometric reasoning,…

Computation and Language · Computer Science 2025-09-23 Guizhen Chen , Weiwen Xu , Hao Zhang , Hou Pong Chan , Deli Zhao , Anh Tuan Luu , Yu Rong

Multilingual Large Language Models(MLLMs) demonstrate strong generalization across languages, yet they remain prone to hallucinations, especially in low-resource languages, due to training data imbalances. These hallucinations, which…

Computation and Language · Computer Science 2025-07-22 Weihua Zheng , Roy Ka-Wei Lee , Zhengyuan Liu , Kui Wu , AiTi Aw , Bowei Zou

Large Language Models (LLMs) have demonstrated impressive progress in complex reasoning tasks, largely driven by the Chain-of-Thought (CoT) paradigm, which decomposes difficult problems into intermediate steps. However, CoT reasoning…

Symbolic Computation · Computer Science 2026-05-26 Rui Wang , Zeming Wei , Yihao Zhang , Xiaokun Luan

Multimodal large language models (MLLMs) perform well on many vision-language tasks but often struggle with vision-centric problems that require fine-grained visual reasoning. Recent evidence suggests that this limitation arises not from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Sophia Sirko-Galouchenko , Monika Wysoczanska , Andrei Bursuc , Nicolas Thome , Spyros Gidaris