English
Related papers

Related papers: MMBoundary: Advancing MLLM Knowledge Boundary Awar…

200 papers

Reliability and failure detection of large language models (LLMs) is critical for their deployment in high-stakes, multi-step reasoning tasks. Prior work explores confidence estimation for self-evaluating LLM-scorer systems, with confidence…

Machine Learning · Computer Science 2025-11-11 Vaibhav Mavi , Shubh Jaroria , Weiqi Sun

Reasoning has substantially improved the performance of large language models (LLMs) on complicated tasks. Central to the current reasoning studies, Process Reward Models (PRMs) offer a fine-grained evaluation of intermediate reasoning…

Machine Learning · Computer Science 2025-11-05 Qi Cao , Ruiyi Wang , Ruiyi Zhang , Sai Ashish Somayajula , Pengtao Xie

The ability to process information from multiple modalities and to reason through it step-by-step remains a critical challenge in advancing artificial intelligence. However, existing reasoning benchmarks focus on text-only reasoning, or…

Artificial Intelligence · Computer Science 2025-07-01 Yulun Jiang , Yekun Chai , Maria Brbić , Michael Moor

Recent advances in multimodal large language models (MLLMs) have catalyzed transformative progress in affective computing, enabling models to exhibit emergent emotional intelligence. Despite substantial methodological progress, current…

Large language models (LLMs) have been shown to perform better when asked to reason step-by-step before answering a question. However, it is unclear to what degree the model's final answer is faithful to the stated reasoning steps. In this…

Computation and Language · Computer Science 2024-10-08 Debjit Paul , Robert West , Antoine Bosselut , Boi Faltings

As the field of Multimodal Large Language Models (MLLMs) continues to evolve, their potential to revolutionize artificial intelligence is particularly promising, especially in addressing mathematical reasoning tasks. Current mathematical…

Knowledge augmentation has significantly enhanced the performance of Large Language Models (LLMs) in knowledge-intensive tasks. However, existing methods typically operate on the simplistic premise that model performance equates with…

Computation and Language · Computer Science 2026-02-16 Hao Chen , Ye He , Yuchun Fan , Yukun Yan , Zhenghao Liu , Qingfu Zhu , Maosong Sun , Wanxiang Che

In recent years, large language models (LLMs) have driven major advances in language understanding, marking a significant step toward artificial general intelligence (AGI). With increasing demands for higher-level semantics and cross-modal…

Computation and Language · Computer Science 2025-09-30 Yuntao Shou , Tao Meng , Wei Ai , Keqin Li

Uncertainty quantification is essential for assessing the reliability and trustworthiness of modern AI systems. Among existing approaches, verbalized uncertainty, where models express their confidence through natural language, has emerged…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Weihao Xuan , Qingcheng Zeng , Heli Qi , Junjue Wang , Naoto Yokoya

Reasoning-enhanced large language models (LLMs) explicitly generate intermediate reasoning steps prior to generating final answers, helping the model excel in complex problem-solving. In this paper, we demonstrate that this emerging…

Machine Learning · Computer Science 2025-05-22 Tong Wu , Chong Xiang , Jiachen T. Wang , G. Edward Suh , Prateek Mittal

Self-improvement in multimodal large language models (MLLMs) is crucial for enhancing their reliability and robustness. However, current methods often rely heavily on MLLMs themselves as judges, leading to high computational costs and…

Computation and Language · Computer Science 2024-11-28 Shijian Deng , Wentian Zhao , Yu-Jhe Li , Kun Wan , Daniel Miranda , Ajinkya Kale , Yapeng Tian

Multimodal Large Language Models (MLLMs) have made remarkable progress in multimodal perception and reasoning by bridging vision and language. However, most existing MLLMs perform reasoning primarily with textual CoT, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Jintao Tong , Shilin Yan , Hongwei Xue , Xiaojun Tang , Kunyu Shi , Guannan Zhang , Ruixuan Li , Yixiong Zou

Recent progress in Multimodal Large Language Models (MLLMs) has demonstrated remarkable advances in perception and reasoning, suggesting their potential for embodied intelligence. While recent studies have evaluated embodied MLLMs in…

Artificial Intelligence · Computer Science 2026-04-23 Shengyu Guo , Tongrui Ye , Jianbo Zhang , Zicheng Zhang , Chunyi Li , Guangtao Zhai

Recent advancements in large language models (LLMs) have demonstrated substantial progress in reasoning capabilities, such as DeepSeek-R1, which leverages rule-based reinforcement learning to enhance logical reasoning significantly.…

Artificial Intelligence · Computer Science 2025-06-24 Zeyu Liu , Yuhang Liu , Guanghao Zhu , Congkai Xie , Zhen Li , Jianbo Yuan , Xinyao Wang , Qing Li , Shing-Chi Cheung , Shengyu Zhang , Fei Wu , Hongxia Yang

Multimodal large language models (MLLMs) hold considerable promise for applications in healthcare. However, their deployment in safety-critical settings is hindered by two key limitations: (i) sensitivity to prompt design, and (ii) a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Anita Kriz , Elizabeth Laura Janes , Xing Shen , Tal Arbel

A safe and trustworthy use of Large Language Models (LLMs) requires an accurate expression of confidence in their answers. We propose a novel Reinforcement Learning approach that allows to directly fine-tune LLMs to express calibrated…

Computation and Language · Computer Science 2026-03-03 David Bani-Harouni , Chantal Pellegrini , Paul Stangel , Ege Özsoy , Kamilia Zaripova , Nassir Navab , Matthias Keicher

Visual reasoning is central to human cognition, enabling individuals to interpret and abstractly understand their environment. Although recent Multimodal Large Language Models (MLLMs) have demonstrated impressive performance across language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jing Bi , Junjia Guo , Susan Liang , Guangyu Sun , Luchuan Song , Yunlong Tang , Jinxi He , Jiarui Wu , Ali Vosoughi , Chen Chen , Chenliang Xu

The ability to organically reason over and with both text and images is a pillar of human intelligence, yet the ability of Multimodal Large Language Models (MLLMs) to perform such multimodal reasoning remains under-explored. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Yunzhuo Hao , Jiawei Gu , Huichen Will Wang , Linjie Li , Zhengyuan Yang , Lijuan Wang , Yu Cheng

Multimodal large language models (MLLMs) excel at multimodal perception and understanding, yet their tendency to generate hallucinated or inaccurate responses undermines their trustworthiness. Existing methods have largely overlooked the…

Computation and Language · Computer Science 2024-12-17 Yuhao Wang , Zhiyuan Zhu , Heyang Liu , Yusheng Liao , Hongcheng Liu , Yanfeng Wang , Yu Wang

In this paper, we present a holistic multimodal benchmark that evaluates the reasoning capabilities of MLLMs with an explicit focus on reasoning width, a complementary dimension to the more commonly studied reasoning depth. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Mingrui Chen , Hexiong Yang , Haogeng Liu , Huaibo Huang , Ran He