English
Related papers

Related papers: MC-Search: Evaluating and Enhancing Multimodal Age…

200 papers

Deep reasoning is fundamental for solving complex tasks, especially in vision-centric scenarios that demand sequential, multimodal understanding. However, existing benchmarks typically evaluate agents with fully synthetic, single-turn…

Document Visual Question Answering (DocVQA) faces dual challenges in processing lengthy multimodal documents (text, images, tables) and performing cross-modal reasoning. Current document retrieval-augmented generation (DocRAG) methods…

Information Retrieval · Computer Science 2025-11-10 Kuicai Dong , Yujing Chang , Shijie Huang , Yasheng Wang , Ruiming Tang , Yong Liu

Condition monitoring (CM) plays a crucial role in ensuring reliability and efficiency in the process industry. Although computerised maintenance systems effectively detect and classify faults, tasks like fault severity estimation, and…

Machine Learning · Computer Science 2025-06-12 Karl Löwenmark , Daniel Strömbergsson , Chang Liu , Marcus Liwicki , Fredrik Sandin

Multimodal large language models (MLLMs) have shown great potential in perception and interpretation tasks, but their capabilities in predictive reasoning remain under-explored. To address this gap, we introduce a novel benchmark that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Mingwei Zhu , Leigang Sha , Yu Shu , Kangjia Zhao , Tiancheng Zhao , Jianwei Yin

IQ testing has served as a foundational methodology for evaluating human cognitive capabilities, deliberately decoupling assessment from linguistic background, language proficiency, or domain-specific knowledge to isolate core competencies…

Artificial Intelligence · Computer Science 2025-06-05 Huanqia Cai , Yijun Yang , Winston Hu

Existing benchmarks for multimodal agentic search evaluate multimodal search and visual browsing, but visual evidence is either confined to the input or treated as an answer endpoint rather than part of an interleaved search trajectory. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Bohan Hou , Jiuning Gu , Jiayan Guo , Ronghao Dang , Sicong Leng , Xin Li , Xuemeng Song , Jianfei Yang

Large reasoning models (LRMs) combined with retrieval-augmented generation (RAG) have enabled deep research agents capable of multi-step reasoning with external knowledge retrieval. However, we find that existing approaches rarely…

Artificial Intelligence · Computer Science 2026-05-26 Dayoon Ko , Jihyuk Kim , Haeju Park , Sohyeon Kim , Dahyun Lee , Yongrae Jo , Gunhee Kim , Moontae Lee , Kyungjae Lee

Large Language Models (LLMs) hold significant promise for mathematics education, yet they often struggle with complex mathematical reasoning. While Retrieval-Augmented Generation (RAG) mitigates these issues by grounding LLMs in external…

Computation and Language · Computer Science 2025-12-02 Shiting Chen , Zijian Zhao , Jinsong Chen

Open-source multimodal large language models (MLLMs) have shown significant potential in a broad range of multimodal tasks. However, their reasoning capabilities remain constrained by existing instruction-tuning datasets, which were…

Computation and Language · Computer Science 2025-06-05 Jarvis Guo , Tuney Zheng , Yuelin Bai , Bo Li , Yubo Wang , King Zhu , Yizhi Li , Graham Neubig , Wenhu Chen , Xiang Yue

Graph Retrieval-Augmented Generation (GraphRAG) enhances factual reasoning in LLMs by structurally modeling knowledge through graph-based representations. However, existing GraphRAG approaches face two core limitations: shallow retrieval…

Computation and Language · Computer Science 2025-10-01 Cehao Yang , Xiaojun Wu , Xueyuan Lin , Chengjin Xu , Xuhui Jiang , Yuanliang Sun , Jia Li , Hui Xiong , Jian Guo

In this study, we introduced a new benchmark consisting of a curated dataset and a defined evaluation process to assess the compositional reasoning capabilities of large language models within the chemistry domain. We designed and validated…

Computation and Language · Computer Science 2025-08-07 Mohammad Khodadad , Ali Shiraee Kasmaee , Mahdi Astaraki , Nicholas Sherck , Hamidreza Mahyar , Soheila Samiee

Retrieval-Augmented Generation (RAG) has become a robust framework for enhancing Large Language Models (LLMs) with external knowledge. Recent advances in RAG have investigated graph based retrieval for intricate reasoning; however, the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Tejas Sarnaik , Manan Shah , Ravi Hegde

Large language models (LLMs) are widely used in retrieval-augmented generation (RAG) to incorporate external knowledge at inference time. However, when retrieved contexts are noisy, incomplete, or heterogeneous, a single generation process…

Computation and Language · Computer Science 2026-04-22 Xingchen Xiao , Heyan Huang , Runheng Liu , Jincheng Xie

Recent progress in the reasoning capabilities of multimodal large language models (MLLMs) has empowered them to address more complex tasks such as scientific analysis and mathematical reasoning. Despite their promise, MLLMs' reasoning…

Computation and Language · Computer Science 2026-03-03 Jiachun Li , Shaoping Huang , Zhuoran Jin , Chenlong Zhang , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Large Language Models (LLMs) are proficient at generating coherent and contextually relevant text but face challenges when addressing knowledge-intensive queries in domain-specific and factual question-answering tasks. Retrieval-augmented…

Information Retrieval · Computer Science 2024-10-08 Garima Agrawal , Tharindu Kumarage , Zeyad Alghamdi , Huan Liu

Multimodal Large Language Models (MLLMs) are set to transform how machines process and generate human-like responses by integrating diverse modalities such as text, images, and code. Yet, effectively harnessing their capabilities hinges on…

Artificial Intelligence · Computer Science 2025-04-15 Anwesha Mohanty , Venkatesh Balavadhani Parthasarathy , Arsalan Shahid

Multimodal document retrieval systems enable information access across text, images, and layouts, benefiting various domains like document-based question answering, report analysis, and interactive content summarization. Rerankers improve…

Artificial Intelligence · Computer Science 2025-06-24 Mingjun Xu , Jinhan Dong , Jue Hou , Zehui Wang , Sihang Li , Zhifeng Gao , Renxin Zhong , Hengxing Cai

While Retrieval-Augmented Generation (RAG) plays a crucial role in the application of Large Language Models (LLMs), existing retrieval methods in knowledge-dense domains like law and medicine still suffer from a lack of multi-perspective…

Computation and Language · Computer Science 2025-10-24 Guanhua Chen , Wenhan Yu , Xiao Lu , Xiao Zhang , Erli Meng , Lei Sha

Incentivizing the reasoning ability of Multimodal Large Language Models (MLLMs) is essential for medical applications to transparently analyze medical scans and provide reliable diagnosis. However, existing medical MLLMs rely solely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Lehan Wang , Yi Qin , Honglong Yang , Xiaomeng Li

Reasoning is a fundamental cognitive process that enables logical inference, problem-solving, and decision-making. With the rapid advancement of large language models (LLMs), reasoning has emerged as a key capability that distinguishes…