English
Related papers

Related papers: MC-Search: Evaluating and Enhancing Multimodal Age…

200 papers

Large Language Models (LLMs) excel at reasoning and generation but are inherently limited by static pretraining data, resulting in factual inaccuracies and weak adaptability to new information. Retrieval-Augmented Generation (RAG) addresses…

Computation and Language · Computer Science 2025-11-03 Qi Luo , Xiaonan Li , Yuxin Wang , Tingshuo Fan , Yuan Li , Xinchi Chen , Xipeng Qiu

Multimodal large language models (MLLMs) achieve strong performance on benchmarks that evaluate text, image, or video understanding separately. However, these settings do not assess a critical real-world requirement, which involves…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Dannong Xu , Zhongyu Yang , Jun Chen , Yingfang Yuan , Ming Hu , Lei Sun , Luc Van Gool , Danda Pani Paudel , Chun-Mei Feng

Retrieval-Augmented Generation (RAG) mitigates key limitations of Large Language Models (LLMs)-such as factual errors, outdated knowledge, and hallucinations-by dynamically retrieving external information. Recent work extends this paradigm…

Computation and Language · Computer Science 2026-05-22 Jingru Lin , Chen Zhang , Stephen Y. Liu , Haizhou Li

Multimodal Large Language Models (MLLMs) are evolving from passive observers into active agents, solving problems through Visual Expansion (invoking visual tools) and Knowledge Expansion (open-web search). However, existing evaluations fall…

Artificial Intelligence · Computer Science 2026-04-06 Qianshan Wei , Yishan Yang , Siyi Wang , Jinglin Chen , Binyu Wang , Jiaming Wang , Shuang Chen , Zechen Li , Yang Shi , Yuqi Tang , Weining Wang , Yi Yu , Chaoyou Fu , Qi Li , Yi-Fan Zhang

Logical reasoning is a fundamental aspect of human intelligence and an essential capability for multimodal large language models (MLLMs). Despite the significant advancement in multimodal reasoning, existing benchmarks fail to…

Artificial Intelligence · Computer Science 2025-05-28 Jiakang Yuan , Tianshuo Peng , Yilei Jiang , Yiting Lu , Renrui Zhang , Kaituo Feng , Chaoyou Fu , Tao Chen , Lei Bai , Bo Zhang , Xiangyu Yue

Deep search agents have proven effective in enhancing LLMs by retrieving external knowledge during multi-step reasoning. However, existing methods often generate a single query for retrieval at each reasoning step, limiting information…

Artificial Intelligence · Computer Science 2026-05-14 Jiabei Liu , Wenyu Mao , Junfei Tan , Chunxu Shen , Lingling Yi , Jiancan Wu , Xiang Wang

Multimodal Retrieval-Augmented Generation (MRAG) has emerged as a key paradigm for grounding MLLMs with external knowledge. While query pre-processing (e.g., rewriting) is standard in text-based RAG, existing MRAG pipelines predominantly…

Information Retrieval · Computer Science 2026-02-16 Jiankun Zhang , Shenglai Zeng , Kai Guo , Xinnan Dai , Hui Liu , Jiliang Tang , Yi Chang

Large language models (LLMs) exhibit remarkable problem-solving abilities, but struggle with complex tasks due to static internal knowledge. Retrieval-Augmented Generation (RAG) enhances access to external information, yet remains limited…

Retrieval-Augmented Generation (RAG) has demonstrated significant effectiveness in enhancing large language models (LLMs) for complex multi-hop question answering (QA). For multi-hop QA tasks, current iterative approaches predominantly rely…

Computation and Language · Computer Science 2026-01-19 Yuling Shi , Maolin Sun , Zijun Liu , Mo Yang , Yixiong Fang , Tianran Sun , Xiaodong Gu

Large reasoning models (LRMs) like OpenAI-o1 have demonstrated impressive long stepwise reasoning capabilities through large-scale reinforcement learning. However, their extended reasoning processes often suffer from knowledge…

Artificial Intelligence · Computer Science 2025-01-10 Xiaoxi Li , Guanting Dong , Jiajie Jin , Yuyao Zhang , Yujia Zhou , Yutao Zhu , Peitian Zhang , Zhicheng Dou

Large Language Models (LLMs), enhanced through agent tuning, have demonstrated remarkable capabilities in Chain-of-Thought (CoT) and tool utilization, significantly surpassing the performance of standalone models. However, the multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Tianhong Gao , Yannian Fu , Weiqun Wu , Haixiao Yue , Shanshan Liu , Gang Zhang

Large Language Models (LLMs) suffer from hallucinations and outdated knowledge due to their reliance on static training data. Retrieval-Augmented Generation (RAG) mitigates these issues by integrating external dynamic information for…

Large language models (LLMs) have been widely integrated into information retrieval to advance traditional techniques. However, effectively enabling LLMs to seek accurate knowledge in complex tasks remains a challenge due to the complexity…

Computation and Language · Computer Science 2025-05-27 Zhengliang Shi , Lingyong Yan , Dawei Yin , Suzan Verberne , Maarten de Rijke , Zhaochun Ren

Recent advancements in Retrieval-Augmented Generation (RAG) have enabled Large Language Models to answer financial questions using external knowledge bases of U.S. SEC filings, earnings reports, and regulatory documents. However, existing…

Multi-step multimodal reasoning tasks pose significant challenges for multimodal large language models (MLLMs), and finding effective ways to enhance their performance in such scenarios remains an unresolved issue. In this paper, we propose…

Computation and Language · Computer Science 2024-12-20 Guanting Dong , Chenghao Zhang , Mengjie Deng , Yutao Zhu , Zhicheng Dou , Ji-Rong Wen

Multimodal deep search agents have shown great potential in solving complex tasks by iteratively collecting textual and visual evidence. However, managing the heterogeneous information and high token costs associated with multimodal inputs…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yifan Du , Zikang Liu , Jinbiao Peng , Jie Wu , Junyi Li , Jinyang Li , Wayne Xin Zhao , Ji-Rong Wen

Efficient multi-hop reasoning requires Large Language Models (LLMs) based agents to acquire high-value external knowledge iteratively. Previous work has explored reinforcement learning (RL) to train LLMs to perform search-based document…

Computation and Language · Computer Science 2025-05-27 Ziliang Wang , Xuhui Zheng , Kang An , Cijun Ouyang , Jialu Cai , Yuhang Wang , Yichao Wu

Contemporary large language model (LLM)-based multi-agent systems exhibit systematic advantages in deep research tasks, which emphasize iterative, vertically structured information seeking. However, when confronted with wide search tasks…

Multiagent Systems · Computer Science 2026-02-03 Mingju Chen , Guibin Zhang , Heng Chang , Yuchen Guo , Shiji Zhou

Recently, multimodal large language models (MLLMs) have been widely applied to reasoning tasks. However, they suffer from limited multi-rationale semantic modeling, insufficient logical robustness, and are susceptible to misleading…

Artificial Intelligence · Computer Science 2025-12-08 Chuang Yu , Jinmiao Zhao , Mingxuan Zhao , Yunpeng Liu , Xiujun Shu , Yuanhao Feng , Bo Wang , Xiangyu Yue

Large Reasoning Models (LRMs) exhibit remarkable reasoning abilities but rely primarily on parametric knowledge, limiting factual accuracy. While recent works equip reinforcement learning (RL)-based LRMs with retrieval capabilities, they…

Computation and Language · Computer Science 2025-05-20 Zhicheng Lee , Shulin Cao , Jinxin Liu , Jiajie Zhang , Weichuan Liu , Xiaoyin Che , Lei Hou , Juanzi Li