English
Related papers

Related papers: ComoRAG: A Cognitive-Inspired Memory-Organized RAG…

200 papers

Multimodal Large Language Models (MLLMs) have shown impressive capabilities in jointly understanding text, images, and videos, often evaluated via Visual Question Answering (VQA). However, even state-of-the-art MLLMs struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Alberto Compagnoni , Marco Morini , Sara Sarto , Federico Cocchi , Davide Caffagni , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Despite significant advancements, current large language models (LLMs) and vision-language models (LVLMs) continue to struggle with complex, multi-step, cross-modal common sense reasoning tasks, often exhibiting a lack of "deliberative…

Computation and Language · Computer Science 2025-08-06 Wenjie Luo , Ruocheng Li , Shanshan Zhu , Julian Perry

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for enhancing large language models (LLMs) on multi-hop question answering (QA), which requires reasoning over evidence from multiple documents. Current multi-hop RAG…

Computation and Language · Computer Science 2026-05-28 Yikai Zhu , Kunfeng Chen , Qihuang Zhong , Juhua Liu , Bo Du

Retrieval-Augmented Generation (RAG) has significantly enhanced large language models (LLMs) in knowledge-intensive tasks by incorporating external knowledge retrieval. However, existing RAG frameworks primarily rely on semantic similarity…

Computation and Language · Computer Science 2025-04-18 Elahe Khatibi , Ziyu Wang , Amir M. Rahmani

Large language models (LLMs) have shown promise in medical question answering but often struggle with hallucinations and shallow reasoning, particularly in tasks requiring nuanced clinical understanding. Retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2025-08-25 Ziyu Wang , Elahe Khatibi , Amir M. Rahmani

Continuous knowledge updating for pre-trained large language models (LLMs) is increasingly necessary yet remains challenging. Although inference-time methods like In-Context Learning (ICL) and Retrieval-Augmented Generation (RAG) are…

Machine Learning · Computer Science 2026-05-07 Seungju Back , Dongwoo Lee , Naun Kang , Taehee Lee , S. K. Hong , Youngjune Gwon , Sungjin Ahn

In recent years, large language models (LLMs) have made remarkable achievements in various domains. However, the untimeliness and cost of knowledge updates coupled with hallucination issues of LLMs have curtailed their applications in…

Machine Learning · Computer Science 2024-05-31 Chunjing Gan , Dan Yang , Binbin Hu , Hanxiao Zhang , Siyuan Li , Ziqi Liu , Yue Shen , Lin Ju , Zhiqiang Zhang , Jinjie Gu , Lei Liang , Jun Zhou

While Long Chain-of-Thought (CoT) reasoning significantly improves Large Language Models (LLMs) performance on complex reasoning tasks, the substantial computational and memory costs of generating long CoT sequences limit their efficiency…

Artificial Intelligence · Computer Science 2026-02-03 Liang Zhang , Yu Zhao , Longyue Wang , Tianqi Shi , Weihua Luo , Kaifu Zhang , Jinsong Su

Graph-based retrieval-augmented generation (RAG) methods, typically built on knowledge graphs (KGs) with binary relational facts, have shown promise in multi-hop open-domain QA. However, their rigid retrieval schemes and dense similarity…

Computation and Language · Computer Science 2026-02-17 Wen-Sheng Lien , Yu-Kai Chan , Hao-Lung Hsiao , Bo-Kai Ruan , Meng-Fen Chiang , Chien-An Chen , Yi-Ren Yeh , Hong-Han Shuai

This paper describes an investigation of the robustness of large language models (LLMs) for retrieval augmented generation (RAG)-based summarization tasks. While LLMs provide summarization capabilities, their performance in complex,…

Computation and Language · Computer Science 2024-04-01 Shengjie Liu , Jing Wu , Jingyuan Bao , Wenyi Wang , Naira Hovakimyan , Christopher G Healey

While language Models store a massive amount of world knowledge implicitly in their parameters, even very large models often fail to encode information about rare entities and events, while incurring huge computational costs. Recently,…

Computation and Language · Computer Science 2022-10-21 Wenhu Chen , Hexiang Hu , Xi Chen , Pat Verga , William W. Cohen

Current Large Language Models (LLMs) face inherent limitations due to their pre-defined context lengths, which impede their capacity for multi-hop reasoning within extensive textual contexts. While existing techniques like…

Computation and Language · Computer Science 2024-06-19 Weizhi Fei , Xueyan Niu , Guoqing Xie , Yanhua Zhang , Bo Bai , Lei Deng , Wei Han

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by grounding responses in external knowledge during inference. However, conventiona RAG systems under-perform on structured tabular data, largely due to coarse…

Computation and Language · Computer Science 2026-05-05 Zebin Guo , Weidong Geng , Ruichen Mao

The ability to robustly identify causal relationships is essential for autonomous decision-making and adaptation to novel scenarios. However, accurately inferring causal structure requires integrating both world knowledge and abstract…

Machine Learning · Computer Science 2025-06-17 Khurram Yamin , Shantanu Gupta , Gaurav R. Ghosal , Zachary C. Lipton , Bryan Wilder

Retrieval-augmented generation (RAG) has become a widely adopted paradigm for enabling knowledge-grounded large language models (LLMs). However, standard RAG pipelines often fail to ensure that model reasoning remains consistent with the…

Artificial Intelligence · Computer Science 2025-10-14 Jiaqi Wei , Hao Zhou , Xiang Zhang , Di Zhang , Zijie Qiu , Wei Wei , Jinzhe Li , Wanli Ouyang , Siqi Sun

Multi-modal Retrieval-Augmented Generation (MMRAG) has emerged as a powerful paradigm for enhancing Multimodal Large Language Models in knowledge-intensive question answering by integrating external visual, textual, and structural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Xiang Fang , Wanlong Fang , Changshuo Wang

Complex reasoning in tool-augmented agent frameworks is inherently long-horizon, causing reasoning traces and transient tool artifacts to accumulate and strain the bounded working context of large language models. Without explicit memory…

Artificial Intelligence · Computer Science 2026-01-14 Hongjin Qian , Zhao Cao , Zheng Liu

Reasoning over knowledge graphs (KGs) with first-order logic (FOL) queries is challenging due to the inherent incompleteness of real-world KGs and the compositional complexity of logical query structures. Most existing methods rely on…

Computation and Language · Computer Science 2025-12-23 Ziyan Zhang , Chao Wang , Zhuo Chen , Lei Chen , Chiyi Li , Kai Song

Large language models (LLMs) have achieved impressive performance on knowledge-intensive tasks, yet they often struggle with multi-step reasoning due to the unstructured nature of retrieved context. While retrieval-augmented generation…

Computation and Language · Computer Science 2026-01-30 Pengcheng Jiang , Lang Cao , Ruike Zhu , Minhao Jiang , Yunyi Zhang , Jiaming Shen , Jimeng Sun , Jiawei Han

Retrieval-augmented generation (RAG) is a framework enabling large language models (LLMs) to enhance their accuracy and reduce hallucinations by integrating external knowledge bases. In this paper, we introduce a hybrid RAG system enhanced…

Computation and Language · Computer Science 2024-09-04 Ye Yuan , Chengwu Liu , Jingyang Yuan , Gongbo Sun , Siqi Li , Ming Zhang