The performance of large language models (LLMs) in Q&A task increased substantially through Retrieval-Augmented Generation (RAG) which brings in external knowledge. However, the main difficulty lies in balancing the inherent self-knowledge of LLMs with external information retrieval (IR). The current threshold-based methods apply one-dimensional static mechanisms with single criterion. As a result, their IR decisions might be irrelevant to the LLMs' response under difficult queries. To alleviate this problem, we propose Cognitive Convection of Self-Knowledge (CCSK). Different from traditional methods that maintain single fixed IR activation criteria, CCSK implements a dynamic joint decision process via a Siamese Network module and a Response Quality Model. The Siamese Network calculates the cosine similarity between the current query and the historical queries. The Response Quality Model evaluates the responses of LLMs through LightGBM. The final decision of the CCSK is derived from the outputs of the two modules, as well as text features fused using a multi-head attention mechanism. Extensive experiments on real-world datasets show that CCSK significantly enhances the model's effectiveness in information retrieval.
@article{arxiv.2504.10498,
title = {CCSK:Cognitive Convection of Self-Knowledge Based Retrieval Augmentation for Large Language Models},
author = {Jianling Lu and Mingqi Lv and Tieming Chen},
journal= {arXiv preprint arXiv:2504.10498},
year = {2025}
}
Comments
All authors of this paper have unanimously decided to withdraw its preprint from arXiv. As one of the authors, I cannot unilaterally decide its retention. In accordance with the collective decision, we formally request the complete deletion of the paper from arXiv