KGARevion:面向知识密集型医学问答的 AI 智能体
摘要
医学推理将结构化、编码的知识与非结构化、经验驱动的见解相结合。 Depending on the context, quantity, and nature of available evidence, researchers and clinicians use diverse strategies, including rule-based, prototype-based, and case-based reasoning. Effective medical AI models must handle this complexity while ensuring reliability and adaptability. We introduce KGARevion, a knowledge graph-based agent that answers knowledge-intensive questions. Upon receiving a query, KGARevion generates relevant triplets by leveraging the latent knowledge embedded in a large language model. It then verifies these triplets against a grounded knowledge graph, filtering out errors and retaining only accurate, contextually relevant information for the final answer. This multi-step process strengthens reasoning, adapts to different models of medical inference, and outperforms retrieval-augmented generation-based approaches that lack effective verification mechanisms. Evaluations on medical QA benchmarks show that KGARevion improves accuracy by over 5.2% over 15 models in handling complex medical queries. To further assess its effectiveness, we curated three new medical QA datasets with varying levels of semantic complexity, where KGARevion improved accuracy by 10.4%. The agent integrates with different LLMs and biomedical knowledge graphs for broad applicability across knowledge-intensive tasks. We evaluated KGARevion on AfriMed-QA, a newly introduced dataset focused on African healthcare, demonstrating its strong zero-shot generalization to underrepresented medical contexts.
引用
@article{arxiv.2410.04660,
title = {KGARevion: An AI Agent for Knowledge-Intensive Biomedical QA},
author = {Xiaorui Su and Yibo Wang and Shanghua Gao and Xiaolong Liu and Valentina Giunchiglia and Djork-Arné Clevert and Marinka Zitnik},
journal= {arXiv preprint arXiv:2410.04660},
year = {2025}
}