English
Related papers

Related papers: Benchmarking Large Language Models for Knowledge G…

200 papers

Despite the recent popularity of knowledge graph (KG) related tasks and benchmarks such as KG embeddings, link prediction, entity alignment and evaluation of the reasoning abilities of pretrained language models as KGs, the structure and…

Machine Learning · Computer Science 2023-11-14 Nedelina Teneva , Estevam Hruschka

Large Language Models (LLMs) have exhibited impressive proficiency in various natural language processing (NLP) tasks, which involve increasingly complex reasoning. Knowledge reasoning, a primary type of reasoning, aims at deriving new…

Computation and Language · Computer Science 2024-07-02 Yifei Zhang , Xintao Wang , Jiaqing Liang , Sirui Xia , Lida Chen , Yanghua Xiao

We propose two new methods for multi-document financial question answering. First, a method that uses semantic tagging, and then, queries the index to get the context (RAG_SEM). And second, a Knowledge Graph (KG_RAG) based method that uses…

Information Retrieval · Computer Science 2024-11-13 Shalin Shah , Srikanth Ryali , Ramasubbu Venkatesh

Large language models (LLMs) have recently emerged as powerful tools, finding many medical applications. LLMs' ability to coalesce vast amounts of information from many sources to generate a response-a process similar to that of a human…

Autoregressive large language models (LLMs) pre-trained by next token prediction are inherently proficient in generative tasks. However, their performance on knowledge-driven tasks such as factual knowledge querying remains unsatisfactory.…

Computation and Language · Computer Science 2026-01-14 Peng Yu , Cheng Deng , Beiya Dai , Xinbing Wang , Ying Wen

Large Language Models (LLMs) have significantly advanced natural language processing (NLP) with their impressive language understanding and generation capabilities. However, their performance may be suboptimal for domain-specific tasks that…

Computation and Language · Computer Science 2023-05-19 Ziyang Luo , Can Xu , Pu Zhao , Xiubo Geng , Chongyang Tao , Jing Ma , Qingwei Lin , Daxin Jiang

Large language models have become integral to question-answering applications despite their propensity for generating hallucinations and factually inaccurate content. Querying knowledge graphs to reduce hallucinations in LLM meets the…

Computation and Language · Computer Science 2024-06-26 Tong Zhou , Yubo Chen , Kang Liu , Jun Zhao

With the rise of knowledge graph based retrieval-augmented generation (RAG) techniques such as GraphRAG and Pike-RAG, the role of knowledge graphs in enhancing the reasoning capabilities of large language models (LLMs) has become…

Information Retrieval · Computer Science 2025-04-15 Hairong Zhang , Jiaheng Si , Guohang Yan , Boyuan Qi , Pinlong Cai , Song Mao , Ding Wang , Botian Shi

Knowledge graphs (KGs) can be enhanced through rule mining; however, the resulting logical rules are often difficult for humans to interpret due to their inherent complexity and the idiosyncratic labeling conventions of individual KGs. This…

Computation and Language · Computer Science 2025-08-18 Nasim Shirvani-Mahdavi , Chengkai Li

Large language models (LLMs) have garnered significant attention for their superior performance in many knowledge-driven applications on the world wide web.These models are designed to train hundreds of millions or more parameters on large…

Computation and Language · Computer Science 2025-04-09 Bingchen Liu , Yuanyuan Fang , Naixing Xu , Shihao Hou , Xin Li , Qian Li

Large Language Models tend to struggle when dealing with specialized domains. While all aspects of evaluation hold importance, factuality is the most critical one. Similarly, reliable fact-checking tools and data sources are essential for…

Computation and Language · Computer Science 2025-09-03 Anum Afzal , Juraj Vladika , Florian Matthes

Large language models hallucinate factual claims and struggle to ground their outputs in retrievable evidence, particularly in non-English languages. Existing resources impose a trade-off: structured knowledge bases lack textual grounding,…

Computation and Language · Computer Science 2026-05-15 Yingli Shen , Wen Lai , Jie Zhou , Xueren Zhang , Yudong Wang , Kangyang Luo , Shuo Wang , Ge Gao , Alexander Fraser , Maosong Sun

Constructing domain-specific knowledge graphs from unstructured text remains challenging due to heterogeneous entity mentions, long-tail relation distributions, and the absence of standardized schemas. We present LEC-KG, a bidirectional…

Computation and Language · Computer Science 2026-03-02 Yikai Zeng , Yingchao Piao , Changhua Pei , Jianhui Li

Large Language Models (LLMs) have demonstrated remarkable capabilities in many real-world applications. Nonetheless, LLMs are often criticized for their tendency to produce hallucinations, wherein the models fabricate incorrect statements…

Computation and Language · Computer Science 2024-06-05 Qinggang Zhang , Junnan Dong , Hao Chen , Daochen Zha , Zailiang Yu , Xiao Huang

Large Language Models (LLMs) succeed in many natural language processing tasks. However, their tendency to hallucinate - generate plausible but inconsistent or factually incorrect text - can cause significant problems in certain tasks,…

Computation and Language · Computer Science 2025-08-08 Xiangyan Chen , Yujian Gan , Yimeng Gu , Matthew Purver

Trustworthiness is a core research challenge for agentic AI systems built on Large Language Models (LLMs). To enhance trust, natural language claims from diverse sources, including human-written text, web content, and model outputs, are…

Large Language Models (LLMs) have shown impressive capability in language generation and understanding, but their tendency to hallucinate and produce factually incorrect information remains a key limitation. To verify LLM-generated contents…

Computation and Language · Computer Science 2025-06-03 Kushan Mitra , Dan Zhang , Sajjadur Rahman , Estevam Hruschka

Automatic fact-checking plays a crucial role in combating the spread of misinformation. Large Language Models (LLMs) and Instruction-Following variants, such as InstructGPT and Alpaca, have shown remarkable performance in various natural…

Computation and Language · Computer Science 2023-09-04 Tsun-Hin Cheung , Kin-Man Lam

Large language models (LLMs) often need to balance their internal parametric knowledge with external information, such as user beliefs and content from retrieved documents, in real-world scenarios like RAG or chat-based systems. A model's…

Computation and Language · Computer Science 2026-04-27 Shuowei Li , Haoxin Li , Wenda Chu , Yi Fang

Traditional methods of linking large language models (LLMs) to knowledge bases via the semantic similarity search often fall short of capturing complex relational dynamics. To address these limitations, we introduce AutoKG, a lightweight…

Computation and Language · Computer Science 2023-11-28 Bohan Chen , Andrea L. Bertozzi