English
Related papers

Related papers: Reliable Reasoning Path: Distilling Effective Guid…

200 papers

Large Language Models (LLMs) have shown remarkable reasoning capabilities on complex tasks, but they still suffer from out-of-date knowledge, hallucinations, and opaque decision-making. In contrast, Knowledge Graphs (KGs) can provide…

Artificial Intelligence · Computer Science 2024-11-01 Liyi Chen , Panrong Tong , Zhongming Jin , Ying Sun , Jieping Ye , Hui Xiong

Fact-checking is a crucial task as it ensures the prevention of misinformation. However, manual fact-checking cannot keep up with the rate at which false information is generated and disseminated online. Automated fact-checking by machines…

Artificial Intelligence · Computer Science 2023-10-12 Gustav Nikopensius , Mohit Mayank , Orchid Chetia Phukan , Rajesh Sharma

To tackle the problem of domain-specific knowledge scarcity within large language models (LLMs), knowledge graph-retrievalaugmented method has been proven to be an effective and efficient technique for knowledge infusion. However, existing…

Computation and Language · Computer Science 2024-06-07 Zhouyu Jiang , Ling Zhong , Mengshu Sun , Jun Xu , Rui Sun , Hui Cai , Shuhan Luo , Zhiqiang Zhang

Large Language Models (LLMs) have achieved remarkable success in natural language tasks, yet understanding their reasoning processes remains a significant challenge. We address this by introducing XplainLLM, a dataset accompanying an…

Computation and Language · Computer Science 2024-09-24 Zichen Chen , Jianda Chen , Ambuj Singh , Misha Sra

Teaching large language models (LLMs) to use tools is crucial for improving their problem-solving abilities and expanding their applications. However, effectively using tools is challenging because it requires a deep understanding of tool…

Machine Learning · Computer Science 2025-06-27 Jingwei Wang , Zai Zhang , Hao Qian , Chunjing Gan , Binbin Hu , Ziqi Liu , Zhiqiang Zhang , Jun Zhou , Bin Shi , Bo Dong

The advent of Large Language Models (LLMs) has revolutionized natural language processing. However, these models face challenges in retrieving precise information from vast datasets. Retrieval-Augmented Generation (RAG) was developed to…

Information Retrieval · Computer Science 2025-03-04 Yuxin Yang , Haoyang Wu , Tao Wang , Jia Yang , Hao Ma , Guojie Luo

While large language models (LLMs) are proficient at question-answering (QA), it is not always clear how (or even if) an answer follows from their latent "beliefs". This lack of interpretability is a growing impediment to widespread use of…

Computation and Language · Computer Science 2023-10-31 Nora Kassner , Oyvind Tafjord , Ashish Sabharwal , Kyle Richardson , Hinrich Schuetze , Peter Clark

This paper examines the capacity of LLMs to reason with knowledge graphs using their internal knowledge graph, i.e., the knowledge graph they learned during pre-training. Two research questions are formulated to investigate the accuracy of…

Computation and Language · Computer Science 2023-12-04 Pei-Chi Lo , Yi-Hang Tsai , Ee-Peng Lim , San-Yih Hwang

Recent studies have combined Large Language Models (LLMs) with Knowledge Graphs (KGs) to enhance reasoning, improving inference accuracy without additional training while mitigating hallucination. However, existing frameworks still suffer…

Computation and Language · Computer Science 2025-11-11 Sumin Jo , Junseong Choi , Jiho Kim , Edward Choi

Large language models (LLMs), while exhibiting exceptional performance, suffer from hallucinations, especially on knowledge-intensive tasks. Existing works propose to augment LLMs with individual text units retrieved from external knowledge…

Computation and Language · Computer Science 2024-10-04 Bowen Jin , Chulin Xie , Jiawei Zhang , Kashob Kumar Roy , Yu Zhang , Zheng Li , Ruirui Li , Xianfeng Tang , Suhang Wang , Yu Meng , Jiawei Han

Large Language Models (LLMs) have shown remarkable capabilities across various domains, yet they struggle with knowledge-intensive tasks in areas that demand factual accuracy, e.g. industrial automation and healthcare. Key limitations…

Machine Learning · Computer Science 2025-09-10 Michael Banf , Johannes Kuhn

Large Language Models (LLMs) have demonstrated remarkable reasoning capabilities but often grapple with reliability challenges like hallucinations. While Knowledge Graphs (KGs) offer explicit grounding, existing paradigms of KG-augmented…

Computation and Language · Computer Science 2026-04-15 Yuanxiang Liu , Songze Li , Xiaoke Guo , Zhaoyan Gong , Qifei Zhang , Huajun Chen , Wen Zhang

Synthesizing high-quality training data is crucial for enhancing domain models' reasoning abilities. Existing methods face limitations in long-tail knowledge coverage, effectiveness verification, and interpretability. Knowledge-graph-based…

Artificial Intelligence · Computer Science 2026-03-02 Lun Zhan , Feng Xiong , Huanyong Liu , Feng Zhang , Yuhui Yin

Large language models (LLMs), such as ChatGPT and GPT-4, are versatile and can solve different tasks due to their emergent ability and generalizability. However, LLMs sometimes lack domain-specific knowledge to perform tasks, which would…

Computation and Language · Computer Science 2023-09-07 Chao Feng , Xinyu Zhang , Zichu Fei

Large language models (LLMs) frequently generate confident yet factually incorrect content when used for language generation (a phenomenon often known as hallucination). Retrieval augmented generation (RAG) tries to reduce factual errors by…

Information Retrieval · Computer Science 2026-04-01 Dobrik Georgiev , Kheeran Naidu , Alberto Cattaneo , Federico Monti , Carlo Luschi , Daniel Justus

Recently, large language models (LLMs) have demonstrated impressive performance in Knowledge Graph Question Answering (KGQA) tasks, which aim to find answers based on knowledge graphs (KGs) for natural language questions. Existing…

Computation and Language · Computer Science 2025-05-20 Xiao Long , Liansheng Zhuang , Chen Shen , Shaotian Yan , Yifei Li , Shafei Wang

Large Language Models (LLMs) for Graph Reasoning have been extensively studied over the past two years, involving enabling LLMs to understand graph structures and reason on graphs to solve various graph problems, with graph algorithm…

Artificial Intelligence · Computer Science 2025-10-03 Yuwei Hu , Xinyi Huang , Zhewei Wei , Yongchao Liu , Chuntao Hong

Despite the success of large language models (LLMs) in various natural language processing (NLP) tasks, the stored knowledge in these models may inevitably be incomplete, out-of-date, or incorrect. This motivates the need to utilize…

Computation and Language · Computer Science 2023-01-03 Hangfeng He , Hongming Zhang , Dan Roth

The use of knowledge graphs in recommender systems has become one of the common approaches to addressing data sparsity and cold start problems. Recent advances in large language models (LLMs) offer new possibilities for processing side and…

Information Retrieval · Computer Science 2025-02-13 Minhye Jeon , Seokho Ahn , Young-Duk Seo

Knowledge conflicts commonly arise across diverse sources, and their prevalence has increased with the advent of LLMs. When dealing with conflicts between multiple contexts, also known as \emph{inter-context knowledge conflicts}, LLMs are…

Artificial Intelligence · Computer Science 2025-08-06 Xianda Zheng , Zijian Huang , Meng-Fen Chiang , Michael J. Witbrock , Kaiqi Zhao