English
Related papers

Related papers: Right for Right Reasons: Large Language Models for…

200 papers

Large language models (LLMs) based on generative pre-trained Transformer have achieved remarkable performance on knowledge graph question-answering (KGQA) tasks. However, LLMs often produce ungrounded subgraph planning or reasoning results…

Computation and Language · Computer Science 2025-03-10 Mufan Xu , Kehai Chen , Xuefeng Bai , Muyun Yang , Tiejun Zhao , Min Zhang

The fusion of language models (LMs) and knowledge graphs (KGs) is widely used in commonsense question answering, but generating faithful explanations remains challenging. Current methods often overlook path decoding faithfulness, leading to…

Computation and Language · Computer Science 2024-09-23 Weihe Zhai , Arkaitz Zubiaga

Large language models (LLMs), such as GPT3.5, GPT4 and LLAMA2 perform surprisingly well and outperform human experts on many tasks. However, in many domain-specific evaluations, these LLMs often suffer from hallucination problems due to…

Computation and Language · Computer Science 2024-04-19 Yuqi Wang , Boran Jiang , Yi Luo , Dawei He , Peng Cheng , Liangcai Gao

Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP) based applications including automated text generation, question answering, chatbots, and others. However, they face a significant challenge: hallucinations,…

Computation and Language · Computer Science 2024-11-22 Ernests Lavrinovics , Russa Biswas , Johannes Bjerva , Katja Hose

Large Language Models (LLMs) exhibit strong abilities in natural language understanding and generation, yet they struggle with knowledge-intensive reasoning. Structured Knowledge Graphs (KGs) provide an effective form of external knowledge…

Computation and Language · Computer Science 2026-04-15 Shuai Wang , Yinan Yu

Multi-hop Knowledge Base Question Answering(KBQA) aims to find the answer entity in a knowledge graph (KG), which requires multiple steps of reasoning. Existing retrieval-based approaches solve this task by concentrating on the specific…

Computation and Language · Computer Science 2023-12-20 Haowei Du , Quzhe Huang , Chen Li , Chen Zhang , Yang Li , Dongyan Zhao

This study addresses the challenge of ambiguity in knowledge graph question answering (KGQA). While recent KGQA systems have made significant progress, particularly with the integration of large language models (LLMs), they typically assume…

Computation and Language · Computer Science 2025-04-15 Liqiang Wen , Guanming Xiong , Tong Mo , Bing Li , Weiping Li , Wen Zhao

Methods to evaluate Large Language Model (LLM) responses and detect inconsistencies, also known as hallucinations, with respect to the provided knowledge, are becoming increasingly important for LLM applications. Current metrics fall short…

Computation and Language · Computer Science 2024-07-16 Hannah Sansford , Nicholas Richardson , Hermina Petric Maretic , Juba Nait Saada

While Large Language Models (LLMs) demonstrate exceptional performance in a multitude of Natural Language Processing (NLP) tasks, they encounter challenges in practical applications, including issues with hallucinations, inadequate…

Computation and Language · Computer Science 2024-06-13 Yihao Li , Ru Zhang , Jianyi Liu

Question Answering (QA) systems over Knowledge Graphs (KGs) (KGQA) automatically answer natural language questions using triples contained in a KG. The key idea is to represent questions and entities of a KG as low-dimensional embeddings.…

Machine Learning · Computer Science 2022-03-28 Sirui Li , Kok Kai Wong , Dengya Zhu , Chun Che Fung

Incorporating factual knowledge in knowledge graph is regarded as a promising approach for mitigating the hallucination of large language models (LLMs). Existing methods usually only use the user's input to query the knowledge graph, thus…

Computation and Language · Computer Science 2023-11-23 Xinyan Guan , Yanjiang Liu , Hongyu Lin , Yaojie Lu , Ben He , Xianpei Han , Le Sun

Large Language Models (LLMs) face challenges in knowledge-intensive reasoning tasks like classic multi-hop question and answering, which involves reasoning across multiple facts. This difficulty arises because the chain of thoughts (CoTs)…

Computation and Language · Computer Science 2025-08-25 Nan Wang , Yongqi Fan , yansha zhu , ZongYu Wang , Xuezhi Cao , Xinyan He , Haiyun Jiang , Tong Ruan , Jingping Liu

Answering questions over domain-specific graphs requires a tailored approach due to the limited number of relations and the specific nature of the domain. Our approach integrates classic logical programming languages into large language…

Machine Learning · Computer Science 2023-08-24 Navid Madani , Rohini K. Srihari , Kenneth Joseph

Large Language Models (LLMs) have excelled in multi-hop question-answering (M-QA) due to their advanced reasoning abilities. However, the impact of the inherent reasoning structures on LLM M-QA performance remains unclear, largely due to…

Knowledge-based Visual Question Answering (KVQA) requires external knowledge beyond the visible content to answer questions about an image. This ability is challenging but indispensable to achieve general VQA. One limitation of existing…

Artificial Intelligence · Computer Science 2020-11-04 Jing Yu , Zihao Zhu , Yujing Wang , Weifeng Zhang , Yue Hu , Jianlong Tan

Large language models (LLMs) have shown remarkable capabilities in natural language processing. However, in knowledge graph question answering tasks (KGQA), there remains the issue of answering questions that require multi-hop reasoning.…

Computation and Language · Computer Science 2025-08-22 Runxuan Liu , Bei Luo , Jiaqi Li , Baoxin Wang , Ming Liu , Dayong Wu , Shijin Wang , Bing Qin

As large language models (LLMs) continue to grow in size, their abilities to tackle complex tasks have significantly improved. However, issues such as hallucination and the lack of up-to-date knowledge largely remain unresolved. Knowledge…

Artificial Intelligence · Computer Science 2026-03-17 Lihui Liu

Recently, knowledge representation learning (KRL) is emerging as the state-of-the-art approach to process queries over knowledge graphs (KGs), wherein KG entities and the query are embedded into a latent space such that entities that answer…

Artificial Intelligence · Computer Science 2022-09-29 Zhaohan Xi , Ren Pang , Changjiang Li , Tianyu Du , Shouling Ji , Fenglong Ma , Ting Wang

Large language models (LLMs) typically improve performance by either retrieving semantically similar information, or enhancing reasoning abilities through structured prompts like chain-of-thought. While both strategies are considered…

Computation and Language · Computer Science 2024-10-16 Yejin Kim , Eojin Kang , Juae Kim , H. Howie Huang

Knowledge graph question answering (KGQA) based on information retrieval aims to answer a question by retrieving answer from a large-scale knowledge graph. Most existing methods first roughly retrieve the knowledge subgraphs (KSG) that may…

Computation and Language · Computer Science 2022-10-06 Hanning Gao , Lingfei Wu , Po Hu , Zhihua Wei , Fangli Xu , Bo Long