English
Related papers

Related papers: Spider4SPARQL: A Complex Benchmark for Evaluating …

200 papers

Recent studies have demonstrated that large language models (LLMs) are susceptible to being misled by false premise questions (FPQs), leading to errors in factual knowledge, know as factuality hallucination. Existing benchmarks that assess…

Computation and Language · Computer Science 2024-12-24 Yanxu Zhu , Jinlin Xiao , Yuhang Wang , Jitao Sang

Knowledge graphs (KGs) are large datasets with specific structures representing large knowledge bases (KB) where each node represents a key entity and relations amongst them are typed edges. Natural language queries formed to extract…

Artificial Intelligence · Computer Science 2024-05-01 Abir Chakraborty

Large Language Models (LLMs) exhibit strong reasoning capabilities in complex tasks. However, they still struggle with hallucinations and factual errors in knowledge-intensive scenarios like knowledge graph question answering (KGQA). We…

Computation and Language · Computer Science 2025-11-12 Songze Li , Zhiqiang Liu , Zhengke Gui , Huajun Chen , Wen Zhang

The task of multi-hop link prediction within knowledge graphs (KGs) stands as a challenge in the field of knowledge graph analysis, as it requires the model to reason through and understand all intermediate connections before making a…

Computation and Language · Computer Science 2025-06-17 Dong Shu , Tianle Chen , Mingyu Jin , Chong Zhang , Mengnan Du , Yongfeng Zhang

Recent studies have explored the use of Large Language Models (LLMs) with Retrieval Augmented Generation (RAG) for Knowledge Graph Question Answering (KGQA). They typically require rewriting retrieved subgraphs into natural language formats…

Computation and Language · Computer Science 2025-11-21 Yike Wu , Yi Huang , Nan Hu , Yuncheng Hua , Guilin Qi , Jiaoyan Chen , Jeff Z. Pan

Knowledge Graphs (KGs) play a crucial role in enhancing e-commerce system performance by providing structured information about entities and their relationships, such as complementary or substitutable relations between products or product…

Information Retrieval · Computer Science 2023-05-18 Jiao Chen , Luyi Ma , Xiaohan Li , Nikhil Thakurdesai , Jianpeng Xu , Jason H. D. Cho , Kaushiki Nag , Evren Korpeoglu , Sushant Kumar , Kannan Achan

Recently, there has been an increase in the number of knowledge graphs that can be only queried by experts. However, describing questions using structured queries is not straightforward for non-expert users who need to have sufficient…

Computation and Language · Computer Science 2021-05-04 Abdelghny Orogat , Isabelle Liu , Ahmed El-Roby

Knowledge graph question answering (KGQA) is a promising approach for mitigating LLM hallucination by grounding reasoning in structured and verifiable knowledge graphs. Existing approaches fall into two paradigms: retrieval-based methods…

Computation and Language · Computer Science 2026-03-23 Bo Yuan , Hexuan Deng , Xuebo Liu , Min Zhang

The ability to have the same experience for different user groups (i.e., accessibility) is one of the most important characteristics of Web-based systems. The same is true for Knowledge Graph Question Answering (KGQA) systems that provide…

Computation and Language · Computer Science 2022-02-08 Aleksandr Perevalov , Dennis Diefenbach , Ricardo Usbeck , Andreas Both

The Scholarly Question Answering over Linked Data (Scholarly QALD) at The International Semantic Web Conference (ISWC) 2023 challenge presents two sub-tasks to tackle question answering (QA) over knowledge graphs (KGs). We answer the KGQA…

Artificial Intelligence · Computer Science 2023-10-20 Hanna Abi Akl

This paper investigates whether state-of-the-art Large Language Models (LLMs) can automatically translate SPARQL between popular Knowledge Graph (KG) schemas. We focus on translations between the DBpedia and Wikidata KG, and later on DBLP…

Artificial Intelligence · Computer Science 2025-07-15 Malte Christian Bartels , Debayan Banerjee , Ricardo Usbeck

Retrieval-augmented generation (RAG) methods are viable solutions for addressing the static memory limits of pre-trained language models. Nevertheless, encountering conflicting sources of information within the retrieval context is an…

Computation and Language · Computer Science 2025-06-05 Quang Hieu Pham , Hoang Ngo , Anh Tuan Luu , Dat Quoc Nguyen

Large language model (LLM) driven synthetic data generation has emerged as a powerful method for improving model reasoning capabilities. However, most methods either distill large state-of-the-art models into small students or use natural…

Machine Learning · Computer Science 2025-06-18 Alex Havrilla , Edward Hughes , Mikayel Samvelyan , Jacob Abernethy

Factuality in Large Language Models (LLMs) is a persistent challenge. Current benchmarks often assess short factual answers, overlooking the critical ability to generate structured, multi-record tabular outputs from parametric knowledge. We…

Computation and Language · Computer Science 2025-05-28 Dario Satriani , Enzo Veltri , Donatello Santoro , Paolo Papotti

Generating complex, logically-sound SPARQL queries for multi-hop questions remains a critical bottleneck for Knowledge Graph Question Answering, as the brittle nature of one-shot generation by Large Language Models (LLMs) hinders reliable…

Artificial Intelligence · Computer Science 2025-11-18 Floris Vossebeld , Shenghui Wang

Knowledge Graph Question Answering (KGQA) aims to answer user-questions from a knowledge graph (KG) by identifying the reasoning relations between topic entity and answer. As a complex branch task of KGQA, multi-hop KGQA requires reasoning…

Computation and Language · Computer Science 2022-11-15 Weiqiang Jin , Biao Zhao , Hang Yu , Xi Tao , Ruiping Yin , Guizhong Liu

The problem of answering questions using knowledge from pre-trained language models (LMs) and knowledge graphs (KGs) presents two challenges: given a QA context (question and answer choice), methods need to (i) identify relevant knowledge…

Computation and Language · Computer Science 2022-12-14 Michihiro Yasunaga , Hongyu Ren , Antoine Bosselut , Percy Liang , Jure Leskovec

This study explores the realm of knowledge base question answering (KBQA). KBQA is considered a challenging task, particularly in parsing intricate questions into executable logical forms. Traditional semantic parsing (SP)-based methods…

Computation and Language · Computer Science 2025-03-13 Guanming Xiong , Junwei Bao , Wen Zhao

Language interpretation is a compositional process, in which the meaning of more complex linguistic structures is inferred from the meaning of their parts. Large language models possess remarkable language interpretation capabilities and…

Artificial Intelligence · Computer Science 2025-10-31 David Maria Schmidt , Raoul Schubert , Philipp Cimiano

Large language models (LLMs) have demonstrated human-level performance on a vast spectrum of natural language tasks. However, it is largely unexplored whether they can better internalize knowledge from a structured data, such as a knowledge…

Computation and Language · Computer Science 2022-05-18 Fedor Moiseev , Zhe Dong , Enrique Alfonseca , Martin Jaggi