English
Related papers

Related papers: Spider4SPARQL: A Complex Benchmark for Evaluating …

200 papers

Knowledge Base Question Answering (KBQA) aims to answer factoid questions based on knowledge bases. However, generating the most appropriate knowledge base query code based on Natural Language Questions (NLQ) poses a significant challenge…

Computation and Language · Computer Science 2023-11-07 Yunlong Chen , Yaming Zhang , Jianfei Yu , Li Yang , Rui Xia

Existing benchmarks like NLGraph and GraphQA evaluate LLMs on graphs by focusing mainly on pairwise relationships, overlooking the high-order correlations found in real-world data. Hypergraphs, which can model complex beyond-pairwise…

Artificial Intelligence · Computer Science 2024-10-17 Yifan Feng , Chengwu Yang , Xingliang Hou , Shaoyi Du , Shihui Ying , Zongze Wu , Yue Gao

Question answering over knowledge graphs (KGQA) has evolved from simple single-fact questions to complex questions that require graph traversal and aggregation. We propose a novel approach for complex KGQA that uses unsupervised message…

Computation and Language · Computer Science 2019-08-20 Svitlana Vakulenko , Javier David Fernandez Garcia , Axel Polleres , Maarten de Rijke , Michael Cochez

As question answering (QA) systems advance alongside the rapid evolution of foundation models, the need for robust, adaptable, and large-scale evaluation benchmarks becomes increasingly critical. Traditional QA benchmarks are often static…

Computation and Language · Computer Science 2025-03-10 Preetam Prabhu Srikar Dammu , Himanshu Naidu , Chirag Shah

In the last years, the Linked Data Cloud has achieved a size of more than 100 billion facts pertaining to a multitude of domains. However, accessing this information has been significantly challenging for lay users. Approaches to problems…

Computation and Language · Computer Science 2020-05-07 Tommaso Soru , Edgard Marx , Diego Moussallem , Gustavo Publio , André Valdestilhas , Diego Esteves , Ciro Baron Neto

The availability of Large Language Models (LLMs) presents a unique opportunity to reinvigorate research on Knowledge Engineering (KE) automation. This trend is already evident in recent efforts developing LLM-based methods and tools for the…

Computation and Language · Computer Science 2025-12-10 Anna Sofia Lippolis , Minh Davide Ragagni , Paolo Ciancarini , Andrea Giovanni Nuzzolese , Valentina Presutti

Knowledge graph question answering (KGQA) is a well-established field that seeks to provide factual answers to natural language (NL) questions by leveraging knowledge graphs (KGs). However, existing KGQA datasets suffer from two significant…

Computation and Language · Computer Science 2024-03-05 Willis Guo , Armin Toroghi , Scott Sanner

In this paper, we are interested in developing semantic parsers which understand natural language questions embedded in a conversation with a user and ground them to formal queries over definitions in a general purpose knowledge graph (KG)…

Computation and Language · Computer Science 2023-01-31 Laura Perez-Beltrachini , Parag Jain , Emilio Monti , Mirella Lapata

Background. In the last decades, several life science resources have structured data using the same framework and made these accessible using the same query language to facilitate interoperability. Knowledge graphs have seen increased…

Knowledge graph question answering (KGQA) based on information retrieval aims to answer a question by retrieving answer from a large-scale knowledge graph. Most existing methods first roughly retrieve the knowledge subgraphs (KSG) that may…

Computation and Language · Computer Science 2022-10-06 Hanning Gao , Lingfei Wu , Po Hu , Zhihua Wei , Fangli Xu , Bo Long

Large Language Models (LLMs) and Knowledge Graphs (KGs) offer a promising approach to robust and explainable Question Answering (QA). While LLMs excel at natural language understanding, they suffer from knowledge gaps and hallucinations.…

Machine Learning · Computer Science 2025-04-15 Jasper Linders , Jakub M. Tomczak

In this work, we focus on the task of generating SPARQL queries from natural language questions, which can then be executed on Knowledge Graphs (KGs). We assume that gold entity and relations have been provided, and the remaining task is to…

Information Retrieval · Computer Science 2023-09-15 Debayan Banerjee , Pranav Ajit Nair , Jivat Neet Kaur , Ricardo Usbeck , Chris Biemann

Enterprise applications of Large Language Models (LLMs) hold promise for question answering on enterprise SQL databases. However, the extent to which LLMs can accurately respond to enterprise questions in such databases remains unclear,…

Artificial Intelligence · Computer Science 2023-11-14 Juan Sequeda , Dean Allemang , Bryon Jacob

While current tasks of converting natural language to SQL (NL2SQL) using Foundation Models have shown impressive achievements, adapting these approaches for converting natural language to Graph Query Language (NL2GQL) encounters hurdles due…

Computation and Language · Computer Science 2024-07-02 Yuhang Zhou , Yu He , Siyu Tian , Yuchen Ni , Zhangyue Yin , Xiang Liu , Chuanjun Ji , Sen Liu , Xipeng Qiu , Guangnan Ye , Hongfeng Chai

Interacting with knowledge graphs can be a daunting task for people without a background in computer science since the query language that is used (SPARQL) has a high barrier of entry. Large language models (LLMs) can lower that barrier by…

Computation and Language · Computer Science 2025-10-03 Felix Brei , Lorenz Bühmann , Johannes Frey , Daniel Gerber , Lars-Peter Meyer , Claus Stadler , Kirill Bulert

This study addresses the challenge of ambiguity in knowledge graph question answering (KGQA). While recent KGQA systems have made significant progress, particularly with the integration of large language models (LLMs), they typically assume…

Computation and Language · Computer Science 2025-04-15 Liqiang Wen , Guanming Xiong , Tong Mo , Bing Li , Weiping Li , Wen Zhao

The generation of questions and answers (QA) from knowledge graphs (KG) plays a crucial role in the development and testing of educational platforms, dissemination tools, and large language models (LLM). However, existing approaches often…

Computation and Language · Computer Science 2025-11-17 Sania Nayab , Marco Simoni , Giulio Rossolini , Andrea Saracino

Knowledge Graphs (KGs) represent human-crafted factual knowledge in the form of triplets (head, relation, tail), which collectively form a graph. Question Answering over KGs (KGQA) is the task of answering natural questions grounding the…

Computation and Language · Computer Science 2024-05-31 Costas Mavromatis , George Karypis

Query graph construction aims to construct the correct executable SPARQL on the KG to answer natural language questions. Although recent methods have achieved good results using neural network-based query graph ranking, they suffer from…

Artificial Intelligence · Computer Science 2022-09-13 Yongrui Chen , Huiying Li , Guilin Qi , Tianxing Wu , Tenggou Wang

Large Language Models (LLMs) may suffer from hallucinations in real-world applications due to the lack of relevant knowledge. In contrast, knowledge graphs encompass extensive, multi-relational structures that store a vast array of symbolic…

Computation and Language · Computer Science 2024-09-06 Jie Ma , Zhitao Gao , Qi Chai , Wangchun Sun , Pinghui Wang , Hongbin Pei , Jing Tao , Lingyun Song , Jun Liu , Chen Zhang , Lizhen Cui