English
Related papers

Related papers: KQA Pro: A Dataset with Explicit Compositional Pro…

200 papers

Despite recent advances in large language models (LLMs), most QA benchmarks are still confined to single-paragraph or single-document settings, failing to capture the complexity of real-world information-seeking tasks. Practical QA often…

Computation and Language · Computer Science 2025-08-25 Jiwon Park , Seohyun Pyeon , Jinwoo Kim , Rina Carines Cabal , Yihao Ding , Soyeon Caren Han

When answering complex questions, people can seamlessly combine information from visual, textual and tabular sources. While interest in models that reason over multiple pieces of evidence has surged in recent years, there has been…

Computation and Language · Computer Science 2021-04-14 Alon Talmor , Ori Yoran , Amnon Catav , Dan Lahav , Yizhong Wang , Akari Asai , Gabriel Ilharco , Hannaneh Hajishirzi , Jonathan Berant

We introduce \textsc{ComplexTempQA},\footnote{Dataset and code available at: https://github.com/DataScienceUIBK/ComplexTempQA} a large-scale dataset consisting of over 100 million question-answer pairs designed to tackle the challenges in…

Computation and Language · Computer Science 2025-08-26 Raphael Gruber , Abdelrahman Abdallah , Michael Färber , Adam Jatowt

With the rise of knowledge graph (KG), question answering over knowledge base (KBQA) has attracted increasing attention in recent years. Despite much research has been conducted on this topic, it is still challenging to apply KBQA…

Artificial Intelligence · Computer Science 2019-12-19 Feng-Lin Li , Weijia Chen , Qi Huang , Yikun Guo

Complex question answering (CQA) over raw text is a challenging task. A prominent approach to this task is based on the programmer-interpreter framework, where the programmer maps the question into a sequence of reasoning actions which is…

Computation and Language · Computer Science 2020-10-20 Xiao-Yu Guo , Yuan-Fang Li , Gholamreza Haffari

A multi-hop question answering (QA) dataset aims to test reasoning and inference skills by requiring a model to read multiple paragraphs to answer a given question. However, current datasets do not provide a complete explanation for the…

Computation and Language · Computer Science 2020-11-13 Xanh Ho , Anh-Khoa Duong Nguyen , Saku Sugawara , Akiko Aizawa

Thanks to the development of the Semantic Web, a lot of new structured data has become available on the Web in the form of knowledge bases (KBs). Making this valuable data accessible and usable for end-users is one of the main goals of…

Artificial Intelligence · Computer Science 2018-03-05 Dennis Diefenbach , Andreas Both , Kamal Singh , Pierre Maret

Complex knowledge base question answering can be achieved by converting questions into sequences of predefined actions. However, there is a significant semantic and structural gap between natural language and action sequences, which makes…

Computation and Language · Computer Science 2022-12-27 Yechun Tang , Xiaoxia Cheng , Weiming Lu

Question answering (QA) systems are among the most important and rapidly developing research topics in natural language processing (NLP). A reason, therefore, is that a QA system allows humans to interact more naturally with a machine,…

Computation and Language · Computer Science 2022-09-27 Amer Farea , Zhen Yang , Kien Duong , Nadeesha Perera , Frank Emmert-Streib

Knowledge base question answering (KBQA) is a challenging task that aims to retrieve correct answers from large-scale knowledge bases. Existing attempts primarily focus on entity representation and final answer reasoning, which results in…

Computation and Language · Computer Science 2023-05-26 Yong Cao , Xianzhi Li , Huiwen Liu , Wen Dai , Shuai Chen , Bin Wang , Min Chen , Daniel Hershcovich

Knowledge base question answering (KBQA)is an important task in Natural Language Processing. Existing approaches face significant challenges including complex question understanding, necessity for reasoning, and lack of large end-to-end…

Most existing approaches for Knowledge Base Question Answering (KBQA) focus on a specific underlying knowledge base either because of inherent assumptions in the approach, or because evaluating it on a different knowledge base requires…

Current methods for Knowledge-Based Question Answering (KBQA) usually rely on complex training techniques and model frameworks, leading to many limitations in practical applications. Recently, the emergence of In-Context Learning (ICL)…

Computation and Language · Computer Science 2024-01-08 Zhijie Nie , Richong Zhang , Zhongyuan Wang , Xudong Liu

To effectively interact with the real world, Large Language Models (LLMs) require entity-based commonsense reasoning, a challenging task that necessitates integrating factual knowledge about specific entities with commonsense inference.…

Computation and Language · Computer Science 2026-05-14 Armin Toroghi , Faeze Moradi Kalarde , Scott Sanner

We introduce a large-scale dataset of math word problems and an interpretable neural math problem solver that learns to map problems to operation programs. Due to annotation challenges, current datasets in this domain have been either…

Computation and Language · Computer Science 2019-06-03 Aida Amini , Saadia Gabriel , Peter Lin , Rik Koncel-Kedziorski , Yejin Choi , Hannaneh Hajishirzi

Complex query answering (CQA) on knowledge graphs (KGs) is gaining momentum as a challenging reasoning task. In this paper, we show that the current benchmarks for CQA might not be as complex as we think, as the way they are built distorts…

Machine Learning · Computer Science 2025-07-04 Cosimo Gregucci , Bo Xiong , Daniel Hernandez , Lorenzo Loconte , Pasquale Minervini , Steffen Staab , Antonio Vergari

The inherent difficulty of knowledge specification and the lack of trained specialists are some of the key obstacles on the way to making intelligent systems based on the knowledge representation and reasoning (KRR) paradigm commonplace.…

Computation and Language · Computer Science 2020-02-19 Tiantian Gao , Paul Fodor , Michael Kifer

We present the Open Predicate Query Language (OPQL); a method for constructing a virtual KB (VKB) trained entirely from text. Large Knowledge Bases (KBs) are indispensable for a wide-range of industry applications such as question answering…

Artificial Intelligence · Computer Science 2021-06-16 Haitian Sun , Pat Verga , Bhuwan Dhingra , Ruslan Salakhutdinov , William W. Cohen

Knowledge Graph Question Answering (KGQA) simplifies querying vast amounts of knowledge stored in a graph-based model using natural language. However, the research has largely concentrated on English, putting non-English speakers at a…

Computation and Language · Computer Science 2024-07-09 Nikit Srivastava , Mengshi Ma , Daniel Vollmers , Hamada Zahera , Diego Moussallem , Axel-Cyrille Ngonga Ngomo

Pre-trained language models (PLMs) have shown their effectiveness in multiple scenarios. However, KBQA remains challenging, especially regarding coverage and generalization settings. This is due to two main factors: i) understanding the…

Computation and Language · Computer Science 2022-10-25 Yiheng Shu , Zhiwei Yu , Yuhan Li , Börje F. Karlsson , Tingting Ma , Yuzhong Qu , Chin-Yew Lin