English
Related papers

Related papers: New Methods & Metrics for LFQA tasks

200 papers

Knowledge Base Question Answering (KBQA) aims to answer natural language questions with the help of an external knowledge base. The core idea is to find the link between the internal knowledge behind questions and known triples of the…

Computation and Language · Computer Science 2022-05-03 Hanyu Zhao , Sha Yuan , Jiahong Leng , Xiang Pan , Guoqiang Wang , Ledell Wu , Jie Tang

The rapid proliferation of Large Language Models (LLMs) has significantly contributed to the development of equitable AI systems capable of factual question-answering (QA). However, no known study tests the LLMs' robustness when presented…

Computation and Language · Computer Science 2026-03-05 Shubhra Ghosh , Abhilekh Borah , Aditya Kumar Guru , Kripabandhu Ghosh

We consider the problem of adapting neural paragraph-level question answering models to the case where entire documents are given as input. Our proposed solution trains models to produce well calibrated confidence scores for their results…

Computation and Language · Computer Science 2017-11-08 Christopher Clark , Matt Gardner

Large language models (LLMs) have shown impressive prowess in solving a wide range of tasks with world knowledge. However, it remains unclear how well LLMs are able to perceive their factual knowledge boundaries, particularly under…

Computation and Language · Computer Science 2024-11-20 Ruiyang Ren , Yuhao Wang , Yingqi Qu , Wayne Xin Zhao , Jing Liu , Hao Tian , Hua Wu , Ji-Rong Wen , Haifeng Wang

While Large Language Models (LLMs) have demonstrated commendable performance across a myriad of domains and tasks, existing LLMs still exhibit a palpable deficit in handling multimodal functionalities, especially for the Spoken Question…

Computation and Language · Computer Science 2024-04-19 Zihan Zhao , Yiyang Jiang , Heyang Liu , Yanfeng Wang , Yu Wang

We present a framework for question answering that can efficiently scale to longer documents while maintaining or even improving performance of state-of-the-art models. While most successful approaches for reading comprehension rely on…

Computation and Language · Computer Science 2017-02-09 Eunsol Choi , Daniel Hewlett , Alexandre Lacoste , Illia Polosukhin , Jakob Uszkoreit , Jonathan Berant

This paper presents a scholarly Knowledge Graph Question Answering (KGQA) that answers bibliographic natural language questions by leveraging a large language model (LLM) in a few-shot manner. The model initially identifies the top-n…

Computation and Language · Computer Science 2023-11-17 Tilahun Abedissa Taffa , Ricardo Usbeck

Advanced table question answering (TableQA) methods prompt large language models (LLMs) to generate answer text, SQL query, Python code, or custom operation, which impressively improve the complex reasoning problems in the TableQA task.…

Computation and Language · Computer Science 2025-09-03 Zhongyuan Wang , Richong Zhang , Zhijie Nie , Hangyu Mao

Despite the increasing effectiveness of language models, their reasoning capabilities remain underdeveloped. In particular, causal reasoning through counterfactual question answering is lacking. This work aims to bridge this gap. We first…

Computation and Language · Computer Science 2025-03-18 Alihan Hüyük , Xinnuo Xu , Jacqueline Maasch , Aditya V. Nori , Javier González

Natural language understanding (NLU) of text is a fundamental challenge in AI, and it has received significant attention throughout the history of NLP research. This primary goal has been studied under different tasks, such as Question…

Computation and Language · Computer Science 2019-08-15 Daniel Khashabi

Open-domain question answering (QA) tasks usually require the retrieval of relevant information from a large corpus to generate accurate answers. We propose a novel approach called Generator-Retriever-Generator (GRG) that combines document…

Computation and Language · Computer Science 2024-03-27 Abdelrahman Abdallah , Adam Jatowt

Knowledge graph question answering (KGQA) facilitates information access by leveraging structured data without requiring formal query language expertise from the user. Instead, users can express their information needs by simply asking…

Information Retrieval · Computer Science 2022-05-26 Trond Linjordet , Krisztian Balog

Time plays a critical role in how information is generated, retrieved, and interpreted. In this survey, we provide a comprehensive overview of Temporal Question Answering (TQA), a research area that focuses on answering questions involving…

Computation and Language · Computer Science 2026-04-24 Bhawna Piryani , Abdelrahman Abdallah , Jamshid Mozafari , Avishek Anand , Adam Jatowt

Question generation (QGen) models are often evaluated with standardized NLG metrics that are based on n-gram overlap. In this paper, we measure whether these metric improvements translate to gains in a practical setting, focusing on the use…

Computation and Language · Computer Science 2022-05-05 Philippe Laban , Chien-Sheng Wu , Lidiya Murakhovs'ka , Wenhao Liu , Caiming Xiong

Knowledge Graph Question Answering (KGQA) is a crucial task in natural language processing that requires reasoning over knowledge graphs (KGs) to answer natural language questions. Recent methods utilizing large language models (LLMs) have…

Computation and Language · Computer Science 2025-06-12 Xiujun Zhou , Pingjian Zhang , Deyou Tang

Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a…

Computation and Language · Computer Science 2024-11-01 Yuxia Wang , Minghan Wang , Muhammad Arslan Manzoor , Fei Liu , Georgi Georgiev , Rocktim Jyoti Das , Preslav Nakov

Numerical reasoning is required when solving most problems in our life, but it has been neglected in previous artificial intelligence researches. FinQA challenge has been organized to strengthen the study on numerical reasoning where the…

Computation and Language · Computer Science 2022-07-15 Renhui Zhang , Youwei Zhang , Yao Yu

While Large Language Models (LLMs) are widely used in open-domain Question Answering (QA), their ability to handle inferential questions-where answers must be derived rather than directly retrieved-remains still underexplored. This study…

Computation and Language · Computer Science 2026-05-13 Jamshid Mozafari , Bhawna Piryani , Adam Jatowt

Over time, software systems have reached a level of complexity that makes it difficult for their developers and users to explain particular decisions made by them. In this paper, we focus on the explainability of component-based systems for…

Software Engineering · Computer Science 2025-08-21 Dennis Schiese , Aleksandr Perevalov , Andreas Both

Question generation (QG) is a natural language generation task where a model is trained to ask questions corresponding to some input text. Most recent approaches frame QG as a sequence-to-sequence problem and rely on additional features and…

Computation and Language · Computer Science 2021-08-16 Luis Enrico Lopez , Diane Kathryn Cruz , Jan Christian Blaise Cruz , Charibeth Cheng