English
Related papers

Related papers: ExpertQA: Expert-Curated Questions and Attributed …

200 papers

Question answering (QA) models have shown rapid progress enabled by the availability of large, high-quality benchmark datasets. Such annotated datasets are difficult and costly to collect, and rarely exist in languages other than English,…

Computation and Language · Computer Science 2020-05-05 Patrick Lewis , Barlas Oğuz , Ruty Rinott , Sebastian Riedel , Holger Schwenk

The rapid development recently of Community Question Answering (CQA) satisfies users quest for professional and personal knowledge about anything. In CQA, one central issue is to find users with expertise and willingness to answer the given…

Information Retrieval · Computer Science 2018-04-24 Sha Yuan , Yu Zhang , Jie Tang , Juan Bautista Cabotà

Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a…

Computation and Language · Computer Science 2024-11-01 Yuxia Wang , Minghan Wang , Muhammad Arslan Manzoor , Fei Liu , Georgi Georgiev , Rocktim Jyoti Das , Preslav Nakov

We propose a novel methodology to generate domain-specific large-scale question answering (QA) datasets by re-purposing existing annotations for other NLP tasks. We demonstrate an instance of this methodology in generating a large-scale QA…

Computation and Language · Computer Science 2018-09-05 Anusri Pampari , Preethi Raghavan , Jennifer Liang , Jian Peng

Community Question Answering (CQA) websites can be claimed as the most major venues for knowledge sharing, and the most effective way of exchanging knowledge at present. Considering that massive amount of users are participating online and…

Information Retrieval · Computer Science 2018-10-29 Chaoran Huang , Lina Yao , Xianzhi Wang , Boualem Benatallah , Xiang Zhang

We propose a benchmark to measure whether a language model is truthful in generating answers to questions. The benchmark comprises 817 questions that span 38 categories, including health, law, finance and politics. We crafted questions that…

Computation and Language · Computer Science 2022-05-10 Stephanie Lin , Jacob Hilton , Owain Evans

Automatic fact verification has received significant attention recently. Contemporary automatic fact-checking systems focus on estimating truthfulness using numerical scores which are not human-interpretable. A human fact-checker generally…

Computation and Language · Computer Science 2023-05-30 Anku Rani , S. M Towhidul Islam Tonmoy , Dwip Dalal , Shreya Gautam , Megha Chakraborty , Aman Chadha , Amit Sheth , Amitava Das

The increasing adoption of large language models (LLMs) has raised serious concerns about their reliability and trustworthiness. As a result, a growing body of research focuses on evidence-based text generation with LLMs, aiming to link…

Computation and Language · Computer Science 2026-04-17 Tobias Schreieder , Tim Schopf , Michael Färber

Product Question Answering (PQA) systems are key in e-commerce applications to provide responses to customers' questions as they shop for products. While existing work on PQA focuses mainly on English, in practice there is need to support…

Computation and Language · Computer Science 2023-05-17 Xiaoyu Shen , Akari Asai , Bill Byrne , Adrià de Gispert

Table Question Answering (TQA) aims to answer natural language questions about tabular data, often accompanied by additional contexts such as text passages. The task spans diverse settings, varying in table representation, question/answer…

Computation and Language · Computer Science 2026-04-21 Wei Zhou , Bolei Ma , Annemarie Friedrich , Mohsen Mesgar

Knowledge and expertise in the real-world can be disjointedly owned. To solve a complex question, collaboration among experts is often called for. In this paper, we propose CollabQA, a novel QA task in which several expert agents…

Artificial Intelligence · Computer Science 2022-01-25 Xiangkun Hu , Hang Yan , Qipeng Guo , Xipeng Qiu , Weinan Zhang , Zheng Zhang

Humans apprehend the world through various sensory modalities, yet language is their predominant communication channel. Machine learning systems need to draw on the same multimodal richness to have informed discourses with humans in natural…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Min Wang , Ata Mahjoubfar , Anupama Joshi

Document-based question answering (QA) increasingly includes abstract questions that require synthesizing scattered information from long documents or across multiple documents into coherent answers. However, this setting is still poorly…

Computation and Language · Computer Science 2026-05-12 Shu Wang , Shansong Zhou , Xinyang Wang , Shiwei Wang , Hulong Wu , Yixiang Fang

Generating high-quality question-answer pairs for specialized technical domains remains challenging, with existing approaches facing a tradeoff between leveraging expert examples and achieving topical diversity. We present ExpertGenQA, a…

Computation and Language · Computer Science 2025-03-06 Haz Sameen Shahgir , Chansong Lim , Jia Chen , Evangelos E. Papalexakis , Yue Dong

State-of-the-art extractive question-answering models achieve superhuman performances on the SQuAD benchmark. Yet, they are unreasonably heavy and need expensive GPU computing to answer questions in a reasonable time. Thus, they cannot be…

Computation and Language · Computer Science 2025-03-11 Sofian Chaybouti , Achraf Saghe , Aymen Shabou

Question Answering (QA) is a challenging topic since it requires tackling the various difficulties of natural language understanding. Since evaluation is important not only for identifying the strong and weak points of the various…

Computation and Language · Computer Science 2021-02-09 Katerina Papantoniou , Yannis Tzitzikas

Table Question Answering (Table QA) refers to providing precise answers from tables to answer a user's question. In recent years, there have been a lot of works on table QA, but there is a lack of comprehensive surveys on this research…

Computation and Language · Computer Science 2022-07-13 Nengzheng Jin , Joanna Siebert , Dongfang Li , Qingcai Chen

Question answering based on retrieval augmented generation (RAG-QA) is an important research topic in NLP and has a wide range of real-world applications. However, most existing datasets for this task are either constructed using a single…

Computation and Language · Computer Science 2024-10-04 Rujun Han , Yuhao Zhang , Peng Qi , Yumo Xu , Jenyuan Wang , Lan Liu , William Yang Wang , Bonan Min , Vittorio Castelli

Question Answering (QA), as a research field, has primarily focused on either knowledge bases (KBs) or free text as a source of knowledge. These two sources have historically shaped the kinds of questions that are asked over these sources,…

Computation and Language · Computer Science 2019-02-26 Igor Labutov , Bishan Yang , Anusha Prakash , Amos Azaria

Fact-checking is the task of verifying the veracity of claims by assessing their assertions against credible evidence. The vast majority of fact-checking studies focus exclusively on political claims. Very little research explores…

Computation and Language · Computer Science 2020-10-21 Neema Kotonya , Francesca Toni