English
Related papers

Related papers: ANTIQUE: A Non-Factoid Question Answering Benchmar…

200 papers

In this paper, we present a framework for Question Difficulty and Expertise Estimation (QDEE) in Community Question Answering sites (CQAs) such as Yahoo! Answers and Stack Overflow, which tackles a fundamental challenge in crowdsourcing:…

Social and Information Networks · Computer Science 2018-04-24 Jiankai Sun , Sobhan Moosavi , Rajiv Ramnath , Srinivasan Parthasarathy

Ambiguity is inherent to open-domain question answering; especially when exploring new topics, it can be difficult to ask questions that have a single, unambiguous answer. In this paper, we introduce AmbigQA, a new open-domain question…

Computation and Language · Computer Science 2020-10-06 Sewon Min , Julian Michael , Hannaneh Hajishirzi , Luke Zettlemoyer

Long-form answers, consisting of multiple sentences, can provide nuanced and comprehensive answers to a broader set of questions. To better understand this complex and understudied task, we study the functional structure of long-form…

Computation and Language · Computer Science 2022-03-22 Fangyuan Xu , Junyi Jessy Li , Eunsol Choi

Confidently making progress on multilingual modeling requires challenging, trustworthy evaluations. We present TyDi QA---a question answering dataset covering 11 typologically diverse languages with 204K question-answer pairs. The languages…

Computation and Language · Computer Science 2020-03-12 Jonathan H. Clark , Eunsol Choi , Michael Collins , Dan Garrette , Tom Kwiatkowski , Vitaly Nikolaev , Jennimaria Palomaki

With the expanding growth of Arabic electronic data on the web, extracting information, which is actually one of the major challenges of the question-answering, is essentially used for building corpus of documents. In fact, building a…

Information Retrieval · Computer Science 2018-05-24 Patrice Bellot , Wided Bakari , Mahmoud Neji

Fact checking is an essential task in journalism; its importance has been highlighted due to recently increased concerns and efforts in combating misinformation. In this paper, we present an automated fact-checking platform which given a…

Computation and Language · Computer Science 2019-04-04 Sebastião Miranda , David Nogueira , Afonso Mendes , Andreas Vlachos , Andrew Secker , Rebecca Garrett , Jeff Mitchel , Zita Marinho

Recent pretrained language models "solved" many reading comprehension benchmarks, where questions are written with access to the evidence document. However, datasets containing information-seeking queries where evidence documents are…

Computation and Language · Computer Science 2021-06-08 Akari Asai , Eunsol Choi

Recent progress in Large Language Model (LLM) technology has changed our role in interacting with these models. Instead of primarily testing these models with questions we already know answers to, we are now using them for queries where the…

Question Answering (QA) returns concise answers or answer lists from natural language text given a context document. Many resources go into curating QA datasets to advance robust models' development. There is a surge of QA datasets for…

Computation and Language · Computer Science 2023-11-17 Tilahun Abedissa , Ricardo Usbeck , Yaregal Assabie

The goal of a technology-assisted review is to achieve high recall with low human effort. Continuous active learning algorithms have demonstrated good performance in locating the majority of relevant documents in a collection, however their…

Information Retrieval · Computer Science 2018-10-15 Jie Zou , Dan Li , Evangelos Kanoulas

We present a large-scale dataset for the task of rewriting an ill-formed natural language question to a well-formed one. Our multi-domain question rewriting MQR dataset is constructed from human contributed Stack Exchange question edit…

Computation and Language · Computer Science 2019-11-22 Zewei Chu , Mingda Chen , Jing Chen , Miaosen Wang , Kevin Gimpel , Manaal Faruqui , Xiance Si

Automated fact-checking based on machine learning is a promising approach to identify false information distributed on the web. In order to achieve satisfactory performance, machine learning methods require a large corpus with reliable…

Computation and Language · Computer Science 2019-11-05 Andreas Hanselowski , Christian Stab , Claudia Schulz , Zile Li , Iryna Gurevych

Information-seeking dialogues span a wide range of questions, from simple factoid to complex queries that require exploring multiple facets and viewpoints. When performing exploratory searches in unfamiliar domains, users may lack…

Information Retrieval · Computer Science 2024-10-30 Weronika Łajewska , Krisztian Balog , Damiano Spina , Johanne Trippas

Retrieval Augmented Generation (RAG) works as a backbone for interacting with an enterprise's own data via Conversational Question Answering (ConvQA). In a RAG system, a retriever fetches passages from a collection in response to a…

Computation and Language · Computer Science 2024-12-24 Rishiraj Saha Roy , Joel Schlotthauer , Chris Hinze , Andreas Foltyn , Luzian Hahn , Fabian Kuech

Existing conversational systems are mostly agent-centric, which assumes the user utterances would closely follow the system ontology (for NLU or dialogue state tracking). However, in real-world scenarios, it is highly desirable that the…

Computation and Language · Computer Science 2021-09-10 Zhiyu Chen , Honglei Liu , Hu Xu , Seungwhan Moon , Hao Zhou , Bing Liu

Existing table question answering datasets contain abundant factual questions that primarily evaluate the query and schema comprehension capability of a system, but they fail to include questions that require complex reasoning and…

While the body of research directed towards constructing and generating clarifying questions in mixed-initiative conversational search systems is vast, research aimed at processing and comprehending users' answers to such questions is…

Information Retrieval · Computer Science 2024-01-23 Ivan Sekulić , Weronika Łajewska , Krisztian Balog , Fabio Crestani

Recent advancements in open-domain question answering (ODQA), i.e., finding answers from large open-domain corpus like Wikipedia, have led to human-level performance on many datasets. However, progress in QA over book stories (Book QA) lags…

Computation and Language · Computer Science 2021-06-08 Xiangyang Mou , Chenghao Yang , Mo Yu , Bingsheng Yao , Xiaoxiao Guo , Saloni Potdar , Hui Su

Large language models (LLMs) often generate content that contains factual errors when responding to fact-seeking prompts on open-ended topics. To benchmark a model's long-form factuality in open domains, we first use GPT-4 to generate…

Computation and Language · Computer Science 2024-11-08 Jerry Wei , Chengrun Yang , Xinying Song , Yifeng Lu , Nathan Hu , Jie Huang , Dustin Tran , Daiyi Peng , Ruibo Liu , Da Huang , Cosmo Du , Quoc V. Le

We introduce WebFAQ 2.0, a new version of the WebFAQ dataset, containing 198 million FAQ-based natural question-answer pairs across 108 languages. Compared to the previous version, it significantly expands multilingual coverage and the…

Information Retrieval · Computer Science 2026-02-20 Michael Dinzinger , Laura Caspari , Ali Salman , Irvin Topi , Jelena Mitrović , Michael Granitzer