中文
相关论文

相关论文: ANTIQUE: A Non-Factoid Question Answering Benchmar…

200 篇论文

Intelligent assistants change the way people interact with computers and make it possible for people to search for products through conversations when they have purchase needs. During the interactions, the system could ask questions on…

信息检索 · 计算机科学 2019-09-06 Keping Bi , Qingyao Ai , Yongfeng Zhang , W. Bruce Croft

We present FoQA, a Faroese extractive question-answering (QA) dataset with 2,000 samples, created using a semi-automated approach combining Large Language Models (LLMs) and human validation. The dataset was generated from Faroese Wikipedia…

计算与语言 · 计算机科学 2025-02-12 Annika Simonsen , Dan Saattrup Nielsen , Hafsteinn Einarsson

Long-form factuality evaluation assesses the ability of models to generate accurate, comprehensive responses to short prompts. Existing benchmarks often lack human verification, leading to potential quality issues. To address this…

计算与语言 · 计算机科学 2025-08-04 Mingda Chen , Yang Li , Xilun Chen , Adina Williams , Gargi Ghosh , Scott Yih

Question answering (QA) models often rely on large-scale training datasets, which necessitates the development of a data generation framework to reduce the cost of manual annotations. Although several recent studies have aimed to generate…

计算与语言 · 计算机科学 2023-02-07 Seongyun Lee , Hyunjae Kim , Jaewoo Kang

Teachers and students are increasingly relying on online learning resources to supplement the ones provided in school. This increase in the breadth and depth of available resources is a great thing for students, but only provided they are…

计算与语言 · 计算机科学 2023-04-17 Antoine Lefebvre-Brossard , Stephane Gazaille , Michel C. Desmarais

Existing datasets for automated fact-checking have substantial limitations, such as relying on artificial claims, lacking annotations for evidence and intermediate reasoning, or including evidence published after the claim. In this paper we…

计算与语言 · 计算机科学 2023-11-09 Michael Schlichtkrull , Zhijiang Guo , Andreas Vlachos

Information seeking users often pose questions with false presuppositions, especially when asking about unfamiliar topics. Most existing question answering (QA) datasets, in contrast, assume all questions have well defined answers. We…

计算与语言 · 计算机科学 2022-12-01 Xinyan Velocity Yu , Sewon Min , Luke Zettlemoyer , Hannaneh Hajishirzi

A peculiarity of conversational search systems is that they involve mixed-initiatives such as system-generated query clarifying questions. Evaluating those systems at a large scale on the end task of IR is very challenging, requiring…

信息检索 · 计算机科学 2023-11-13 Pierre Erbacher , Jian-Yun Nie , Philippe Preux , Laure Soulier

Our research is in the relatively unexplored area of question answering technologies for patient-specific questions over their electronic health records. A large dataset of human expert curated question and answer pairs is an important…

计算与语言 · 计算机科学 2018-05-18 Preethi Raghavan , Siddharth Patwardhan , Jennifer J. Liang , Murthy V. Devarakonda

Question Answering (QA) is key for making possible a robust communication between human and machine. Modern language models used for QA have surpassed the human-performance in several essential tasks; however, these models require large…

计算与语言 · 计算机科学 2021-09-08 Liubov Nikolenko , Pouya Rezazadeh Kalehbasti

Question answering involves developing methods to extract useful information from large collections of documents. This is done with specialised search engines such as Answer Finder. The aim of Answer Finder is to provide an answer to a…

计算与语言 · 计算机科学 2013-04-29 Leon Derczynski , Richard Shaw , Ben Solway , Jun Wang

Progress in cross-lingual modeling depends on challenging, realistic, and diverse evaluation sets. We introduce Multilingual Knowledge Questions and Answers (MKQA), an open-domain question answering evaluation set comprising 10k…

计算与语言 · 计算机科学 2021-08-18 Shayne Longpre , Yi Lu , Joachim Daiber

The proliferation of automated conversational systems such as chatbots, spoken-dialogue systems, and smart speakers, has significantly impacted modern digital life. However, these systems are primarily designed to provide answers to…

人机交互 · 计算机科学 2023-04-05 Shih-Hong Huang , Chieh-Yang Huang , Ya-Fang Lin , Ting-Hao 'Kenneth' Huang

In this paper, we introduce MeDiaQA, a novel question answering(QA) dataset, which constructed on real online Medical Dialogues. It contains 22k multiple-choice questions annotated by human for over 11k dialogues with 120k utterances…

计算与语言 · 计算机科学 2021-08-19 Huqun Suri , Qi Zhang , Wenhua Huo , Yan Liu , Chunsheng Guan

Query-based document summarization aims to extract or generate a summary of a document which directly answers or is relevant to the search query. It is an important technique that can be beneficial to a variety of applications such as…

人工智能 · 计算机科学 2020-10-29 Mingjun Zhao , Shengli Yan , Bang Liu , Xinwang Zhong , Qian Hao , Haolan Chen , Di Niu , Bowei Long , Weidong Guo

Textual knowledge bases such as Wikipedia require considerable effort to keep up to date and consistent. While automated writing assistants could potentially ease this burden, the problem of suggesting edits grounded in external knowledge…

计算与语言 · 计算机科学 2022-07-14 Robert L. Logan , Alexandre Passos , Sameer Singh , Ming-Wei Chang

A heightened interest in the presence of the past has given rise to the new field of memory studies, but there is a lack of search and research tools to support studying how and why the past is evoked in diachronic discourses. Searching for…

信息检索 · 计算机科学 2017-10-04 Alex Olieman , Kaspar Beelen , Jaap Kamps

To enhance the ability to find credible evidence in news articles, we propose a novel task of expert recommendation, which aims to identify trustworthy experts on a specific news topic. To achieve the aim, we describe the construction of a…

信息检索 · 计算机科学 2023-05-09 Wenjia Zhang , Lin Gui , Rob Procter , Yulan He

We introduce KazQAD -- a Kazakh open-domain question answering (ODQA) dataset -- that can be used in both reading comprehension and full ODQA settings, as well as for information retrieval experiments. KazQAD contains just under 6,000…

计算与语言 · 计算机科学 2024-04-09 Rustem Yeshpanov , Pavel Efimov , Leonid Boytsov , Ardak Shalkarbayuli , Pavel Braslavski

Question answering over knowledge bases (KBQA) has become a popular approach to help users extract information from knowledge bases. Although several systems exist, choosing one suitable for a particular application scenario is difficult.…

计算与语言 · 计算机科学 2022-11-16 Khiem Vinh Tran , Hao Phu Phan , Khang Nguyen Duc Quach , Ngan Luu-Thuy Nguyen , Jun Jo , Thanh Tam Nguyen