中文
相关论文

相关论文: SF-QA: Simple and Fair Evaluation Library for Open…

200 篇论文

This study focuses on the evaluation of the Open Question Answering (Open-QA) task, which can directly estimate the factuality of large language models (LLMs). Current automatic evaluation methods have shown limitations, indicating that…

计算与语言 · 计算机科学 2023-10-24 Cunxiang Wang , Sirui Cheng , Qipeng Guo , Yuanhao Yue , Bowen Ding , Zhikun Xu , Yidong Wang , Xiangkun Hu , Zheng Zhang , Yue Zhang

Tables extracted from web documents can be used to directly answer many web search queries. Previous works on question answering (QA) using web tables have focused on factoid queries, i.e., those answerable with a short string like person…

信息检索 · 计算机科学 2020-01-13 Kaushik Chakrabarti , Zhimin Chen , Siamak Shakeri , Guihong Cao

Semantic Question Answering (SQA) systems automatically interpret user questions expressed in a natural language in terms of semantic queries. This process involves uncertainty, such that the resulting queries do not always accurately match…

信息检索 · 计算机科学 2020-06-26 Hamid Zafar , Mohnish Dubey , Jens Lehmann , Elena Demidova

In open-domain question answering (QA), retrieve-and-read mechanism has the inherent benefit of interpretability and the easiness of adding, removing, or editing knowledge compared to the parametric approaches of closed-book QA models.…

计算与语言 · 计算机科学 2021-05-25 Sohee Yang , Minjoon Seo

We study open-domain question answering with structured, unstructured and semi-structured knowledge sources, including text, tables, lists and knowledge bases. Departing from prior work, we propose a unifying approach that homogenizes all…

Ambiguity is inherent to open-domain question answering; especially when exploring new topics, it can be difficult to ask questions that have a single, unambiguous answer. In this paper, we introduce AmbigQA, a new open-domain question…

计算与语言 · 计算机科学 2020-10-06 Sewon Min , Julian Michael , Hannaneh Hajishirzi , Luke Zettlemoyer

Current methods in open-domain question answering (QA) usually employ a pipeline of first retrieving relevant documents, then applying strong reading comprehension (RC) models to that retrieved text. However, modern RC models are complex…

计算与语言 · 计算机科学 2020-09-22 Shih-Ting Lin , Greg Durrett

In the era of Big Knowledge Graphs, Question Answering (QA) systems have reached a milestone in their performance and feasibility. However, their applicability, particularly in specific domains such as the biomedical domain, has not gained…

计算与语言 · 计算机科学 2020-10-19 Saeedeh Shekarpour , Abhishek Nadgeri , Kuldeep Singh

While there has been substantial progress in factoid question-answering (QA), answering complex questions remains challenging, typically requiring both a large body of knowledge and inference techniques. Open Information Extraction (Open…

人工智能 · 计算机科学 2017-04-20 Tushar Khot , Ashish Sabharwal , Peter Clark

A popular recent approach to answering open-domain questions is to first search for question-related passages and then apply reading comprehension models to extract answers. Existing methods usually extract answers from single passages…

计算与语言 · 计算机科学 2018-04-27 Shuohang Wang , Mo Yu , Jing Jiang , Wei Zhang , Xiaoxiao Guo , Shiyu Chang , Zhiguo Wang , Tim Klinger , Gerald Tesauro , Murray Campbell

The paper presents an open-domain Question Answering system for Romanian, answering COVID-19 related questions. The QA system pipeline involves automatic question processing, automatic query generation, web searching for the top 10 most…

The financial domain frequently deals with large numbers of long documents that are essential for daily operations. Significant effort is put towards automating financial data analysis. However, a persistent challenge, not limited to the…

计算与语言 · 计算机科学 2024-06-21 Viet Dac Lai , Michael Krumdick , Charles Lovering , Varshini Reddy , Craig Schmidt , Chris Tanner

Answering questions related to the legal domain is a complex task, primarily due to the intricate nature and diverse range of legal document systems. Providing an accurate answer to a legal query typically necessitates specialized knowledge…

计算与语言 · 计算机科学 2023-09-18 Abdelrahman Abdallah , Bhawna Piryani , Adam Jatowt

This work presents a novel four-stage open-domain QA pipeline R2-D2 (Rank twice, reaD twice). The pipeline is composed of a retriever, passage reranker, extractive reader, generative reader and a mechanism that aggregates the final…

计算与语言 · 计算机科学 2021-09-09 Martin Fajcik , Martin Docekal , Karel Ondrej , Pavel Smrz

Ambiguous questions persist in open-domain question answering, because formulating a precise question with a unique answer is often challenging. Previously, Min et al. (2020) have tackled this issue by generating disambiguated questions for…

计算与语言 · 计算机科学 2023-10-26 Dongryeol Lee , Segwang Kim , Minwoo Lee , Hwanhee Lee , Joonsuk Park , Sang-Woo Lee , Kyomin Jung

Open-domain question answering (QA) systems are often built with retrieval modules. However, retrieving passages from a given source is known to suffer from insufficient knowledge coverage. Alternatively, prompting large language models…

计算与语言 · 计算机科学 2023-10-24 Yunxiang Zhang , Muhammad Khalifa , Lajanugen Logeswaran , Moontae Lee , Honglak Lee , Lu Wang

With the rapid development of knowledge bases(KBs),question answering(QA)based on KBs has become a hot research issue. In this paper,we propose two frameworks(i.e.,pipeline framework,an end-to-end framework)to focus answering…

计算与语言 · 计算机科学 2019-05-07 Lin Li , Mengjing Zhang , Zhaohui Chao , Jianwen Xiang

Information retrieval (IR) or knowledge retrieval, is a critical component for many down-stream tasks such as open-domain question answering (QA). It is also very challenging, as it requires succinctness, completeness, and correctness. In…

计算与语言 · 计算机科学 2023-08-10 Xiaodong Yu , Ben Zhou , Dan Roth

Question answering (QA) system aims at retrieving precise information from a large collection of documents against a query. This paper describes the architecture of a Natural Language Question Answering (NLQA) system for a specific domain…

计算与语言 · 计算机科学 2013-11-14 Athira P. M. , Sreeja M. , P. C. Reghu Raj

When Question-Answering (QA) systems are deployed in the real world, users query them through a variety of interfaces, such as speaking to voice assistants, typing questions into a search engine, or even translating questions to languages…

计算与语言 · 计算机科学 2021-02-17 Abhilasha Ravichander , Siddharth Dalmia , Maria Ryskina , Florian Metze , Eduard Hovy , Alan W Black