中文
相关论文

相关论文: Relation-Guided Pre-Training for Open-Domain Quest…

200 篇论文

In this paper, we focus on task-specific question answering (QA). To this end, we introduce a method for generating exhaustive and high-quality training data, which allows us to train compact (e.g., run on a mobile device), task-specific QA…

Recently, utilizing deep neural networks to build the opendomain dialogue models has become a hot topic. However, the responses generated by these models suffer from many problems such as responses not being contextualized and tend to…

计算与语言 · 计算机科学 2023-09-07 Mengjuan Liu , Chenyang Liu , Yunfan Yang , Jiang Liu , Mohan Jing

Pre-trained language models have contributed significantly to relation extraction by demonstrating remarkable few-shot learning abilities. However, prompt tuning methods for relation extraction may still fail to generalize to those rare or…

计算与语言 · 计算机科学 2023-09-20 Xiang Chen , Lei Li , Ningyu Zhang , Chuanqi Tan , Fei Huang , Luo Si , Huajun Chen

This paper presents a simple and cost-effective method for synthesizing data to train question-answering systems. For training, fine-tuning GPT models is a common practice in resource-rich languages like English, however, it becomes…

计算与语言 · 计算机科学 2023-10-16 Kosuke Takahashi , Takahiro Omi , Kosuke Arima , Tatsuya Ishigaki

Language model pre-training has been shown to capture a surprising amount of world knowledge, crucial for NLP tasks such as question answering. However, this knowledge is stored implicitly in the parameters of a neural network, requiring…

计算与语言 · 计算机科学 2020-02-21 Kelvin Guu , Kenton Lee , Zora Tung , Panupong Pasupat , Ming-Wei Chang

Pretrained Large Language Models (LLMs) have gained significant attention for addressing open-domain Question Answering (QA). While they exhibit high accuracy in answering questions related to common knowledge, LLMs encounter difficulties…

计算与语言 · 计算机科学 2024-03-05 Rohan Kumar , Youngmin Kim , Sunitha Ravi , Haitian Sun , Christos Faloutsos , Ruslan Salakhutdinov , Minji Yoon

Pre-training on larger datasets with ever increasing model size is now a proven recipe for increased performance across almost all NLP tasks. A notable exception is information retrieval, where additional pre-training has so far failed to…

Automatic relation extraction (RE) for types of interest is of great importance for interpreting massive text corpora in an efficient manner. Traditional RE models have heavily relied on human-annotated corpus for training, which can be…

计算与语言 · 计算机科学 2017-11-27 Zeqiu Wu , Xiang Ren , Frank F. Xu , Ji Li , Jiawei Han

The emergence of structured databases for Question Answering (QA) systems has led to developing methods, in which the problem of learning the correct answer efficiently is based on a linking task between the constituents of the question and…

机器学习 · 计算机科学 2020-03-05 Hamid Zafar , Maryam Tavakol , Jens Lehmann

Question Answering (QA) is in increasing demand as the amount of information available online and the desire for quick access to this content grows. A common approach to QA has been to fine-tune a pretrained language model on a…

计算与语言 · 计算机科学 2020-04-27 Alexander R. Fabbri , Patrick Ng , Zhiguo Wang , Ramesh Nallapati , Bing Xiang

Open-domain question answering can be reformulated as a phrase retrieval problem, without the need for processing documents on-demand during inference (Seo et al., 2019). However, current phrase retrieval models heavily depend on sparse…

计算与语言 · 计算机科学 2021-06-03 Jinhyuk Lee , Mujeen Sung , Jaewoo Kang , Danqi Chen

This paper proposes a Question-Answering (QA) system for the telecom domain using 3rd Generation Partnership Project (3GPP) technical documents. Alongside, a hybrid dataset, Telco-DPR, which consists of a curated 3GPP corpus in a hybrid…

信息检索 · 计算机科学 2024-10-29 Thaina Saraiva , Marco Sousa , Pedro Vieira , António Rodrigues

Question Answering (QA) is a task in natural language processing that has seen considerable growth after the advent of transformers. There has been a surge in QA datasets that have been proposed to challenge natural language processing…

计算与语言 · 计算机科学 2021-10-08 Kate Pearce , Tiffany Zhan , Aneesh Komanduri , Justin Zhan

Question Answering (QA) has shown great success thanks to the availability of large-scale datasets and the effectiveness of neural models. Recent research works have attempted to extend these successes to the settings with few or no labeled…

计算与语言 · 计算机科学 2020-05-07 Zhongli Li , Wenhui Wang , Li Dong , Furu Wei , Ke Xu

We introduce REALTIME QA, a dynamic question answering (QA) platform that announces questions and evaluates systems on a regular basis (weekly in this version). REALTIME QA inquires about the current world, and QA systems need to answer…

Long-tail question answering presents significant challenges for large language models (LLMs) due to their limited ability to acquire and accurately recall less common knowledge. Retrieval-augmented generation (RAG) systems have shown great…

计算与语言 · 计算机科学 2026-02-20 Yiming Zhang , Siyue Zhang , Junbo Zhao , Chen Zhao

In open-domain question answering, a model receives a text question as input and searches for the correct answer using a large evidence corpus. The retrieval step is especially difficult as typical evidence corpora have \textit{millions} of…

计算与语言 · 计算机科学 2021-09-24 Christopher Sciavolino

To extract answers from a large corpus, open-domain question answering (QA) systems usually rely on information retrieval (IR) techniques to narrow the search space. Standard inverted index methods such as TF-IDF are commonly used as thanks…

计算与语言 · 计算机科学 2021-02-22 Wenhan Xiong , Hong Wang , William Yang Wang

Open-domain Question Answering (OpenQA) aims at answering factual questions with an external large-scale knowledge corpus. However, real-world knowledge is not static; it updates and evolves continually. Such a dynamic characteristic of…

计算与语言 · 计算机科学 2024-04-03 Zixuan Zhang , Revanth Gangi Reddy , Kevin Small , Tong Zhang , Heng Ji

Ideally Open-Domain Question Answering models should exhibit a number of competencies, ranging from simply memorizing questions seen at training time, to answering novel question formulations with answers seen during training, to…

计算与语言 · 计算机科学 2020-08-07 Patrick Lewis , Pontus Stenetorp , Sebastian Riedel