English
Related papers

Related papers: Self-QA: Unsupervised Knowledge Guided Language Mo…

200 papers

Obtaining training data for multi-hop question answering (QA) is time-consuming and resource-intensive. We explore the possibility to train a well-performed multi-hop QA model without referencing any human-labeled multi-hop question-answer…

Computation and Language · Computer Science 2021-04-13 Liangming Pan , Wenhu Chen , Wenhan Xiong , Min-Yen Kan , William Yang Wang

This paper presents a simple and cost-effective method for synthesizing data to train question-answering systems. For training, fine-tuning GPT models is a common practice in resource-rich languages like English, however, it becomes…

Computation and Language · Computer Science 2023-10-16 Kosuke Takahashi , Takahiro Omi , Kosuke Arima , Tatsuya Ishigaki

Question Answering (QA) is in increasing demand as the amount of information available online and the desire for quick access to this content grows. A common approach to QA has been to fine-tune a pretrained language model on a…

Computation and Language · Computer Science 2020-04-27 Alexander R. Fabbri , Patrick Ng , Zhiguo Wang , Ramesh Nallapati , Bing Xiang

Question answering (QA) tasks have been posed using a variety of formats, such as extractive span selection, multiple choice, etc. This has led to format-specialized models, and even to an implicit division in the QA community. We argue…

Computation and Language · Computer Science 2020-10-08 Daniel Khashabi , Sewon Min , Tushar Khot , Ashish Sabharwal , Oyvind Tafjord , Peter Clark , Hannaneh Hajishirzi

The recent (2019-02) demonstration of the power of huge language models such as GPT-2 to memorise the answers to factoid questions raises questions about the extent to which knowledge is being embedded directly within these large models.…

Computation and Language · Computer Science 2019-11-22 Martin Andrews , Sam Witteveen

In this paper, we focus on task-specific question answering (QA). To this end, we introduce a method for generating exhaustive and high-quality training data, which allows us to train compact (e.g., run on a mobile device), task-specific QA…

Computation and Language · Computer Science 2024-01-25 Hai X. Pham , Isma Hadji , Xinnuo Xu , Ziedune Degutyte , Jay Rainey , Evangelos Kazakos , Afsaneh Fazly , Georgios Tzimiropoulos , Brais Martinez

We study the problem of semi-supervised question answering----utilizing unlabeled text to boost the performance of question answering models. We propose a novel training framework, the Generative Domain-Adaptive Nets. In this framework, we…

Computation and Language · Computer Science 2017-04-25 Zhilin Yang , Junjie Hu , Ruslan Salakhutdinov , William W. Cohen

Supervised Question Answering systems (QA systems) rely on domain-specific human-labeled data for training. Unsupervised QA systems generate their own question-answer training pairs, typically using secondary knowledge sources to achieve…

Computation and Language · Computer Science 2023-02-06 Dinesh Nagumothu , Bahadorreza Ofoghi , Guangyan Huang , Peter W. Eklund

Question Answering (QA) has shown great success thanks to the availability of large-scale datasets and the effectiveness of neural models. Recent research works have attempted to extend these successes to the settings with few or no labeled…

Computation and Language · Computer Science 2020-05-07 Zhongli Li , Wenhui Wang , Li Dong , Furu Wei , Ke Xu

Existing question answering (QA) systems owe much of their success to large, high-quality training data. Such annotation efforts are costly, and the difficulty compounds in the cross-lingual setting. Therefore, prior cross-lingual QA work…

Computation and Language · Computer Science 2023-10-18 Bryan Li , Chris Callison-Burch

Large "instruction-tuned" language models (i.e., finetuned to respond to instructions) have demonstrated a remarkable ability to generalize zero-shot to new tasks. Nevertheless, they depend heavily on human-written instruction data that is…

Computation and Language · Computer Science 2023-05-29 Yizhong Wang , Yeganeh Kordi , Swaroop Mishra , Alisa Liu , Noah A. Smith , Daniel Khashabi , Hannaneh Hajishirzi

In spoken conversational question answering (SCQA), the answer to the corresponding question is generated by retrieving and then analyzing a fixed spoken document, including multi-part conversations. Most SCQA systems have considered only…

Computation and Language · Computer Science 2021-06-25 Nuo Chen , Chenyu You , Yuexian Zou

Unsupervised question answering is an attractive task due to its independence on labeled data. Previous works usually make use of heuristic rules as well as pre-trained models to construct data and train QA models. However, most of these…

Computation and Language · Computer Science 2022-08-24 Yuxiang Nie , Heyan Huang , Zewen Chi , Xian-Ling Mao

Question Answering (QA) is the task of automatically answering questions posed by humans in natural languages. There are different settings to answer a question, such as abstractive, extractive, boolean, and multiple-choice QA. As a popular…

Computation and Language · Computer Science 2023-04-07 Zhichao Duan , Xiuxing Li , Zhengyan Zhang , Zhenyu Li , Ning Liu , Jianyong Wang

Unsupervised commonsense question answering is appealing since it does not rely on any labeled task data. Among existing work, a popular solution is to use pre-trained language models to score candidate choices directly conditioned on the…

Computation and Language · Computer Science 2021-06-01 Yilin Niu , Fei Huang , Jiaming Liang , Wenkai Chen , Xiaoyan Zhu , Minlie Huang

With the rise of Large Language Models (LLMs) and their ubiquitous deployment in diverse domains, measuring language model behavior on realistic data is imperative. For example, a company deploying a client-facing chatbot must ensure that…

Computation and Language · Computer Science 2023-06-30 Neel Jain , Khalid Saifullah , Yuxin Wen , John Kirchenbauer , Manli Shu , Aniruddha Saha , Micah Goldblum , Jonas Geiping , Tom Goldstein

The GPT (Generative Pre-trained Transformer) language models are an artificial intelligence and natural language processing technology that enables automatic text generation. There is a growing interest in applying GPT language models to…

Computers and Society · Computer Science 2024-03-25 Manuel de Buenaga , Francisco Javier Bueno

Question Generation (QG) is the task of generating a plausible question for a given <passage, answer> pair. Template-based QG uses linguistically-informed heuristics to transform declarative sentences into interrogatives, whereas supervised…

Computation and Language · Computer Science 2021-09-17 Chenyang Lyu , Lifeng Shang , Yvette Graham , Jennifer Foster , Xin Jiang , Qun Liu

Recent instruction-finetuned large language models (LMs) have achieved notable performances in various tasks, such as question-answering (QA). However, despite their ability to memorize a vast amount of general knowledge across diverse…

Computation and Language · Computer Science 2023-10-23 Soyeong Jeong , Jinheon Baek , Sukmin Cho , Sung Ju Hwang , Jong C. Park

Question-answering (QA) that comes naturally to humans is a critical component in seamless human-computer interaction. It has emerged as one of the most convenient and natural methods to interact with the web and is especially desirable in…

Computation and Language · Computer Science 2022-11-15 Deepak Gupta
‹ Prev 1 2 3 10 Next ›