English
Related papers

Related papers: Improving Neural Question Generation using World K…

200 papers

Closed-book question answering (QA) requires a model to directly answer an open-domain question without access to any external knowledge. Prior work on closed-book QA either directly finetunes or prompts a pretrained language model (LM) to…

Computation and Language · Computer Science 2023-04-28 Dan Su , Mostofa Patwary , Shrimai Prabhumoye , Peng Xu , Ryan Prenger , Mohammad Shoeybi , Pascale Fung , Anima Anandkumar , Bryan Catanzaro

This thesis investigates how natural language understanding and generation with transformer models can benefit from grounding the models with knowledge representations and addresses the following key research questions: (i) Can knowledge of…

Computation and Language · Computer Science 2024-03-25 Chenxi Whitehouse

Emerging research in Neural Question Generation (NQG) has started to integrate a larger variety of inputs, and generating questions requiring higher levels of cognition. These trends point to NQG as a bellwether for NLP, about how human…

Computation and Language · Computer Science 2019-06-05 Liangming Pan , Wenqiang Lei , Tat-Seng Chua , Min-Yen Kan

The problem of answering questions using knowledge from pre-trained language models (LMs) and knowledge graphs (KGs) presents two challenges: given a QA context (question and answer choice), methods need to (i) identify relevant knowledge…

Computation and Language · Computer Science 2022-12-14 Michihiro Yasunaga , Hongyu Ren , Antoine Bosselut , Percy Liang , Jure Leskovec

Question Answering has come a long way from answer sentence selection, relational QA to reading and comprehension. We shift our attention to generative question answering (gQA) by which we facilitate machine to read passages and answer…

Computation and Language · Computer Science 2018-07-10 Rajarshee Mitra

Question and answer generation is a data augmentation method that aims to improve question answering (QA) models given the limited amount of human labeled data. However, a considerable gap remains between synthetic and human-generated…

Computation and Language · Computer Science 2020-02-25 Raul Puri , Ryan Spring , Mostofa Patwary , Mohammad Shoeybi , Bryan Catanzaro

Question answer generation using Natural Language Processing models is ubiquitous in the world around us. It is used in many use cases such as the building of chat bots, suggestive prompts in google search and also as a way of navigating…

Computation and Language · Computer Science 2023-11-28 Shashidhar Reddy Javaji , Haoran Hu , Sai Sameer Vennam , Vijaya Gajanan Buddhavarapu

Question generation is a challenging task which aims to ask a question based on an answer and relevant context. The existing works suffer from the mismatching between question type and answer, i.e. generating a question with type $how$…

Computation and Language · Computer Science 2019-09-04 Wenjie Zhou , Minghua Zhang , Yunfang Wu

The goal of text generation is to make machines express in human language. It is one of the most important yet challenging tasks in natural language processing (NLP). Since 2014, various neural encoder-decoder models pioneered by Seq2Seq…

Computation and Language · Computer Science 2022-01-25 Wenhao Yu , Chenguang Zhu , Zaitang Li , Zhiting Hu , Qingyun Wang , Heng Ji , Meng Jiang

Large pre-trained language models (LMs) have been shown to perform surprisingly well when fine-tuned on tasks that require commonsense and world knowledge. However, in end-to-end architectures, it is difficult to explain what is the…

Computation and Language · Computer Science 2020-04-14 Veronica Latcinnik , Jonathan Berant

We propose a generative machine comprehension model that learns jointly to ask and answer questions based on documents. The proposed model uses a sequence-to-sequence framework that encodes the document and generates a question (answer)…

Computation and Language · Computer Science 2017-06-06 Tong Wang , Xingdi Yuan , Adam Trischler

Neural network models are capable of generating extremely natural sounding conversational interactions. Nevertheless, these models have yet to demonstrate that they can incorporate content in the form of factual information or…

Computation and Language · Computer Science 2018-11-19 Marjan Ghazvininejad , Chris Brockett , Ming-Wei Chang , Bill Dolan , Jianfeng Gao , Wen-tau Yih , Michel Galley

In real-world object recognition, there are numerous object classes to be recognized. Conventional image recognition based on supervised learning can only recognize object classes that exist in the training data, and thus has limited…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Kohei Uehara , Tatsuya Harada

Automatic question generation is an important problem in natural language processing. In this paper we propose a novel adaptive copying recurrent neural network model to tackle the problem of question generation from sentences and…

Machine Learning · Computer Science 2019-09-19 Xinyuan Lu , Yuhong Guo

It is often observed in knowledge-centric tasks (e.g., common sense question and answering, relation classification) that the integration of external knowledge such as entity representation into language models can help provide useful…

Computation and Language · Computer Science 2021-09-03 Ruochen Xu , Yuwei Fang , Chenguang Zhu , Michael Zeng

In traditional Visual Question Generation (VQG), most images have multiple concepts (e.g. objects and categories) for which a question could be generated, but models are trained to mimic an arbitrary choice of concept as given in their…

Machine Learning · Computer Science 2022-07-27 Nihir Vedd , Zixu Wang , Marek Rei , Yishu Miao , Lucia Specia

Automatic question generation aims to generate questions from a text passage where the generated questions can be answered by certain sub-spans of the given passage. Traditional methods mainly use rigid heuristic rules to transform a…

Computation and Language · Computer Science 2017-04-19 Qingyu Zhou , Nan Yang , Furu Wei , Chuanqi Tan , Hangbo Bao , Ming Zhou

Relation extraction is an important but challenging task that aims to extract all hidden relational facts from the text. With the development of deep language models, relation extraction methods have achieved good performance on various…

Computation and Language · Computer Science 2022-08-17 Sheng Zhang , Patrick Ng , Zhiguo Wang , Bing Xiang

Inquiry is fundamental to communication, and machines cannot effectively collaborate with humans unless they can ask questions. In this work, we build a neural network model for the task of ranking clarification questions. Our model is…

Computation and Language · Computer Science 2018-06-14 Sudha Rao , Hal Daumé

Recently it has been shown that without any access to the contextual passage, multiple choice reading comprehension (MCRC) systems are able to answer questions significantly better than random on average. These systems use their accumulated…

Computation and Language · Computer Science 2023-05-31 Adian Liusie , Vatsal Raina , Mark Gales