English
Related papers

Related papers: Diversifying Question Generation over Knowledge Ba…

200 papers

Ambiguous user queries in search engines result in the retrieval of documents that often span multiple topics. One potential solution is for the search engine to generate multiple refined queries, each of which relates to a subset of the…

Computation and Language · Computer Science 2019-10-28 Woon Sang Cho , Yizhe Zhang , Sudha Rao , Chris Brockett , Sungjin Lee

In the automatic evaluation of generative question answering (GenQA) systems, it is difficult to assess the correctness of generated answers due to the free-form of the answer. Especially, widely used n-gram similarity metrics often fail to…

Computation and Language · Computer Science 2021-04-16 Hwanhee Lee , Seunghyun Yoon , Franck Dernoncourt , Doo Soon Kim , Trung Bui , Joongbo Shin , Kyomin Jung

Neural question generation (NQG) is the task of generating a question from a given passage with deep neural networks. Previous NQG models suffer from a problem that a significant proportion of the generated questions include words in the…

Computation and Language · Computer Science 2018-11-20 Yanghoon Kim , Hwanhee Lee , Joongbo Shin , Kyomin Jung

This paper addresses the problem of generating questions from a given context and an answer, specifically focusing on questions that require multi-hop reasoning across an extended context. Previous studies have suggested that key phrase…

Computation and Language · Computer Science 2023-10-24 Zehua Xia , Qi Gou , Bowen Yu , Haiyang Yu , Fei Huang , Yongbin Li , Cam-Tu Nguyen

State-of-the-art summarization systems can generate highly fluent summaries. These summaries, however, may contain factual inconsistencies and/or information not present in the source. Hence, an important component of assessing the quality…

Computation and Language · Computer Science 2023-09-11 Potsawee Manakul , Adian Liusie , Mark J. F. Gales

We explore question generation in the context of knowledge-grounded dialogs focusing on explainability and evaluation. Inspired by previous work on planning-based summarisation, we present a model which instead of directly generating a…

Computation and Language · Computer Science 2024-04-12 Juliette Faille , Quentin Brabant , Gwenole Lecorve , Lina M. Rojas-Barahona , Claire Gardent

Question answering (QA) models for reading comprehension have achieved human-level accuracy on in-distribution test sets. However, they have been demonstrated to lack robustness to challenge sets, whose distribution is different from that…

Computation and Language · Computer Science 2021-06-07 Kazutoshi Shinoda , Saku Sugawara , Akiko Aizawa

Generating diverse and relevant questions over text is a task with widespread applications. We argue that commonly-used evaluation metrics such as BLEU and METEOR are not suitable for this task due to the inherent diversity of reference…

Computation and Language · Computer Science 2020-08-18 Michael Sejr Schlichtkrull , Weiwei Cheng

Generating some appealing questions in open-domain conversations is an effective way to improve human-machine interactions and lead the topic to a broader or deeper direction. To avoid dull or deviated questions, some researchers tried to…

Computation and Language · Computer Science 2021-06-08 Lei Shen , Fandong Meng , Jinchao Zhang , Yang Feng , Jie Zhou

In traditional Visual Question Generation (VQG), most images have multiple concepts (e.g. objects and categories) for which a question could be generated, but models are trained to mimic an arbitrary choice of concept as given in their…

Machine Learning · Computer Science 2022-07-27 Nihir Vedd , Zixu Wang , Marek Rei , Yishu Miao , Lucia Specia

Question Generation (QG) is a Natural Language Processing (NLP) task that aids advances in Question Answering (QA) and conversational assistants. Existing models focus on generating a question based on a text and possibly the answer to the…

Computation and Language · Computer Science 2019-10-31 Junmo Kang , Haritz Puerto San Roman , Sung-Hyon Myaeng

Question Answer Generation (QAG) is an effective data augmentation technique to improve the accuracy of question answering systems, especially in low-resource domains. While recent pretrained and large language model-based QAG methods have…

Computation and Language · Computer Science 2024-06-27 Vikas Yadav , Hyuk Joon Kwon , Vijay Srinivasan , Hongxia Jin

This paper explores the task of Difficulty-Controllable Question Generation (DCQG), which aims at generating questions with required difficulty levels. Previous research on this task mainly defines the difficulty of a question as whether it…

Computation and Language · Computer Science 2021-05-26 Yi Cheng , Siyao Li , Bang Liu , Ruihui Zhao , Sujian Li , Chenghua Lin , Yefeng Zheng

Formal query generation aims to generate correct executable queries for question answering over knowledge bases (KBs), given entity and relation linking results. Current approaches build universal paraphrasing or ranking models for the…

Computation and Language · Computer Science 2019-08-30 Jiwei Ding , Wei Hu , Qixin Xu , Yuzhong Qu

We present a novel method for obtaining high-quality, domain-targeted multiple choice questions from crowd workers. Generating these questions can be difficult without trading away originality, relevance or diversity in the answer options.…

Human-Computer Interaction · Computer Science 2017-07-20 Johannes Welbl , Nelson F. Liu , Matt Gardner

Automatically generated questions often suffer from problems such as unclear expression or factual inaccuracies, requiring a reliable and comprehensive evaluation of their quality. Human evaluation is widely used in the field of question…

Computation and Language · Computer Science 2024-10-11 Weiping Fu , Bifan Wei , Jianxiang Hu , Zhongmin Cai , Jun Liu

Fact-checking requires retrieving evidence related to a claim under investigation. The task can be formulated as question generation based on a claim, followed by question answering. However, recent question generation approaches assume…

Computation and Language · Computer Science 2022-10-25 Nedjma Ousidhoum , Zhangdie Yuan , Andreas Vlachos

Multi-hop question answering faces substantial challenges due to data sparsity, which increases the likelihood of language models learning spurious patterns. To address this issue, prior research has focused on diversifying question…

Computation and Language · Computer Science 2026-04-14 Yangfan Wang , Jie Liu , Chen Tang , Lian Yan , Jingchi Jiang

Powerful generative models have led to recent progress in question generation (QG). However, it is difficult to measure advances in QG research since there are no standardized resources that allow a uniform comparison among approaches. In…

Computation and Language · Computer Science 2023-01-03 Asahi Ushio , Fernando Alva-Manchego , Jose Camacho-Collados

Generating natural, diverse, and meaningful questions from images is an essential task for multimodal assistants as it confirms whether they have understood the object and scene in the images properly. The research in visual question…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Alkesh Patel , Akanksha Bindal , Hadas Kotek , Christopher Klein , Jason Williams