English
Related papers

Related papers: Consistency Training by Synthetic Question Generat…

200 papers

We introduce a novel method of generating synthetic question answering corpora by combining models of question generation and answer extraction, and by filtering the results to ensure roundtrip consistency. By pretraining on the resulting…

Computation and Language · Computer Science 2019-06-14 Chris Alberti , Daniel Andor , Emily Pitler , Jacob Devlin , Michael Collins

Context information modeling is an important task in conversational KBQA. However, existing methods usually assume the independence of utterances and model them in isolation. In this paper, we propose a History Semantic Graph Enhanced KBQA…

Computation and Language · Computer Science 2023-06-13 Hao Sun , Yang Li , Liwei Deng , Bowen Li , Binyuan Hui , Binhua Li , Yunshi Lan , Yan Zhang , Yongbin Li

In this paper, we investigate the use of data obtained from prompting a large generative language model, ChatGPT, to generate synthetic training data with the aim of augmenting data in low resource scenarios. We show that with appropriate…

Artificial Intelligence · Computer Science 2023-04-28 Solomon Ubani , Suleyman Olcay Polat , Rodney Nielsen

Data augmentation is an inexpensive way to increase training data diversity and is commonly achieved via transformations of existing data. For tasks such as classification, there is a good case for learning representations of the data that…

Sound · Computer Science 2021-04-20 Turab Iqbal , Karim Helwani , Arvindh Krishnaswamy , Wenwu Wang

We study the problem of generating interconnected questions in question-answering style conversations. Compared with previous works which generate questions based on a single sentence (or paragraph), this setting is different in two major…

Computation and Language · Computer Science 2019-06-18 Yifan Gao , Piji Li , Irwin King , Michael R. Lyu

Existing question answering (QA) systems owe much of their success to large, high-quality training data. Such annotation efforts are costly, and the difficulty compounds in the cross-lingual setting. Therefore, prior cross-lingual QA work…

Computation and Language · Computer Science 2023-10-18 Bryan Li , Chris Callison-Burch

Despite Visual Question Answering (VQA) has realized impressive progress over the last few years, today's VQA models tend to capture superficial linguistic correlations in the train set and fail to generalize to the test set with different…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Long Chen , Xin Yan , Jun Xiao , Hanwang Zhang , Shiliang Pu , Yueting Zhuang

Despite considerable recent progress in Visual Question Answering (VQA) models, inconsistent or contradictory answers continue to cast doubt on their true reasoning capabilities. However, most proposed methods use indirect strategies or…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Sergio Tascon-Morales , Pablo Márquez-Neila , Raphael Sznitman

Conversational Question Answering (CQA) aims to answer questions contained within dialogues, which are not easily interpretable without context. Developing a model to rewrite conversational questions into self-contained ones is an emerging…

Computation and Language · Computer Science 2022-11-02 Zhiyu Chen , Jie Zhao , Anjie Fang , Besnik Fetahu , Oleg Rokhlenko , Shervin Malmasi

Question generation (QG) is the task of generating a question from a reference sentence and a specified answer within the sentence. A major challenge in QG is to identify answer-relevant context words to finish the…

Computation and Language · Computer Science 2019-10-25 Jingjing Li , Yifan Gao , Lidong Bing , Irwin King , Michael R. Lyu

Information-seeking conversation, which aims to help users gather information through conversation, has achieved great progress in recent years. However, the research is still stymied by the scarcity of training data. To alleviate this…

Computation and Language · Computer Science 2023-08-15 Siheng Li , Cheng Yang , Yichun Yin , Xinyu Zhu , Zesen Cheng , Lifeng Shang , Xin Jiang , Qun Liu , Yujiu Yang

State-of-the-art models for keyphrase generation require large amounts of training data to achieve good performance. However, obtaining keyphrase-labeled documents can be challenging and costly. To address this issue, we present a…

Computation and Language · Computer Science 2024-11-07 Mael Houbre , Florian Boudin , Beatrice Daille , Akiko Aizawa

There has recently been growing interest in conversational agents with long-term memory which has led to the rapid development of language models that use retrieval-augmented generation (RAG). Until recently, most work on RAG has focused on…

Computation and Language · Computer Science 2024-06-06 Nick Alonso , Tomás Figliolia , Anthony Ndirango , Beren Millidge

Synthetic data is a standard component in training large language models, yet systematic comparisons across design dimensions, including rephrasing strategy, generator model, and source data, remain absent. We conduct extensive controlled…

Question answering models commonly have access to two sources of "knowledge" during inference time: (1) parametric knowledge - the factual knowledge encoded in the model weights, and (2) contextual knowledge - external knowledge (e.g., a…

Computation and Language · Computer Science 2022-11-11 Ella Neeman , Roee Aharoni , Or Honovich , Leshem Choshen , Idan Szpektor , Omri Abend

Text-based Question Generation (QG) aims at generating natural and relevant questions that can be answered by a given answer in some context. Existing QG models suffer from a "semantic drift" problem, i.e., the semantics of the…

Computation and Language · Computer Science 2019-09-16 Shiyue Zhang , Mohit Bansal

High-quality data is essential for conversational recommendation systems and serves as the cornerstone of the network architecture development and training strategy design. Existing works contribute heavy human efforts to manually labeling…

Computation and Language · Computer Science 2023-06-19 Yu Lu , Junwei Bao , Zichen Ma , Xiaoguang Han , Youzheng Wu , Shuguang Cui , Xiaodong He

Open-domain conversational question answering can be viewed as two tasks: passage retrieval and conversational question answering, where the former relies on selecting candidate passages from a large corpus and the latter requires better…

Computation and Language · Computer Science 2022-11-18 Hung-Chieh Fang , Kuo-Han Hung , Chao-Wei Huang , Yun-Nung Chen

Synthetic data generation is widely known to boost the accuracy of neural grammatical error correction (GEC) systems, but existing methods often lack diversity or are too simplistic to generate the broad range of grammatical errors made by…

Computation and Language · Computer Science 2021-05-28 Felix Stahlberg , Shankar Kumar

Question-answering software is becoming increasingly integrated into our daily lives, with prominent examples including Apple Siri and Amazon Alexa. Ensuring the quality of such systems is critical, as incorrect answers could lead to…

Software Engineering · Computer Science 2025-11-12 Shuang Liu , Zhirun Zhang , Jinhao Dong , Zan Wang , Qingchao Shen , Junjie Chen , Wei Lu , Xiaoyong Du