English
Related papers

Related papers: Co-Trained Retriever-Generator Framework for Quest…

200 papers

Retrieval-augmented generation (RAG) has received much attention for Open-domain question-answering (ODQA) tasks as a means to compensate for the parametric knowledge of large language models (LLMs). While previous approaches focused on…

Computation and Language · Computer Science 2024-09-30 Minsang Kim , Cheoneum Park , Seungjun Baek

Math word problem (MWP) is a challenging and critical task in natural language processing. Many recent studies formalize MWP as a generation task and have adopted sequence-to-sequence models to transform problem descriptions to mathematical…

Computation and Language · Computer Science 2021-09-08 Jianhao Shen , Yichun Yin , Lin Li , Lifeng Shang , Xin Jiang , Ming Zhang , Qun Liu

Retrieval-augmented generation is increasingly used for financial question answering over long regulatory filings, yet reliability depends on retrieving the exact context needed to justify answers in high stakes settings. We study a…

Computation and Language · Computer Science 2026-02-23 Amine Kobeissi , Philippe Langlais

Recent trends in natural language processing using pretraining have shifted focus towards pretraining and fine-tuning approaches for text generation. Often the focus has been on task-agnostic approaches that generalize the language modeling…

Computation and Language · Computer Science 2020-04-24 Shashi Narayan , Gonçalo Simoes , Ji Ma , Hannah Craighead , Ryan Mcdonald

Large Language Models (LLMs) and Knowledge Graphs (KGs) offer a promising approach to robust and explainable Question Answering (QA). While LLMs excel at natural language understanding, they suffer from knowledge gaps and hallucinations.…

Machine Learning · Computer Science 2025-04-15 Jasper Linders , Jakub M. Tomczak

Multi-modal multi-hop question answering involves answering a question by reasoning over multiple input sources from different modalities. Existing methods often retrieve evidences separately and then use a language model to generate an…

Computation and Language · Computer Science 2023-08-08 Qian Yang , Qian Chen , Wen Wang , Baotian Hu , Min Zhang

Question generation (QG) is a natural language processing task with an abundance of potential benefits and use cases in the educational domain. In order for this potential to be realized, QG systems must be designed and validated with…

Computation and Language · Computer Science 2025-11-05 Sabina Elkins , Ekaterina Kochmar , Jackie C. K. Cheung , Iulian Serban

In this paper, we tackle the task of distractor generation (DG) for multiple-choice questions. Our study introduces two key designs. First, we propose \textit{retrieval augmented pretraining}, which involves refining the language model…

Computation and Language · Computer Science 2024-06-21 Han-Cheng Yu , Yu-An Shih , Kin-Man Law , Kai-Yu Hsieh , Yu-Chen Cheng , Hsin-Chih Ho , Zih-An Lin , Wen-Chuan Hsu , Yao-Chung Fan

Reading comprehension QA tasks have seen a recent surge in popularity, yet most works have focused on fact-finding extractive QA. We instead focus on a more challenging multi-hop generative task (NarrativeQA), which requires the model to…

Computation and Language · Computer Science 2019-06-04 Lisa Bauer , Yicheng Wang , Mohit Bansal

We study a novel task, Video Question-Answer Generation (VQAG), for challenging Video Question Answering (Video QA) task in multimedia. Due to expensive data annotation costs, many widely used, large-scale Video QA datasets such as…

Today the pre-trained language models achieve great success for question generation (QG) task and significantly outperform traditional sequence-to-sequence approaches. However, the pre-trained models treat the input passage as a flat…

Computation and Language · Computer Science 2022-09-12 Zichen Wu , Xin Jia , Fanyi Qu , Yunfang Wu

Automatic question generation can benefit many applications ranging from dialogue systems to reading comprehension. While questions are often asked with respect to long documents, there are many challenges with modeling such long documents.…

Computation and Language · Computer Science 2019-10-24 Luu Anh Tuan , Darsh J Shah , Regina Barzilay

Evaluating Retrieval-Augmented Generation (RAG) in large language models (LLMs) is challenging because benchmarks can quickly become stale. Questions initially requiring retrieval may become answerable from pretraining knowledge as newer…

Computation and Language · Computer Science 2025-05-12 Max Glockner , Xiang Jiang , Leonardo F. R. Ribeiro , Iryna Gurevych , Markus Dreyer

Online reviews provide rich information about products and service, while it remains inefficient for potential consumers to exploit the reviews for fulfilling their specific information need. We propose to explore question generation as a…

Information Retrieval · Computer Science 2020-05-05 Qian Yu , Lidong Bing , Qiong Zhang , Wai Lam , Luo Si

Formal query generation aims to generate correct executable queries for question answering over knowledge bases (KBs), given entity and relation linking results. Current approaches build universal paraphrasing or ranking models for the…

Computation and Language · Computer Science 2019-08-30 Jiwei Ding , Wei Hu , Qixin Xu , Yuzhong Qu

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

Computation and Language · Computer Science 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

Generating diverse and effective clarifying questions is crucial for improving query understanding and retrieval performance in open-domain conversational search (CS) systems. We propose AGENT-CQ (Automatic GENeration, and evaluaTion of…

Computation and Language · Computer Science 2024-10-28 Clemencia Siro , Yifei Yuan , Mohammad Aliannejadi , Maarten de Rijke

In this paper, we present a system to showcase the capabilities of the latest state-of-the-art retrieval augmented generation models trained on knowledge-intensive language tasks, such as slot filling, open domain question answering,…

Computation and Language · Computer Science 2022-09-23 Md Faisal Mahbub Chowdhury , Michael Glass , Gaetano Rossiello , Alfio Gliozzo , Nandana Mihindukulasooriya

Conversational question answering (CQA) facilitates an incremental and interactive understanding of a given context, but building a CQA system is difficult for many domains due to the problem of data scarcity. In this paper, we introduce a…

Computation and Language · Computer Science 2022-10-25 Seonjeong Hwang , Yunsu Kim , Gary Geunbae Lee

Multiple-choice questions (MCQs) are ubiquitous in almost all levels of education since they are easy to administer, grade, and are a reliable form of assessment. An important aspect of MCQs is the distractors, i.e., incorrect options that…

Computation and Language · Computer Science 2024-01-12 Hunter McNichols , Wanyong Feng , Jaewook Lee , Alexander Scarlatos , Digory Smith , Simon Woodhead , Andrew Lan