English
Related papers

Related papers: ELI5: Long Form Question Answering

200 papers

Developing methods of automated inference that are able to provide users with compelling human-readable justifications for why the answer to a question is correct is critical for domains such as science and medicine, where user trust and…

Computation and Language · Computer Science 2018-02-12 Peter A. Jansen , Elizabeth Wainwright , Steven Marmorstein , Clayton T. Morrison

We explore state-of-the-art neural models for question answering on electronic medical records and improve their ability to generalize better on previously unseen (paraphrased) questions at test time. We enable this by learning to predict…

Artificial Intelligence · Computer Science 2021-02-23 Bhanu Pratap Singh Rawat , Wei-Hung Weng , So Yeon Min , Preethi Raghavan , Peter Szolovits

Large Language Models (LLMs) have demonstrated remarkable capabilities in mathematical problem-solving. However, the transition from providing answers to generating high-quality educational questions presents significant challenges that…

Computation and Language · Computer Science 2025-08-15 Chengliang Zhou , Mei Wang , Ting Zhang , Qiannan Zhu , Jian Li , Hua Huang

Models pre-trained with a language modeling objective possess ample world knowledge and language skills, but are known to struggle in tasks that require reasoning. In this work, we propose to leverage semi-structured tables, and…

Computation and Language · Computer Science 2021-07-16 Ori Yoran , Alon Talmor , Jonathan Berant

Long-form question answering (LFQA) enables answering a wide range of questions, but its flexibility poses enormous challenges for evaluation. We perform the first targeted study of the evaluation of long-form answers, covering both human…

Computation and Language · Computer Science 2023-05-30 Fangyuan Xu , Yixiao Song , Mohit Iyyer , Eunsol Choi

Question answering based on retrieval augmented generation (RAG-QA) is an important research topic in NLP and has a wide range of real-world applications. However, most existing datasets for this task are either constructed using a single…

Computation and Language · Computer Science 2024-10-04 Rujun Han , Yuhao Zhang , Peng Qi , Yumo Xu , Jenyuan Wang , Lan Liu , William Yang Wang , Bonan Min , Vittorio Castelli

Document-grounded dialogue systems aim to answer user queries by leveraging external information. Previous studies have mainly focused on handling free-form documents, often overlooking structured data such as lists, which can represent a…

Computation and Language · Computer Science 2024-10-08 Mujeen Sung , Song Feng , James Gung , Raphael Shu , Yi Zhang , Saab Mansour

We propose EXAMS -- a new benchmark dataset for cross-lingual and multilingual question answering for high school examinations. We collected more than 24,000 high-quality high school exam questions in 16 languages, covering 8 language…

Computation and Language · Computer Science 2020-11-09 Momchil Hardalov , Todor Mihaylov , Dimitrina Zlatkova , Yoan Dinkov , Ivan Koychev , Preslav Nakov

The rapid development of multimodal large language models (MLLMs) raises the question of how they compare to human performance. While existing datasets often feature synthetic or overly simplistic tasks, some models have already surpassed…

Computation and Language · Computer Science 2025-10-16 Zichen Zhu , Yang Xu , Lu Chen , Jingkai Yang , Yichuan Ma , Yiming Sun , Hailin Wen , Jiaqi Liu , Jinyu Cai , Yingzi Ma , Situo Zhang , Zihan Zhao , Liangtai Sun , Kai Yu

We introduce a high-quality dataset that contains 3,397 samples comprising (i) multiple choice questions, (ii) answers (including distractors), and (iii) their source documents, from the educational domain. Each question is phrased in two…

Computation and Language · Computer Science 2022-10-13 Amir Hadifar , Semere Kiros Bitew , Johannes Deleu , Chris Develder , Thomas Demeester

Exemplification is a process by which writers explain or clarify a concept by providing an example. While common in all forms of writing, exemplification is particularly useful in the task of long-form question answering (LFQA), where a…

Computation and Language · Computer Science 2022-05-20 Shufan Wang , Fangyuan Xu , Laure Thompson , Eunsol Choi , Mohit Iyyer

We explore the use of long-context capabilities in large language models to create synthetic reading comprehension data from entire books. Previous efforts to construct such datasets relied on crowd-sourcing, but the emergence of…

Large language models (LLMs) have been shown to perform well in answering questions and in producing long-form texts, both in few-shot closed-book settings. While the former can be validated using well-known evaluation metrics, the latter…

Computation and Language · Computer Science 2022-11-01 Reinald Kim Amplayo , Kellie Webster , Michael Collins , Dipanjan Das , Shashi Narayan

Large pre-trained language models (LMs) have been shown to perform surprisingly well when fine-tuned on tasks that require commonsense and world knowledge. However, in end-to-end architectures, it is difficult to explain what is the…

Computation and Language · Computer Science 2020-04-14 Veronica Latcinnik , Jonathan Berant

While there has been substantial progress in factoid question-answering (QA), answering complex questions remains challenging, typically requiring both a large body of knowledge and inference techniques. Open Information Extraction (Open…

Artificial Intelligence · Computer Science 2017-04-20 Tushar Khot , Ashish Sabharwal , Peter Clark

Explanations form the foundation of knowledge sharing and build upon communication principles, social dynamics, and learning theories. We focus specifically on conversational approaches for explanations because the context is highly…

Computation and Language · Computer Science 2024-06-27 Grace Li , Milad Alshomary , Smaranda Muresan

Recently, there has been growing interest in extending the context length of large language models (LLMs), aiming to effectively process long inputs of one turn or conversations with more extensive histories. While proprietary models such…

Computation and Language · Computer Science 2023-10-05 Chenxin An , Shansan Gong , Ming Zhong , Xingjian Zhao , Mukai Li , Jun Zhang , Lingpeng Kong , Xipeng Qiu

Retrieval question answering (ReQA) is the task of retrieving a sentence-level answer to a question from an open corpus (Ahmad et al.,2019).This paper presents MultiReQA, anew multi-domain ReQA evaluation suite com-posed of eight retrieval…

Computation and Language · Computer Science 2020-05-07 Mandy Guo , Yinfei Yang , Daniel Cer , Qinlan Shen , Noah Constant

We present an open deep research system for long-form question answering, selected as a winning system in the text-to-text track of the MMU-RAG competition at NeurIPS 2025. The system combines an open-source large language model (LLM) with…

Computation and Language · Computer Science 2025-12-16 Ikuya Yamada , Wataru Ikeda , Ko Yoshida , Mengyu Ye , Hinata Sugimoto , Masatoshi Suzuki , Hisanori Ozaki , Jun Suzuki

Large Language Models (LLMs) are trained on vast amounts of data, most of which is automatically scraped from the internet. This data includes encyclopedic documents that harbor a vast amount of general knowledge (e.g., Wikipedia) but also…