中文
相关论文

相关论文: ELI5: Long Form Question Answering

200 篇论文

Developing methods of automated inference that are able to provide users with compelling human-readable justifications for why the answer to a question is correct is critical for domains such as science and medicine, where user trust and…

计算与语言 · 计算机科学 2018-02-12 Peter A. Jansen , Elizabeth Wainwright , Steven Marmorstein , Clayton T. Morrison

We explore state-of-the-art neural models for question answering on electronic medical records and improve their ability to generalize better on previously unseen (paraphrased) questions at test time. We enable this by learning to predict…

人工智能 · 计算机科学 2021-02-23 Bhanu Pratap Singh Rawat , Wei-Hung Weng , So Yeon Min , Preethi Raghavan , Peter Szolovits

Large Language Models (LLMs) have demonstrated remarkable capabilities in mathematical problem-solving. However, the transition from providing answers to generating high-quality educational questions presents significant challenges that…

计算与语言 · 计算机科学 2025-08-15 Chengliang Zhou , Mei Wang , Ting Zhang , Qiannan Zhu , Jian Li , Hua Huang

Models pre-trained with a language modeling objective possess ample world knowledge and language skills, but are known to struggle in tasks that require reasoning. In this work, we propose to leverage semi-structured tables, and…

计算与语言 · 计算机科学 2021-07-16 Ori Yoran , Alon Talmor , Jonathan Berant

Long-form question answering (LFQA) enables answering a wide range of questions, but its flexibility poses enormous challenges for evaluation. We perform the first targeted study of the evaluation of long-form answers, covering both human…

计算与语言 · 计算机科学 2023-05-30 Fangyuan Xu , Yixiao Song , Mohit Iyyer , Eunsol Choi

Question answering based on retrieval augmented generation (RAG-QA) is an important research topic in NLP and has a wide range of real-world applications. However, most existing datasets for this task are either constructed using a single…

计算与语言 · 计算机科学 2024-10-04 Rujun Han , Yuhao Zhang , Peng Qi , Yumo Xu , Jenyuan Wang , Lan Liu , William Yang Wang , Bonan Min , Vittorio Castelli

Document-grounded dialogue systems aim to answer user queries by leveraging external information. Previous studies have mainly focused on handling free-form documents, often overlooking structured data such as lists, which can represent a…

计算与语言 · 计算机科学 2024-10-08 Mujeen Sung , Song Feng , James Gung , Raphael Shu , Yi Zhang , Saab Mansour

We propose EXAMS -- a new benchmark dataset for cross-lingual and multilingual question answering for high school examinations. We collected more than 24,000 high-quality high school exam questions in 16 languages, covering 8 language…

计算与语言 · 计算机科学 2020-11-09 Momchil Hardalov , Todor Mihaylov , Dimitrina Zlatkova , Yoan Dinkov , Ivan Koychev , Preslav Nakov

The rapid development of multimodal large language models (MLLMs) raises the question of how they compare to human performance. While existing datasets often feature synthetic or overly simplistic tasks, some models have already surpassed…

We introduce a high-quality dataset that contains 3,397 samples comprising (i) multiple choice questions, (ii) answers (including distractors), and (iii) their source documents, from the educational domain. Each question is phrased in two…

计算与语言 · 计算机科学 2022-10-13 Amir Hadifar , Semere Kiros Bitew , Johannes Deleu , Chris Develder , Thomas Demeester

Exemplification is a process by which writers explain or clarify a concept by providing an example. While common in all forms of writing, exemplification is particularly useful in the task of long-form question answering (LFQA), where a…

计算与语言 · 计算机科学 2022-05-20 Shufan Wang , Fangyuan Xu , Laure Thompson , Eunsol Choi , Mohit Iyyer

We explore the use of long-context capabilities in large language models to create synthetic reading comprehension data from entire books. Previous efforts to construct such datasets relied on crowd-sourcing, but the emergence of…

Large language models (LLMs) have been shown to perform well in answering questions and in producing long-form texts, both in few-shot closed-book settings. While the former can be validated using well-known evaluation metrics, the latter…

计算与语言 · 计算机科学 2022-11-01 Reinald Kim Amplayo , Kellie Webster , Michael Collins , Dipanjan Das , Shashi Narayan

Large pre-trained language models (LMs) have been shown to perform surprisingly well when fine-tuned on tasks that require commonsense and world knowledge. However, in end-to-end architectures, it is difficult to explain what is the…

计算与语言 · 计算机科学 2020-04-14 Veronica Latcinnik , Jonathan Berant

While there has been substantial progress in factoid question-answering (QA), answering complex questions remains challenging, typically requiring both a large body of knowledge and inference techniques. Open Information Extraction (Open…

人工智能 · 计算机科学 2017-04-20 Tushar Khot , Ashish Sabharwal , Peter Clark

Explanations form the foundation of knowledge sharing and build upon communication principles, social dynamics, and learning theories. We focus specifically on conversational approaches for explanations because the context is highly…

计算与语言 · 计算机科学 2024-06-27 Grace Li , Milad Alshomary , Smaranda Muresan

Recently, there has been growing interest in extending the context length of large language models (LLMs), aiming to effectively process long inputs of one turn or conversations with more extensive histories. While proprietary models such…

计算与语言 · 计算机科学 2023-10-05 Chenxin An , Shansan Gong , Ming Zhong , Xingjian Zhao , Mukai Li , Jun Zhang , Lingpeng Kong , Xipeng Qiu

Retrieval question answering (ReQA) is the task of retrieving a sentence-level answer to a question from an open corpus (Ahmad et al.,2019).This paper presents MultiReQA, anew multi-domain ReQA evaluation suite com-posed of eight retrieval…

计算与语言 · 计算机科学 2020-05-07 Mandy Guo , Yinfei Yang , Daniel Cer , Qinlan Shen , Noah Constant

We present an open deep research system for long-form question answering, selected as a winning system in the text-to-text track of the MMU-RAG competition at NeurIPS 2025. The system combines an open-source large language model (LLM) with…

计算与语言 · 计算机科学 2025-12-16 Ikuya Yamada , Wataru Ikeda , Ko Yoshida , Mengyu Ye , Hinata Sugimoto , Masatoshi Suzuki , Hisanori Ozaki , Jun Suzuki

Large Language Models (LLMs) are trained on vast amounts of data, most of which is automatically scraped from the internet. This data includes encyclopedic documents that harbor a vast amount of general knowledge (e.g., Wikipedia) but also…