English
Related papers

Related papers: pdfQA: Diverse, Challenging, and Realistic Questio…

200 papers

While closed-source Large Language Models (LLMs) demonstrate strong mathematical problem-solving abilities, open-source models still face challenges with such tasks. To bridge this gap, we propose a data augmentation approach and introduce…

Identifying keyphrases (KPs) from text documents is a fundamental task in natural language processing and information retrieval. Vast majority of the benchmark datasets for this task are from the scientific domain containing only the…

Computation and Language · Computer Science 2022-04-04 Debanjan Mahata , Navneet Agarwal , Dibya Gautam , Amardeep Kumar , Swapnil Parekh , Yaman Kumar Singla , Anish Acharya , Rajiv Ratn Shah

Document-based question answering (QA) increasingly includes abstract questions that require synthesizing scattered information from long documents or across multiple documents into coherent answers. However, this setting is still poorly…

Computation and Language · Computer Science 2026-05-12 Shu Wang , Shansong Zhou , Xinyang Wang , Shiwei Wang , Hulong Wu , Yixiang Fang

Resolving knowledge conflicts is a crucial challenge in Question Answering (QA) tasks, as the internet contains numerous conflicting facts and opinions. While some research has made progress in tackling ambiguous settings where multiple…

Computation and Language · Computer Science 2024-10-30 Sagi Shaier , Ari Kobren , Philip Ogren

Question answering (QA) tasks have been posed using a variety of formats, such as extractive span selection, multiple choice, etc. This has led to format-specialized models, and even to an implicit division in the QA community. We argue…

Computation and Language · Computer Science 2020-10-08 Daniel Khashabi , Sewon Min , Tushar Khot , Ashish Sabharwal , Oyvind Tafjord , Peter Clark , Hannaneh Hajishirzi

We introduce a high-quality dataset that contains 3,397 samples comprising (i) multiple choice questions, (ii) answers (including distractors), and (iii) their source documents, from the educational domain. Each question is phrased in two…

Computation and Language · Computer Science 2022-10-13 Amir Hadifar , Semere Kiros Bitew , Johannes Deleu , Chris Develder , Thomas Demeester

Building automatic technical support system is an important yet challenge task. Conceptually, to answer a user question on a technical forum, a human expert has to first retrieve relevant documents, and then read them carefully to identify…

Computation and Language · Computer Science 2021-05-19 Wenhao Yu , Lingfei Wu , Yu Deng , Qingkai Zeng , Ruchi Mahindru , Sinem Guven , Meng Jiang

Question Answering (QA) is a task in which a machine understands a given document and a question to find an answer. Despite impressive progress in the NLP area, QA is still a challenging problem, especially for non-English languages due to…

Computation and Language · Computer Science 2022-02-04 ByungHoon So , Kyuhong Byun , Kyungwon Kang , Seongjin Cho

Document Visual Question Answering (DocVQA) has quickly grown into a central task of document understanding. But despite the fact that documents contain sensitive or copyrighted information, none of the current DocVQA methods offers strong…

Retrieval based open-domain QA systems use retrieved documents and answer-span selection over retrieved documents to find best-answer candidates. We hypothesize that multilingual Question Answering (QA) systems are prone to information…

Computation and Language · Computer Science 2022-05-26 Shramay Palta , Haozhe An , Yifan Yang , Shuaiyi Huang , Maharshi Gor

Over the last twenty years, significant progress has been made in designing and implementing Question Answering (QA) systems. However, addressing complex questions, the answers to which are spread across multiple documents, remains a…

Computation and Language · Computer Science 2026-02-26 Sourav Saha , Dwaipayan Roy , Mandar Mitra

We present a unified dataset for document Question-Answering (QA), which is obtained combining several public datasets related to Document AI and visually rich document understanding (VRDU). Our main contribution is twofold: on the one hand…

Computation and Language · Computer Science 2025-12-12 Simone Giovannini , Fabio Coppini , Andrea Gemelli , Simone Marinai

Scaling Visual Question Answering (VQA) to the open-domain and multi-hop nature of web searches, requires fundamental advances in visual representation learning, knowledge aggregation, and language generation. In this work, we introduce…

Computation and Language · Computer Science 2022-03-29 Yingshan Chang , Mridu Narang , Hisami Suzuki , Guihong Cao , Jianfeng Gao , Yonatan Bisk

We introduce REALTIME QA, a dynamic question answering (QA) platform that announces questions and evaluates systems on a regular basis (weekly in this version). REALTIME QA inquires about the current world, and QA systems need to answer…

Computation and Language · Computer Science 2024-02-29 Jungo Kasai , Keisuke Sakaguchi , Yoichi Takahashi , Ronan Le Bras , Akari Asai , Xinyan Yu , Dragomir Radev , Noah A. Smith , Yejin Choi , Kentaro Inui

Generalization and robustness to input variation are core desiderata of machine learning research. Language varies along several axes, most importantly, language instance (e.g. French) and domain (e.g. news). While adapting NLP models to…

Computation and Language · Computer Science 2024-07-02 Leon Engländer , Hannah Sterz , Clifton Poth , Jonas Pfeiffer , Ilia Kuznetsov , Iryna Gurevych

Many important questions (e.g. "How to eat healthier?") require conversation to establish context and explore in depth. However, conversational question answering (ConvQA) systems have long been stymied by scarce training data that is…

Computation and Language · Computer Science 2022-06-02 Zhuyun Dai , Arun Tejasvi Chaganty , Vincent Zhao , Aida Amini , Qazi Mamunur Rashid , Mike Green , Kelvin Guu

We introduce GQA, a new dataset for real-world visual reasoning and compositional question answering, seeking to address key shortcomings of previous VQA datasets. We have developed a strong and robust question engine that leverages scene…

Computation and Language · Computer Science 2019-07-12 Drew A. Hudson , Christopher D. Manning

Charts are very popular for analyzing data. When exploring charts, people often ask a variety of complex reasoning questions that involve several logical and arithmetic operations. They also commonly refer to visual features of a chart in…

Computation and Language · Computer Science 2022-03-22 Ahmed Masry , Do Xuan Long , Jia Qing Tan , Shafiq Joty , Enamul Hoque

Knowledge base question answering (KBQA) aims to answer a question over a knowledge base (KB). Recently, a large number of studies focus on semantically or syntactically complicated questions. In this paper, we elaborately summarize the…

Computation and Language · Computer Science 2021-05-26 Yunshi Lan , Gaole He , Jinhao Jiang , Jing Jiang , Wayne Xin Zhao , Ji-Rong Wen

As language models are adopted by a more sophisticated and diverse set of users, the importance of guaranteeing that they provide factually correct information supported by verifiable sources is critical across fields of study. This is…

Computation and Language · Computer Science 2024-04-03 Chaitanya Malaviya , Subin Lee , Sihao Chen , Elizabeth Sieber , Mark Yatskar , Dan Roth