English
Related papers

Related papers: Delaying Interaction Layers in Transformer-based E…

200 papers

Textbook Question Answering is a complex task in the intersection of Machine Comprehension and Visual Question Answering that requires reasoning with multimodal information from text and diagrams. For the first time, this paper taps on the…

Computation and Language · Computer Science 2020-10-02 Jose Manuel Gomez-Perez , Raul Ortega

In recent years, multi-modal transformers have shown significant progress in Vision-Language tasks, such as Visual Question Answering (VQA), outperforming previous architectures by a considerable margin. This improvement in VQA is often…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Ankur Sikarwar , Gabriel Kreiman

Answering time-sensitive questions from long documents requires temporal reasoning over the times in questions and documents. An important open question is whether large language models can perform such reasoning solely using a provided…

Computation and Language · Computer Science 2023-10-31 Xin Su , Phillip Howard , Nagib Hakim , Steven Bethard

Open-domain question answering (OpenQA) is an important branch of textual QA which discovers answers for the given questions based on a large number of unstructured documents. Effectively mining correct answers from the open-domain sources…

Computation and Language · Computer Science 2022-04-04 Tingting Liang , Yixuan Jiang , Congying Xia , Ziqiang Zhao , Yuyu Yin , Philip S. Yu

Existing open-domain question answering (QA) models are not suitable for real-time usage because they need to process several long documents on-demand for every input query. In this paper, we introduce the query-agnostic indexable…

Computation and Language · Computer Science 2019-06-17 Minjoon Seo , Jinhyuk Lee , Tom Kwiatkowski , Ankur P. Parikh , Ali Farhadi , Hannaneh Hajishirzi

Current methods in open-domain question answering (QA) usually employ a pipeline of first retrieving relevant documents, then applying strong reading comprehension (RC) models to that retrieved text. However, modern RC models are complex…

Computation and Language · Computer Science 2020-09-22 Shih-Ting Lin , Greg Durrett

Transformer encoders contextualize token representations by attending to all other tokens at each layer, leading to quadratic increase in compute effort with the input length. In practice, however, the input text of many NLP tasks can be…

Computation and Language · Computer Science 2023-06-01 Jeremiah Milbauer , Annie Louis , Mohammad Javad Hosseini , Alex Fabrikant , Donald Metzler , Tal Schuster

This work addresses the problem of Question Answering (QA) on handwritten document collections. Unlike typical QA and Visual Question Answering (VQA) formulations where the answer is a short text, we aim to locate a document snippet where…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Minesh Mathew , Lluis Gomez , Dimosthenis Karatzas , CV Jawahar

While transformers demonstrate impressive performance on many knowledge intensive (KI) tasks, their ability to serve as implicit knowledge bases (KBs) remains limited, as shown on several slot-filling, question-answering (QA), fact…

Computation and Language · Computer Science 2022-03-21 Nic Jedema , Thuy Vu , Manish Gupta , Alessandro Moschitti

Open-domain Question Answering (ODQA) has achieved significant results in terms of supervised learning manner. However, data annotation cannot also be irresistible for its huge demand in an open domain. Though unsupervised QA or…

Computation and Language · Computer Science 2021-09-01 Pengfei Zhu , Xiaoguang Li , Jian Li , Hai Zhao

Generative models have recently started to outperform extractive models in Open Domain Question Answering, largely by leveraging their decoder to attend over multiple encoded passages and combining their information. However, generative…

Computation and Language · Computer Science 2022-11-21 Akhil Kedia , Mohd Abbas Zaidi , Haejun Lee

Understanding subjectivity demands reasoning skills beyond the realm of common knowledge. It requires a machine learning model to process sentiment and to perform opinion mining. In this work, I've exploited a recently released dataset for…

Computation and Language · Computer Science 2020-10-15 Lukas Muttenthaler

Visual question answering (VQA) in surgery is largely unexplored. Expert surgeons are scarce and are often overloaded with clinical and academic workloads. This overload often limits their time answering questionnaires from patients,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Lalithkumar Seenivasan , Mobarakol Islam , Adithya K Krishna , Hongliang Ren

Retrieval augmented language models have recently become the standard for knowledge intensive tasks. Rather than relying purely on latent semantics within the parameters of large neural models, these methods enlist a semi-parametric memory…

Computation and Language · Computer Science 2023-01-24 Wenhu Chen , Pat Verga , Michiel de Jong , John Wieting , William Cohen

Since their release, Transformers have revolutionized many fields from Natural Language Understanding to Computer Vision. Document Understanding (DU) was not left behind with first Transformer based models for DU dating from late 2019.…

Computation and Language · Computer Science 2023-09-12 Thibault Douzon , Stefan Duffner , Christophe Garcia , Jérémy Espinas

Asking good questions in large-scale, open-domain conversational systems is quite significant yet rather untouched. This task, substantially different from traditional question generation, requires to question not only with various patterns…

Computation and Language · Computer Science 2018-05-15 Yansen Wang , Chenyi Liu , Minlie Huang , Liqiang Nie

State-of-the-art extractive question-answering models achieve superhuman performances on the SQuAD benchmark. Yet, they are unreasonably heavy and need expensive GPU computing to answer questions in a reasonable time. Thus, they cannot be…

Computation and Language · Computer Science 2025-03-11 Sofian Chaybouti , Achraf Saghe , Aymen Shabou

Textbook Question Answering (TQA) is a complex multimodal task to infer answers given large context descriptions and abundant diagrams. Compared with Visual Question Answering (VQA), TQA contains a large number of uncommon terminologies and…

Multimedia · Computer Science 2021-12-07 Fangzhi Xu , Qika Lin , Jun Liu , Lingling Zhang , Tianzhe Zhao , Qi Chai , Yudai Pan

Open Domain Question Answering (QA) is evolving from complex pipelined systems to end-to-end deep neural networks. Specialized neural models have been developed for extracting answers from either text alone or Knowledge Bases (KBs) alone.…

Computation and Language · Computer Science 2018-09-05 Haitian Sun , Bhuwan Dhingra , Manzil Zaheer , Kathryn Mazaitis , Ruslan Salakhutdinov , William W. Cohen

We study how to enhance text representation via textual commonsense. We point out that commonsense has the nature of domain discrepancy. Namely, commonsense has different data formats and is domain-independent from the downstream task. This…

Computation and Language · Computer Science 2022-03-15 Wanyun Cui , Xingran Chen