English
Related papers

Related papers: mForms : Multimodal Form-Filling with Question Ans…

200 papers

Question answering (QA) has been the subject of a resurgence over the past years. The said resurgence has led to a multitude of question answering (QA) systems being developed both by companies and research facilities. While a few…

Artificial Intelligence · Computer Science 2016-11-09 Ricardo Usbeck , Jonathan Huthmann , Nico Duldhardt , Axel-Cyrille Ngonga Ngomo

Visual question answering (VQA) is the task of answering questions about an image. The task assumes an understanding of both the image and the question to provide a natural language answer. VQA has gained popularity in recent years due to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Deepanway Ghosal , Navonil Majumder , Roy Ka-Wei Lee , Rada Mihalcea , Soujanya Poria

The information in tables can be an important complement to text, making table-based question answering (QA) systems of great value. The intrinsic complexity of handling tables often adds an extra burden to both model design and data…

Computation and Language · Computer Science 2022-07-11 Zhengbao Jiang , Yi Mao , Pengcheng He , Graham Neubig , Weizhu Chen

Transformers have become the gold standard for many natural language processing tasks and, in particular, for multi-hop question answering (MHQA). This task includes processing a long document and reasoning over the multiple parts of it.…

Computation and Language · Computer Science 2023-12-01 Alsu Sagirova , Mikhail Burtsev

The exponential growth of AI in science necessitates efficient and scalable solutions for retrieving and preserving research information. Here, we present a tool for the development of a customized question-answer (QA) dataset, called…

Information Retrieval · Computer Science 2025-02-25 Qiming Liu , Zhongzheng Niu , Siting Liu , Mao Tian

We present a new pre-training method, Multimodal Inverse Cloze Task, for Knowledge-based Visual Question Answering about named Entities (KVQAE). KVQAE is a recently introduced task that consists in answering questions about named entities…

Computation and Language · Computer Science 2023-01-12 Paul Lerner , Olivier Ferret , Camille Guinaudeau

Scaling Visual Question Answering (VQA) to the open-domain and multi-hop nature of web searches, requires fundamental advances in visual representation learning, knowledge aggregation, and language generation. In this work, we introduce…

Computation and Language · Computer Science 2022-03-29 Yingshan Chang , Mridu Narang , Hisami Suzuki , Guihong Cao , Jianfeng Gao , Yonatan Bisk

We present Multiple-Question Multiple-Answer (MQMA), a novel approach to do text-VQA in encoder-decoder transformer models. The text-VQA task requires a model to answer a question by understanding multi-modal content: text (typically from…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Peng Tang , Srikar Appalaraju , R. Manmatha , Yusheng Xie , Vijay Mahadevan

Visual question answering (VQA) is one of the crucial vision-and-language tasks. Yet, existing VQA research has mostly focused on the English language, due to a lack of suitable evaluation resources. Previous work on cross-lingual VQA has…

Computation and Language · Computer Science 2023-06-12 Chen Liu , Jonas Pfeiffer , Anna Korhonen , Ivan Vulić , Iryna Gurevych

Attribution is crucial in question answering (QA) with Large Language Models (LLMs).SOTA question decomposition-based approaches use long form answers to generate questions for retrieving related documents. However, the generated questions…

Computation and Language · Computer Science 2025-11-17 Zhichao Yan , Jiaoyan Chen , Jiapu Wang , Xiaoli Li , Ru Li , Jeff Z. Pan

Having revolutionized natural language processing (NLP) applications, large language models (LLMs) are expanding into the realm of multimodal inputs. Owing to their ability to interpret images, multimodal LLMs (MLLMs) have been primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Jusung Lee , Sungguk Cha , Younghyun Lee , Cheoljong Yang

Conversational Question Answering (CQA) aims to answer questions contained within dialogues, which are not easily interpretable without context. Developing a model to rewrite conversational questions into self-contained ones is an emerging…

Computation and Language · Computer Science 2022-11-02 Zhiyu Chen , Jie Zhao , Anjie Fang , Besnik Fetahu , Oleg Rokhlenko , Shervin Malmasi

Question Answering (QA) is a natural language processing task that aims at obtaining relevant answers to user questions. While some progress has been made in this area, biomedical questions are still a challenge to most QA approaches, due…

Information Retrieval · Computer Science 2020-12-23 Andre Lamurias , Diana Sousa , Francisco M. Couto

Multilingual question answering tasks typically assume answers exist in the same language as the question. Yet in practice, many languages face both information scarcity -- where languages have few reference articles -- and information…

Computation and Language · Computer Science 2021-04-14 Akari Asai , Jungo Kasai , Jonathan H. Clark , Kenton Lee , Eunsol Choi , Hannaneh Hajishirzi

An abundance of datasets and availability of reliable evaluation metrics have resulted in strong progress in factoid question answering (QA). This progress, however, does not easily transfer to the task of long-form QA, where the goal is to…

Computation and Language · Computer Science 2023-01-24 Ivan Stelmakh , Yi Luan , Bhuwan Dhingra , Ming-Wei Chang

The increasing availability of multimodal data across text, tables, and images presents new challenges for developing models capable of complex cross-modal reasoning. Existing methods for Multimodal Multi-hop Question Answering (MMQA) often…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Qi Zhi Lim , Chin Poo Lee , Kian Ming Lim , Kalaiarasi Sonai Muthu Anbananthen

The use of artificial intelligence (AI) offers various possibilities to expand and support educational research. Specifically, the implementation of AI can be used to develop new frameworks to establish new research tools that accelerate…

Digital Libraries · Computer Science 2024-12-12 Stefan Pietrusky

We introduce Talk to Papers, which exploits the recent open-domain question answering (QA) techniques to improve the current experience of academic search. It's designed to enable researchers to use natural language queries to find precise…

Computation and Language · Computer Science 2020-05-25 Tianchang Zhao , Kyusong Lee

In this paper, we propose a novel end-to-end trainable Video Question Answering (VideoQA) framework with three major components: 1) a new heterogeneous memory which can effectively learn global context information from appearance and motion…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Chenyou Fan , Xiaofan Zhang , Shu Zhang , Wensheng Wang , Chi Zhang , Heng Huang

In the rapidly evolving landscape of information retrieval, search engines strive to provide more personalized and relevant results to users. Query suggestion systems play a crucial role in achieving this goal by assisting users in…

Information Retrieval · Computer Science 2024-02-12 Zheng Wang , Bingzheng Gan , Wei Shi