English
Related papers

Related papers: CS-VQA: Visual Question Answering with Compressive…

200 papers

Deep learning methods have proven extremely effective at performing a variety of medical image analysis tasks. With their potential use in clinical routine, their lack of transparency has however been one of their few weak points, raising…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Minh H. Vu , Tommy Löfstedt , Tufve Nyholm , Raphael Sznitman

Visual question answering (Visual QA) has attracted significant attention these years. While a variety of algorithms have been proposed, most of them are built upon different combinations of image and language features as well as…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Cheng Zhang , Wei-Lun Chao , Dong Xuan

Deep neural networks have been playing an essential role in the task of Visual Question Answering (VQA). Until recently, their accuracy has been the main focus of research. Now there is a trend toward assessing the robustness of these…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Jia-Hong Huang , Modar Alfadly , Bernard Ghanem , Marcel Worring

Fact-based Visual Question Answering (FVQA) requires external knowledge beyond visible content to answer questions about an image, which is challenging but indispensable to achieve general VQA. One limitation of existing FVQA solutions is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 Zihao Zhu , Jing Yu , Yujing Wang , Yajing Sun , Yue Hu , Qi Wu

Visual Question Answering (VQA) has benefited from increasingly sophisticated models, but has not enjoyed the same level of engagement in terms of data creation. In this paper, we propose a method that automatically derives VQA examples at…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Soravit Changpinyo , Doron Kukliansky , Idan Szpektor , Xi Chen , Nan Ding , Radu Soricut

Visual Question Answering (VQA) research is split into two camps: the first focuses on VQA datasets that require natural image understanding and the second focuses on synthetic datasets that test reasoning. A good VQA algorithm should be…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Robik Shrestha , Kushal Kafle , Christopher Kanan

Current methods of Visual Question Answering perform well on the answers with an amount of training data but have limited accuracy on the novel ones with few examples. However, humans can quickly adapt to these new categories with just a…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Dalu Guo , Dacheng Tao

Visual Question Answering (VQA) requires integration of feature maps with drastically different structures and focus of the correct regions. Image descriptors have structures at multiple spatial scales, while lexical inputs inherently…

Computer Vision and Pattern Recognition · Computer Science 2018-07-20 Yang Shi , Tommaso Furlanello , Sheng Zha , Animashree Anandkumar

Chart question answering (CQA) is a task used for assessing chart comprehension, which is fundamentally different from understanding natural images. CQA requires analyzing the relationships between the textual and the visual components of a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Matan Levy , Rami Ben-Ari , Dani Lischinski

Current tasks and methods in Document Understanding aims to process documents as single elements. However, documents are usually organized in collections (historical records, purchase invoices), that provide context useful for their…

Information Retrieval · Computer Science 2023-04-04 Rubèn Tito , Dimosthenis Karatzas , Ernest Valveny

This paper focuses on answering fill-in-the-blank style multiple choice questions from the Visual Madlibs dataset. Previous approaches to Visual Question Answering (VQA) have mainly used generic image features from networks trained on the…

Computer Vision and Pattern Recognition · Computer Science 2016-08-12 Tatiana Tommasi , Arun Mallya , Bryan Plummer , Svetlana Lazebnik , Alexander C. Berg , Tamara L. Berg

Visual Question Answering (VQA) emerges as one of the most fascinating topics in computer vision recently. Many state of the art methods naively use holistic visual features with language features into a Long Short-Term Memory (LSTM)…

Computer Vision and Pattern Recognition · Computer Science 2015-11-19 Aiwen Jiang , Fang Wang , Fatih Porikli , Yi Li

There has been a rapid progress in the task of Visual Question Answering with improved model architectures. Unfortunately, these models are usually computationally intensive due to their sheer size which poses a serious challenge for…

Machine Learning · Computer Science 2019-09-23 Vardaan Pahuja , Jie Fu , Christopher J. Pal

Most existing approaches to Visual Question Answering (VQA) answer questions directly, however, people usually decompose a complex question into a sequence of simple sub questions and finally obtain the answer to the original question after…

Computation and Language · Computer Science 2022-04-05 Ruonan Wang , Yuxi Qian , Fangxiang Feng , Xiaojie Wang , Huixing Jiang

We address the problem of Visual Question Answering (VQA), which requires joint image and language understanding to answer a question about a given photograph. Recent approaches have applied deep image captioning methods based on…

Computer Vision and Pattern Recognition · Computer Science 2016-03-22 Huijuan Xu , Kate Saenko

We study visual question answering in a setting where the answer has to be mined from a pool of relevant and irrelevant images given as a context. For such a setting, a model must first retrieve relevant images from the pool and answer the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Abhirama Subramanyam Penamakuri , Manish Gupta , Mithun Das Gupta , Anand Mishra

Visual question answering (VQA) has traditionally been treated as a single-step task where each question receives the same amount of effort, unlike natural human question-answering strategies. We explore a question decomposition strategy…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Zaid Khan , Vijay Kumar BG , Samuel Schulter , Manmohan Chandraker , Yun Fu

Methodologies for training visual question answering (VQA) models assume the availability of datasets with human-annotated \textit{Image-Question-Answer} (I-Q-A) triplets. This has led to heavy reliance on datasets and a lack of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Pratyay Banerjee , Tejas Gokhale , Yezhou Yang , Chitta Baral

Despite significant progress in Visual Question Answering over the years, robustness of today's VQA models leave much to be desired. We introduce a new evaluation protocol and associated dataset (VQA-Rephrasings) and show that…

Computer Vision and Pattern Recognition · Computer Science 2019-02-18 Meet Shah , Xinlei Chen , Marcus Rohrbach , Devi Parikh

Visual Question Answering (VQA) models take an image and a natural-language question as input and infer the answer to the question. Recently, VQA systems in medical imaging have gained popularity thanks to potential advantages such as…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Sergio Tascon-Morales , Pablo Márquez-Neila , Raphael Sznitman