English
Related papers

Related papers: Kvasir-VQA: A Text-Image Pair GI Tract Dataset

200 papers

We introduce a new test set for visual question answering (VQA) called BinaryVQA to push the limits of VQA models. Our dataset includes 7,800 questions across 1,024 images and covers a wide variety of objects, topics, and concepts. For easy…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Ali Borji

Visual Question Answering (VQA) is a complex semantic task requiring both natural language processing and visual recognition. In this paper, we explore whether VQA is solvable when images are captured in a sub-Nyquist compressive paradigm.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Li-Chi Huang , Kuldeep Kulkarni , Anik Jha , Suhas Lohit , Suren Jayasuriya , Pavan Turaga

Visual question answering is the task of answering questions about images. We introduce the VizWiz-VQA-Grounding dataset, the first dataset that visually grounds answers to visual questions asked by people with visual impairments. We…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Chongyan Chen , Samreen Anjum , Danna Gurari

Vision and language understanding has emerged as a subject undergoing intense study in Artificial Intelligence. Among many tasks in this line of research, visual question answering (VQA) has been one of the most successful ones, where the…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Yunseok Jang , Yale Song , Youngjae Yu , Youngjin Kim , Gunhee Kim

We introduce a novel visual question answering (VQA) task in the context of autonomous driving, aiming to answer natural language questions based on street-view clues. Compared to traditional VQA tasks, VQA in autonomous driving scenario…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Tianwen Qian , Jingjing Chen , Linhai Zhuo , Yang Jiao , Yu-Gang Jiang

The lack, due to privacy concerns, of large public databases of medical pathologies is a well-known and major problem, substantially hindering the application of deep learning techniques in this field. In this article, we investigate the…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Andrea Asperti , Claudio Mastronardo

The development of Urdu scene text detection, recognition, and Visual Question Answering (VQA) technologies is crucial for advancing accessibility, information retrieval, and linguistic diversity in digital content, facilitating better…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Hiba Maryam , Ling Fu , Jiajun Song , Tajrian ABM Shafayet , Qidi Luo , Xiang Bai , Yuliang Liu

The examination of chest X-ray images is a crucial component in detecting various thoracic illnesses. This study introduces a new image description generation model that integrates a Vision Transformer (ViT) encoder with cross-modal…

Image and Video Processing · Electrical Eng. & Systems 2025-04-24 Lakshita Agarwal , Bindu Verma

Document Visual Question Answering (DocVQA) requires models to jointly understand textual semantics, spatial layout, and visual features. Current methods struggle with explicit spatial relationship modeling, inefficiency with…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Ahmad Mohammadshirazi , Pinaki Prasad Guha Neogi , Dheeraj Kulshrestha , Rajiv Ramnath

In this paper, we present the mQA model, which is able to answer questions about the content of an image. The answer can be a sentence, a phrase or a single word. Our model contains four components: a Long Short-Term Memory (LSTM) to…

Computer Vision and Pattern Recognition · Computer Science 2015-11-04 Haoyuan Gao , Junhua Mao , Jie Zhou , Zhiheng Huang , Lei Wang , Wei Xu

Vision Question Answering (VQA) tasks use images to convey critical information to answer text-based questions, which is one of the most common forms of question answering in real-world scenarios. Numerous vision-text models exist today and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Yuchen Yang , Haoran Yan , Yanhao Chen , Qingqiang Wu , Qingqi Hong

In visual question answering (VQA), an algorithm must answer text-based questions about images. While multiple datasets for VQA have been created since late 2014, they all have flaws in both their content and the way algorithms are…

Computer Vision and Pattern Recognition · Computer Science 2017-09-15 Kushal Kafle , Christopher Kanan

Multimodal pre-training demonstrates its potential in the medical domain, which learns medical visual representations from paired medical reports. However, many pre-training tasks require extra annotations from clinicians, and most of them…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Tongkun Su , Jun Li , Xi Zhang , Haibo Jin , Hao Chen , Qiong Wang , Faqin Lv , Baoliang Zhao , Yin Hu

Visual question answering (VQA) is the multi-modal task of answering natural language questions about an input image. Through cross-dataset adaptation methods, it is possible to transfer knowledge from a source dataset with larger train…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Arjun R. Akula

This paper introduces QAConv, a new question answering (QA) dataset that uses conversations as a knowledge source. We focus on informative conversations, including business emails, panel discussions, and work channels. Unlike open-domain…

Computation and Language · Computer Science 2022-04-18 Chien-Sheng Wu , Andrea Madotto , Wenhao Liu , Pascale Fung , Caiming Xiong

We present ECG-Expert-QA, a comprehensive multimodal dataset for evaluating diagnostic capabilities in electrocardiogram (ECG) interpretation. It combines real-world clinical ECG data with systematically generated synthetic cases, covering…

Signal Processing · Electrical Eng. & Systems 2025-04-08 Xu Wang , Jiaju Kang , Puyu Han , Yubao Zhao , Qian Liu , Liwenfei He , Lingqiong Zhang , Lingyun Dai , Yongcheng Wang , Jie Tao

Manually tracking nutritional intake via food diaries is error-prone and burdensome. Automated computer vision techniques show promise for dietary monitoring but require large and diverse food image datasets. To address this need, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Saeejith Nair , Chi-en Amy Tai , Yuhao Chen , Alexander Wong

Recently, the amount of GI tract datasets is introduced more and more by gathering from contests and challenges. The most common task needs to solve that is to classify images from the GI tract into various classes. However, the…

Image and Video Processing · Electrical Eng. & Systems 2023-10-16 Tai Nguyen-D-P

Interpretation of imaging findings based on morphological characteristics is important for diagnosing pulmonary nodules on chest computed tomography (CT) images. In this study, we constructed a visual question answering (VQA) dataset from…

Image and Video Processing · Electrical Eng. & Systems 2026-01-19 Maiko Nagao , Kaito Urata , Atsushi Teramoto , Kazuyoshi Imaizumi , Masashi Kondo , Hiroshi Fujita

Most counting questions in visual question answering (VQA) datasets are simple and require no more than object detection. Here, we study algorithms for complex counting questions that involve relationships between objects, attribute…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Manoj Acharya , Kushal Kafle , Christopher Kanan