English
Related papers

Related papers: Kvasir-VQA: A Text-Image Pair GI Tract Dataset

200 papers

We propose a novel video understanding task by fusing knowledge-based and video question answering. First, we introduce KnowIT VQA, a video dataset with 24,282 human-generated question-answer pairs about a popular sitcom. The dataset…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Noa Garcia , Mayu Otani , Chenhui Chu , Yuta Nakashima

In 2014, more than 10 million people in the US were affected by an ambulatory disability. Thus, gait rehabilitation is a crucial part of health care systems. The quantification of human locomotion enables clinicians to describe and analyze…

Human-Computer Interaction · Computer Science 2019-05-27 Markus Wagner , Djordje Slijepcevic , Brian Horsak , Alexander Rind , Matthias Zeppelzauer , Wolfgang Aigner

We tackle the challenge of Visual Question Answering in multi-image setting for the ISVQA dataset. Traditional VQA tasks have focused on a single-image setting where the target answer is generated from a single image. Image set VQA,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Abhinav Khattar , Aviral Joshi , Har Simrat Singh , Pulkit Goel , Rohit Prakash Barnwal

Visual Question Answering (VQA) is an evolving research field aimed at enabling machines to answer questions about visual content by integrating image and language processing techniques such as feature extraction, object detection, text…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Ngoc Dung Huynh , Mohamed Reda Bouadjenek , Sunil Aryal , Imran Razzak , Hakim Hacid

Document Visual Question Answering (VQA) aims to understand visually-rich documents to answer questions in natural language, which is an emerging research topic for both Natural Language Processing and Computer Vision. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Fengbin Zhu , Wenqiang Lei , Fuli Feng , Chao Wang , Haozhou Zhang , Tat-Seng Chua

Visual Question Answering (VQA) is an interdisciplinary field that bridges the gap between computer vision (CV) and natural language processing(NLP), enabling Artificial Intelligence(AI) systems to answer questions about images. Since its…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Anupam Pandey , Deepjyoti Bodo , Arpan Phukan , Asif Ekbal

GQA~\citep{hudson2019gqa} is a dataset for real-world visual reasoning and compositional question answering. We found that many answers predicted by the best vision-language models on the GQA dataset do not match the ground-truth answer but…

Computation and Language · Computer Science 2022-06-02 Man Luo , Shailaja Keyur Sampat , Riley Tallman , Yankai Zeng , Manuha Vancha , Akarshan Sajja , Chitta Baral

Visual Question Answering (VQA) models aim to answer natural language questions about given images. Due to its ability to ask questions that differ from those used when training the model, medical VQA has received substantial attention in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Sergio Tascon-Morales , Pablo Márquez-Neila , Raphael Sznitman

The widely used Fact-based Visual Question Answering (FVQA) dataset contains visually-grounded questions that require information retrieval using common sense knowledge graphs to answer. It has been observed that the original dataset is…

Computation and Language · Computer Science 2023-03-21 Weizhe Lin , Zhilin Wang , Bill Byrne

Seeking answers to questions within long scientific research articles is a crucial area of study that aids readers in quickly addressing their inquiries. However, existing question-answering (QA) datasets based on scientific papers are…

Computation and Language · Computer Science 2025-01-14 Shraman Pramanick , Rama Chellappa , Subhashini Venugopalan

The accurate classification of gastrointestinal diseases from endoscopic and histopathological imagery remains a significant challenge in medical diagnostics, mainly due to the vast data volume and subtle variation in inter-class visuals.…

Image and Video Processing · Electrical Eng. & Systems 2026-04-28 Md Assaduzzaman , Nushrat Jahan Oyshi , Eram Mahamud

Visual question answering (VQA) is a task where an image is given, and a series of questions are asked about the image. To build an efficient VQA algorithm, a large amount of QA data is required which is very expensive. Generating synthetic…

Computation and Language · Computer Science 2024-08-23 Taehee Kim , Yeongjae Cho , Heejun Shin , Yohan Jo , Dongmyung Shin

Medical Visual Question Answering (VQA) enhances clinical decision-making by enabling systems to interpret medical images and answer clinical queries. However, developing efficient, high-performance VQA models is challenging due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Belal Alsinglawi , Chris McCarthy , Sara Webb , Christopher Fluke , Navid Toosy Saidy

Visual Question Answering (VQA) is a fundamental multimodal task that requires models to jointly understand visual and textual information. Early VQA systems relied heavily on language biases, motivating subsequent work to emphasize visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Nguyen Anh Tuong , Phan Ba Duc , Nguyen Trung Quoc , Tran Dac Thinh , Dang Duy Lan , Nguyen Quoc Thinh , Tung Le

Visual Question Answering (VQA) requires integration of feature maps with drastically different structures and focus of the correct regions. Image descriptors have structures at multiple spatial scales, while lexical inputs inherently…

Computer Vision and Pattern Recognition · Computer Science 2018-07-20 Yang Shi , Tommaso Furlanello , Sheng Zha , Animashree Anandkumar

Visual Question Generation (VQG) is a task to generate questions from images. When humans ask questions about an image, their goal is often to acquire some new knowledge. However, existing studies on VQG have mainly addressed question…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Kohei Uehara , Tatsuya Harada

Visual Question Answering (VQA) methods have made incredible progress, but suffer from a failure to generalize. This is visible in the fact that they are vulnerable to learning coincidental correlations in the data rather than deeper…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Xinyu Wang , Yuliang Liu , Chunhua Shen , Chun Chet Ng , Canjie Luo , Lianwen Jin , Chee Seng Chan , Anton van den Hengel , Liangwei Wang

Large language models perform well on many medical QA benchmarks, but real clinical reasoning often requires integrating evidence across multiple images rather than interpreting a single view. We introduce MedThinkVQA, an expert-annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zonghai Yao , Benlu Wang , Yifan Zhang , Junda Wang , Iris Xia , Zhipeng Tang , Shuo Han , Feiyun Ouyang , Zhichao Yang , Arman Cohan , Hong Yu

Tables condense key transactional and administrative information into compact layouts, but practical extraction requires more than text recognition: systems must also recover structure (rows, columns, merged cells, headers) and interpret…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Laziz Hamdi , Amine Tamasna , Thierry Paquet

Text offers intuitive access to information. This can, in particular, complement the density of numerical time series, thereby allowing improved interactions with time series models to enhance accessibility and decision-making. While the…

Machine Learning · Computer Science 2025-11-10 Felix Divo , Maurice Kraus , Anh Q. Nguyen , Hao Xue , Imran Razzak , Flora D. Salim , Kristian Kersting , Devendra Singh Dhami