English
Related papers

Related papers: ConVQG: Contrastive Visual Question Generation wit…

200 papers

Knowledge-Based Visual Question Answering (KB-VQA) methods focus on tasks that demand reasoning with information extending beyond the explicit content depicted in the image. Early methods relied on explicit knowledge bases to provide this…

Computation and Language · Computer Science 2025-05-27 Mohammad Mahdi Moradi , Sudhir Mudur

Visual Question answering is a challenging problem requiring a combination of concepts from Computer Vision and Natural Language Processing. Most existing approaches use a two streams strategy, computing image and question features that are…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Will Norcliffe-Brown , Efstathios Vafeias , Sarah Parisot

Generalization in Visual Question Answering (VQA) requires models to answer questions about images with contexts beyond the training distribution. Existing attempts primarily refine unimodal aspects, overlooking enhancements in multimodal…

Artificial Intelligence · Computer Science 2023-10-10 Trang Nguyen , Naoaki Okazaki

Generating natural, diverse, and meaningful questions from images is an essential task for multimodal assistants as it confirms whether they have understood the object and scene in the images properly. The research in visual question…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Alkesh Patel , Akanksha Bindal , Hadas Kotek , Christopher Klein , Jason Williams

Multi-modal reasoning in visual question answering (VQA) has witnessed rapid progress recently. However, most reasoning models heavily rely on shortcuts learned from training data, which prevents their usage in challenging real-world…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Qi Zheng , Chaoyue Wang , Daqing Liu , Dadong Wang , Dacheng Tao

Contemporary large-scale visual language models (VLMs) exhibit strong representation capacities, making them ubiquitous for enhancing image and text understanding tasks. They are often trained in a contrastive manner on a large and diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Ugur Sahin , Hang Li , Qadeer Khan , Daniel Cremers , Volker Tresp

Visual Question Answering (VQA) is a challenging multimodal task to answer questions about an image. Many works concentrate on how to reduce language bias which makes models answer questions ignoring visual content and language context.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Chao Yang , Su Feng , Dongsheng Li , Huawei Shen , Guoqing Wang , Bin Jiang

Visual Question Answering (VQA) presents a unique challenge as it requires the ability to understand and encode the multi-modal inputs - in terms of image processing and natural language processing. The algorithm further needs to learn how…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Supriya Pandhre , Shagun Sodhani

The ability to ask questions is a powerful tool to gather information in order to learn about the world and resolve ambiguities. In this paper, we explore a novel problem of generating discriminative questions to help disambiguate visual…

Computer Vision and Pattern Recognition · Computer Science 2017-08-10 Yining Li , Chen Huang , Xiaoou Tang , Chen-Change Loy

Medical Visual Question Answering (MedVQA) aims to answer medical questions according to medical images. However, the complexity of medical data leads to confounders that are difficult to observe, so bias between images and questions is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Zibo Xu , Qiang Li , Weizhi Nie , Weijie Wang , Anan Liu

Text-based VQA aims at answering questions by reading the text present in the images. It requires a large amount of scene-text relationship understanding compared to the VQA task. Recent studies have shown that the question-answer pairs in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Shamanthak Hegde , Soumya Jahagirdar , Shankar Gangisetty

Visual question answering is a recently proposed artificial intelligence task that requires a deep understanding of both images and texts. In deep learning, images are typically modeled through convolutional neural networks, and texts are…

Machine Learning · Computer Science 2018-09-05 Zhengyang Wang , Shuiwang Ji

Visual Question Answering (VQA) has emerged as a highly engaging field in recent years, with increasing research focused on enhancing VQA accuracy through advanced models such as Transformers. Despite this growing interest, limited work has…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Zhilin Zhang , Fangyu Wu

In recent years, visual question answering (VQA) has become topical. The premise of VQA's significance as a benchmark in AI, is that both the image and textual question need to be well understood and mutually grounded in order to infer the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Feng Liu , Tao Xiang , Timothy M. Hospedales , Wankou Yang , Changyin Sun

Visual question answering (VQA) is a task that combines both the techniques of computer vision and natural language processing. It requires models to answer a text-based question according to the information contained in a visual. In recent…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Yeyun Zou , Qiyu Xie

Generating natural questions from an image is a semantic task that requires using visual and language modality to learn multimodal representations. Images can have multiple visual and language contexts that are relevant for generating…

Computation and Language · Computer Science 2019-10-18 Badri N. Patro , Sandeep Kumar , Vinod K. Kurmi , Vinay P. Namboodiri

Text-VQA aims at answering questions that require understanding the textual cues in an image. Despite the great progress of existing Text-VQA methods, their performance suffers from insufficient human-labeled question-answer (QA) pairs.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Jun Wang , Mingfei Gao , Yuqian Hu , Ramprasaath R. Selvaraju , Chetan Ramaiah , Ran Xu , Joseph F. JaJa , Larry S. Davis

Visual question answering (VQA) is a Multidisciplinary research problem that pursued through practices of natural language processing and computer vision. Visual question answering automatically answers natural language questions according…

Computer Vision and Pattern Recognition · Computer Science 2024-09-01 Param Ahir , Hiteishi Diwanji

The intersection of medical Visual Question Answering (Med-VQA) is a challenging research topic with advantages including patient engagement and clinical expert involvement for second opinions. However, existing Med-VQA methods based on…

Machine Learning · Computer Science 2024-06-24 Lin Fan , Xun Gong , Cenyang Zheng , Yafei Ou

This work introduces a novel task, location-aware visual question generation (LocaVQG), which aims to generate engaging questions from data relevant to a particular geographical location. Specifically, we represent such location-aware…