English
Related papers

Related papers: K-VQG: Knowledge-aware Visual Question Generation …

200 papers

There has been an explosion of work in the vision & language community during the past few years from image captioning to video transcription, and answering questions about images. These tasks have focused on literal descriptions of the…

Computation and Language · Computer Science 2016-06-10 Nasrin Mostafazadeh , Ishan Misra , Jacob Devlin , Margaret Mitchell , Xiaodong He , Lucy Vanderwende

With the rapid development of remote sensing image archives, asking questions about images has become an effective way of gathering specific information or performing image retrieval. However, automatically generated image-based questions…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Siran Li , Li Mi , Javiera Castillo-Navarro , Devis Tuia

Generating engaging content has drawn much recent attention in the NLP community. Asking questions is a natural way to respond to photos and promote awareness. However, most answers to questions in traditional question-answering (QA)…

Computation and Language · Computer Science 2022-11-21 Min-Hsuan Yeh , Vicent Chen , Ting-Hao 'Kenneth' Haung , Lun-Wei Ku

In traditional Visual Question Generation (VQG), most images have multiple concepts (e.g. objects and categories) for which a question could be generated, but models are trained to mimic an arbitrary choice of concept as given in their…

Machine Learning · Computer Science 2022-07-27 Nihir Vedd , Zixu Wang , Marek Rei , Yishu Miao , Lucia Specia

The visual question generation (VQG) task aims to generate human-like questions from an image and potentially other side information (e.g. answer type). Previous works on VQG fall in two aspects: i) They suffer from one image to many…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Kai Shen , Lingfei Wu , Siliang Tang , Fangli Xu , Bo Long , Yueting Zhuang , Jian Pei

The task of Visual Question Generation (VQG) is to generate human-like questions relevant to the given image. As VQG is an emerging research field, existing works tend to focus only on resource-rich language such as English due to the…

Computation and Language · Computer Science 2023-10-13 Mahmud Hasan , Labiba Islam , Jannatul Ferdous Ruma , Tasmiah Tahsin Mayeesha , Rashedur M. Rahman

With the rapid development of remote sensing image archives, asking questions about images has become an effective way of gathering specific information or performing semantic image retrieval. However, current automatically generated…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Siran Li , Li Mi , Javiera Castillo-Navarro , Devis Tuia

Generating natural language questions from visual scenes, known as Visual Question Generation (VQG), has been explored in the recent past where large amounts of meticulously labeled data provide the training corpus. However, in practice, it…

Computer Vision and Pattern Recognition · Computer Science 2023-01-09 Anurag Roy , David Johnson Ekka , Saptarshi Ghosh , Abir Das

Visual Question Answering (VQA) is a challenging task that has received increasing attention from both the computer vision and the natural language processing communities. Given an image and a question in natural language, it requires…

Computer Vision and Pattern Recognition · Computer Science 2016-07-21 Qi Wu , Damien Teney , Peng Wang , Chunhua Shen , Anthony Dick , Anton van den Hengel

Visual Question Generation (VQG) is the task of generating natural questions based on an image. Popular methods in the past have explored image-to-sequence architectures trained with maximum likelihood which have demonstrated meaningful…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Shagun Uppal , Anish Madan , Sarthak Bhagat , Yi Yu , Rajiv Ratn Shah

Despite their importance in training artificial intelligence systems, large datasets remain challenging to acquire. For example, the ImageNet dataset required fourteen million labels of basic human knowledge, such as whether an image…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Jihyeon Lee , Sho Arora

Asking questions about visual environments is a crucial way for intelligent agents to understand rich multi-faceted scenes, raising the importance of Visual Question Generation (VQG) systems. Apart from being grounded to the image, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Li Mi , Syrielle Montariol , Javiera Castillo-Navarro , Xianjie Dai , Antoine Bosselut , Devis Tuia

Traditional image recognition methods only consider objects belonging to already learned classes. However, since training a recognition model with every object class in the world is unfeasible, a way of getting information on unknown…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Kohei Uehara , Antonio Tejero-De-Pablos , Yoshitaka Ushiku , Tatsuya Harada

The Visual Question Answering (VQA) task aspires to provide a meaningful testbed for the development of AI models that can jointly reason over visual and natural language inputs. Despite a proliferation of VQA datasets, this goal is…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Dustin Schwenk , Apoorv Khandelwal , Christopher Clark , Kenneth Marino , Roozbeh Mottaghi

Previous solutions to knowledge-based visual question answering~(K-VQA) retrieve knowledge from external knowledge bases and use supervised learning to train the K-VQA model. Recently pre-trained LLMs have been used as both a knowledge…

Computation and Language · Computer Science 2024-02-07 Rui Cao , Jing Jiang

Visual question answering (VQA) is a Multidisciplinary research problem that pursued through practices of natural language processing and computer vision. Visual question answering automatically answers natural language questions according…

Computer Vision and Pattern Recognition · Computer Science 2024-09-01 Param Ahir , Hiteishi Diwanji

The Visual Question Answering (VQA) task combines challenges for processing data with both Visual and Linguistic processing, to answer basic `common sense' questions about given images. Given an image and a question in natural language, the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Yash Srivastava , Vaishnav Murali , Shiv Ram Dubey , Snehasis Mukherjee

Visual question answering (VQA) is a task that combines both the techniques of computer vision and natural language processing. It requires models to answer a text-based question according to the information contained in a visual. In recent…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Yeyun Zou , Qiyu Xie

Question generation (QG) is to generate natural and grammatical questions that can be answered by a specific answer for a given context. Previous sequence-to-sequence models suffer from a problem that asking high-quality questions requires…

Computation and Language · Computer Science 2021-06-22 Xin Jia , Hao Wang , Dawei Yin , Yunfang Wu

Visual Question Answering (VQA) in its ideal form lets us study reasoning in the joint space of vision and language and serves as a proxy for the AI task of scene understanding. However, most VQA benchmarks to date are focused on questions…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Kenneth Marino , Mohammad Rastegari , Ali Farhadi , Roozbeh Mottaghi
‹ Prev 1 2 3 10 Next ›