English
Related papers

Related papers: Generating Natural Questions About an Image

200 papers

Generating engaging content has drawn much recent attention in the NLP community. Asking questions is a natural way to respond to photos and promote awareness. However, most answers to questions in traditional question-answering (QA)…

Computation and Language · Computer Science 2022-11-21 Min-Hsuan Yeh , Vicent Chen , Ting-Hao 'Kenneth' Haung , Lun-Wei Ku

Visual Question Generation (VQG) is a task to generate questions from images. When humans ask questions about an image, their goal is often to acquire some new knowledge. However, existing studies on VQG have mainly addressed question…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Kohei Uehara , Tatsuya Harada

Generating natural language questions from visual scenes, known as Visual Question Generation (VQG), has been explored in the recent past where large amounts of meticulously labeled data provide the training corpus. However, in practice, it…

Computer Vision and Pattern Recognition · Computer Science 2023-01-09 Anurag Roy , David Johnson Ekka , Saptarshi Ghosh , Abir Das

In traditional Visual Question Generation (VQG), most images have multiple concepts (e.g. objects and categories) for which a question could be generated, but models are trained to mimic an arbitrary choice of concept as given in their…

Machine Learning · Computer Science 2022-07-27 Nihir Vedd , Zixu Wang , Marek Rei , Yishu Miao , Lucia Specia

Visual Question Generation (VQG) is the task of generating natural questions based on an image. Popular methods in the past have explored image-to-sequence architectures trained with maximum likelihood which have demonstrated meaningful…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Shagun Uppal , Anish Madan , Sarthak Bhagat , Yi Yu , Rajiv Ratn Shah

Visual Question Answering (VQA) is a challenging task that has received increasing attention from both the computer vision and the natural language processing communities. Given an image and a question in natural language, it requires…

Computer Vision and Pattern Recognition · Computer Science 2016-07-21 Qi Wu , Damien Teney , Peng Wang , Chunhua Shen , Anthony Dick , Anton van den Hengel

Visual question answering (VQA) and image captioning require a shared body of general knowledge connecting language and vision. We present a novel approach to improve VQA performance that exploits this connection by jointly generating…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Jialin Wu , Zeyuan Hu , Raymond J. Mooney

The task of Visual Question Generation (VQG) is to generate human-like questions relevant to the given image. As VQG is an emerging research field, existing works tend to focus only on resource-rich language such as English due to the…

Computation and Language · Computer Science 2023-10-13 Mahmud Hasan , Labiba Islam , Jannatul Ferdous Ruma , Tasmiah Tahsin Mayeesha , Rashedur M. Rahman

Asking questions about visual environments is a crucial way for intelligent agents to understand rich multi-faceted scenes, raising the importance of Visual Question Generation (VQG) systems. Apart from being grounded to the image, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Li Mi , Syrielle Montariol , Javiera Castillo-Navarro , Xianjie Dai , Antoine Bosselut , Devis Tuia

The visual question generation (VQG) task aims to generate human-like questions from an image and potentially other side information (e.g. answer type). Previous works on VQG fall in two aspects: i) They suffer from one image to many…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Kai Shen , Lingfei Wu , Siliang Tang , Fangli Xu , Bo Long , Yueting Zhuang , Jian Pei

The emergence of ChatGPT has once again sparked research in generative artificial intelligence (GAI). While people have been amazed by the generated results, they have also noticed the reasoning potential reflected in the generated textual…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Xiaochuan Li , Baoyu Fan , Runze Zhang , Liang Jin , Di Wang , Zhenhua Guo , Yaqian Zhao , Rengang Li

Generating natural, diverse, and meaningful questions from images is an essential task for multimodal assistants as it confirms whether they have understood the object and scene in the images properly. The research in visual question…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Alkesh Patel , Akanksha Bindal , Hadas Kotek , Christopher Klein , Jason Williams

Visual Question Answering (VQA) is a recent problem in computer vision and natural language processing that has garnered a large amount of interest from the deep learning, computer vision, and natural language processing communities. In…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Kushal Kafle , Christopher Kanan

We propose the task of free-form and open-ended Visual Question Answering (VQA). Given an image and a natural language question about the image, the task is to provide an accurate natural language answer. Mirroring real-world scenarios,…

Computation and Language · Computer Science 2016-10-28 Aishwarya Agrawal , Jiasen Lu , Stanislaw Antol , Margaret Mitchell , C. Lawrence Zitnick , Dhruv Batra , Devi Parikh

Answering visual questions need acquire daily common knowledge and model the semantic connection among different parts in images, which is too difficult for VQA systems to learn from images with the only supervision from answers. Meanwhile,…

Computation and Language · Computer Science 2018-05-23 Jialin Wu , Zeyuan Hu , Raymond J. Mooney

In recent years, a substantial body of work in visually grounded natural language processing has focused on real-life multimodal scenarios such as describing content depicted in images or videos. However, comparatively less attention has…

Computation and Language · Computer Science 2025-08-21 Aditya K Surikuchi , Raquel Fernández , Sandro Pezzelle

The Visual Question Answering (VQA) task combines challenges for processing data with both Visual and Linguistic processing, to answer basic `common sense' questions about given images. Given an image and a question in natural language, the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Yash Srivastava , Vaishnav Murali , Shiv Ram Dubey , Snehasis Mukherjee

Visual Question Answering (VQA) is an emerging area of interest for researches, being a recent problem in natural language processing and image prediction. In this area, an algorithm needs to answer questions about certain images. As of the…

Visual question answering (VQA) refers to the problem where, given an image and a natural language question about the image, a correct natural language answer has to be generated. A VQA model has to demonstrate both the visual understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Raihan Kabir , Naznin Haque , Md Saiful Islam , Marium-E-Jannat

In this paper, we propose the first model to be able to generate visually grounded questions with diverse types for a single image. Visual question generation is an emerging topic which aims to ask questions in natural language based on…

Computer Vision and Pattern Recognition · Computer Science 2017-05-30 Shijie Zhang , Lizhen Qu , Shaodi You , Zhenglu Yang , Jiawan Zhang
‹ Prev 1 2 3 10 Next ›