中文
相关论文

相关论文: Weakly Supervised Visual Question Answer Generatio…

200 篇论文

The Visual Question Answering (VQA) task combines challenges for processing data with both Visual and Linguistic processing, to answer basic `common sense' questions about given images. Given an image and a question in natural language, the…

计算机视觉与模式识别 · 计算机科学 2020-12-24 Yash Srivastava , Vaishnav Murali , Shiv Ram Dubey , Snehasis Mukherjee

Despite recent advances in Visual QuestionAnswering (VQA), it remains a challenge todetermine how much success can be attributedto sound reasoning and comprehension ability.We seek to investigate this question by propos-ing a new task…

人工智能 · 计算机科学 2020-04-07 Hammad A. Ayyubi , Md. Mehrab Tanjim , Julian J. McAuley , Garrison W. Cottrell

We propose the task of free-form and open-ended Visual Question Answering (VQA). Given an image and a natural language question about the image, the task is to provide an accurate natural language answer. Mirroring real-world scenarios,…

计算与语言 · 计算机科学 2016-10-28 Aishwarya Agrawal , Jiasen Lu , Stanislaw Antol , Margaret Mitchell , C. Lawrence Zitnick , Dhruv Batra , Devi Parikh

Most existing approaches to Visual Question Answering (VQA) answer questions directly, however, people usually decompose a complex question into a sequence of simple sub questions and finally obtain the answer to the original question after…

计算与语言 · 计算机科学 2022-04-05 Ruonan Wang , Yuxi Qian , Fangxiang Feng , Xiaojie Wang , Huixing Jiang

Visual Question Answering (VQA) is an emerging area of interest for researches, being a recent problem in natural language processing and image prediction. In this area, an algorithm needs to answer questions about certain images. As of the…

We present a framework that formulates visual question answering as modular code generation. In contrast to prior work on modular approaches to VQA, our approach requires no additional training and relies on pre-trained language models…

Taking an image and question as the input of our method, it can output the text-based answer of the query question about the given image, so called Visual Question Answering (VQA). There are two main modules in our algorithm. Given a…

计算机视觉与模式识别 · 计算机科学 2017-08-30 Jia-Hong Huang , Modar Alfadly , Bernard Ghanem

Generating natural language questions from visual scenes, known as Visual Question Generation (VQG), has been explored in the recent past where large amounts of meticulously labeled data provide the training corpus. However, in practice, it…

计算机视觉与模式识别 · 计算机科学 2023-01-09 Anurag Roy , David Johnson Ekka , Saptarshi Ghosh , Abir Das

There has been an explosion of work in the vision & language community during the past few years from image captioning to video transcription, and answering questions about images. These tasks have focused on literal descriptions of the…

计算与语言 · 计算机科学 2016-06-10 Nasrin Mostafazadeh , Ishan Misra , Jacob Devlin , Margaret Mitchell , Xiaodong He , Lucy Vanderwende

Visual question answering (VQA) systems are emerging from a desire to empower users to ask any natural language question about visual content and receive a valid answer in response. However, close examination of the VQA problem reveals an…

人工智能 · 计算机科学 2016-08-30 Danna Gurari , Kristen Grauman

Visual Question Answering (VQA) task has showcased a new stage of interaction between language and vision, two of the most pivotal components of artificial intelligence. However, it has mostly focused on generating short and repetitive…

计算机视觉与模式识别 · 计算机科学 2016-09-22 Andrew Shin , Yoshitaka Ushiku , Tatsuya Harada

Visual question answering (VQA) is a task that combines both the techniques of computer vision and natural language processing. It requires models to answer a text-based question according to the information contained in a visual. In recent…

计算机视觉与模式识别 · 计算机科学 2021-05-04 Yeyun Zou , Qiyu Xie

The task of Visual Question Generation (VQG) is to generate human-like questions relevant to the given image. As VQG is an emerging research field, existing works tend to focus only on resource-rich language such as English due to the…

计算与语言 · 计算机科学 2023-10-13 Mahmud Hasan , Labiba Islam , Jannatul Ferdous Ruma , Tasmiah Tahsin Mayeesha , Rashedur M. Rahman

Visual Question Answering (VQA) is a recent problem in computer vision and natural language processing that has garnered a large amount of interest from the deep learning, computer vision, and natural language processing communities. In…

计算机视觉与模式识别 · 计算机科学 2017-06-16 Kushal Kafle , Christopher Kanan

Visual question answering (or VQA) is a new and exciting problem that combines natural language processing and computer vision techniques. We present a survey of the various datasets and models that have been used to tackle this task. The…

计算与语言 · 计算机科学 2017-05-12 Akshay Kumar Gupta

Visual Question Answering (VQA) is an extremely stimulating and challenging research area where Computer Vision (CV) and Natural Language Processig (NLP) have recently met. In image captioning and video summarization, the semantic…

计算机视觉与模式识别 · 计算机科学 2021-03-09 Silvio Barra , Carmen Bisogni , Maria De Marsico , Stefano Ricciardi

Generating natural, diverse, and meaningful questions from images is an essential task for multimodal assistants as it confirms whether they have understood the object and scene in the images properly. The research in visual question…

计算机视觉与模式识别 · 计算机科学 2020-12-08 Alkesh Patel , Akanksha Bindal , Hadas Kotek , Christopher Klein , Jason Williams

While Visual Question Answering (VQA) models continue to push the state-of-the-art forward, they largely remain black-boxes - failing to provide insight into how or why an answer is generated. In this ongoing work, we propose addressing…

计算机视觉与模式识别 · 计算机科学 2019-11-18 Jingjing Pan , Yash Goyal , Stefan Lee

Visual Question Answering (VQA) is a complex semantic task requiring both natural language processing and visual recognition. In this paper, we explore whether VQA is solvable when images are captured in a sub-Nyquist compressive paradigm.…

计算机视觉与模式识别 · 计算机科学 2018-06-12 Li-Chi Huang , Kuldeep Kulkarni , Anik Jha , Suhas Lohit , Suren Jayasuriya , Pavan Turaga

Visual Question Answering (VQA) is the task of taking as input an image and a free-form natural language question about the image, and producing an accurate answer. In this work we view VQA as a "feature extraction" module to extract image…

计算机视觉与模式识别 · 计算机科学 2016-09-02 Xiao Lin , Devi Parikh