中文
相关论文

相关论文: All You May Need for VQA are Image Captions

200 篇论文

Multi-modal tasks involving vision and language in deep learning continue to rise in popularity and are leading to the development of newer models that can generalize beyond the extent of their training data. The current models lack…

计算机视觉与模式识别 · 计算机科学 2023-07-21 Ethan Shen , Scotty Singh , Bhavesh Kumar

Visual question answering (VQA) demands simultaneous comprehension of both the image visual content and natural language questions. In some cases, the reasoning needs the help of common sense or general knowledge which usually appear in the…

计算机视觉与模式识别 · 计算机科学 2018-11-30 Hui Li , Peng Wang , Chunhua Shen , Anton van den Hengel

Recent methods for visual question answering rely on large-scale annotated datasets. Manual annotation of questions and answers for videos, however, is tedious, expensive and prevents scalability. In this work, we propose to avoid manual…

计算机视觉与模式识别 · 计算机科学 2022-05-12 Antoine Yang , Antoine Miech , Josef Sivic , Ivan Laptev , Cordelia Schmid

Visual Question Answering (VQA) entails answering questions about images. We introduce the first VQA dataset in which all contents originate from an authentic use case. Sourced from online question answering community forums, we call it…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Chongyan Chen , Mengchen Liu , Noel Codella , Yunsheng Li , Lu Yuan , Danna Gurari

Current work on Visual Question Answering (VQA) explore deterministic approaches conditioned on various types of image and question features. We posit that, in addition to image and question pairs, other modalities are useful for teaching…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Zixu Wang , Yishu Miao , Lucia Specia

Taking an image and question as the input of our method, it can output the text-based answer of the query question about the given image, so called Visual Question Answering (VQA). There are two main modules in our algorithm. Given a…

计算机视觉与模式识别 · 计算机科学 2017-08-30 Jia-Hong Huang , Modar Alfadly , Bernard Ghanem

Visual Question Answering (VQA) is a recent problem in computer vision and natural language processing that has garnered a large amount of interest from the deep learning, computer vision, and natural language processing communities. In…

计算机视觉与模式识别 · 计算机科学 2017-06-16 Kushal Kafle , Christopher Kanan

In visual question answering (VQA), an algorithm must answer text-based questions about images. While multiple datasets for VQA have been created since late 2014, they all have flaws in both their content and the way algorithms are…

计算机视觉与模式识别 · 计算机科学 2017-09-15 Kushal Kafle , Christopher Kanan

Visual question answering (VQA) is challenging not only because the model has to handle multi-modal information, but also because it is just so hard to collect sufficient training examples -- there are too many questions one can ask about…

计算机视觉与模式识别 · 计算机科学 2022-11-10 Jihyung Kil , Cheng Zhang , Dong Xuan , Wei-Lun Chao

Visual question answering (VQA) is a task where an image is given, and a series of questions are asked about the image. To build an efficient VQA algorithm, a large amount of QA data is required which is very expensive. Generating synthetic…

计算与语言 · 计算机科学 2024-08-23 Taehee Kim , Yeongjae Cho , Heejun Shin , Yohan Jo , Dongmyung Shin

Visual question answering (VQA) has traditionally been treated as a single-step task where each question receives the same amount of effort, unlike natural human question-answering strategies. We explore a question decomposition strategy…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Zaid Khan , Vijay Kumar BG , Samuel Schulter , Manmohan Chandraker , Yun Fu

Zero-shot Visual Question Answering (VQA) is a prominent vision-language task that examines both the visual and textual understanding capability of systems in the absence of training data. Recently, by converting the images into captions,…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Yunshi Lan , Xiang Li , Xin Liu , Yang Li , Wei Qin , Weining Qian

Recent research advances in Computer Vision and Natural Language Processing have introduced novel tasks that are paving the way for solving AI-complete problems. One of those tasks is called Visual Question Answering (VQA). A VQA system…

计算机视觉与模式识别 · 计算机科学 2020-07-30 Camila Kolling , Jônatas Wehrmann , Rodrigo C. Barros

In multi-modal reasoning tasks, such as visual question answering (VQA), there have been many modeling and training paradigms tested. Previous models propose different methods for the vision and language tasks, but which ones perform the…

机器学习 · 计算机科学 2021-03-23 Karan Samel , Zelin Zhao , Binghong Chen , Kuan Wang , Robin Luo , Le Song

Recent methods for visual question answering rely on large-scale annotated datasets. Manual annotation of questions and answers for videos, however, is tedious, expensive and prevents scalability. In this work, we propose to avoid manual…

计算机视觉与模式识别 · 计算机科学 2021-08-13 Antoine Yang , Antoine Miech , Josef Sivic , Ivan Laptev , Cordelia Schmid

Current methods of Visual Question Answering perform well on the answers with an amount of training data but have limited accuracy on the novel ones with few examples. However, humans can quickly adapt to these new categories with just a…

计算机视觉与模式识别 · 计算机科学 2021-02-23 Dalu Guo , Dacheng Tao

Visual Question Answering (VQA) models aim to answer natural language questions about given images. Due to its ability to ask questions that differ from those used when training the model, medical VQA has received substantial attention in…

计算机视觉与模式识别 · 计算机科学 2023-07-04 Sergio Tascon-Morales , Pablo Márquez-Neila , Raphael Sznitman

Video Question Answering (VQA) is a recent emerging challenging task in the field of Computer Vision. Several visual information retrieval techniques like Video Captioning/Description and Video-guided Machine Translation have preceded the…

计算机视觉与模式识别 · 计算机科学 2021-03-19 Devshree Patel , Ratnam Parikh , Yesha Shastri

Visual Question Answering (VQA) in its ideal form lets us study reasoning in the joint space of vision and language and serves as a proxy for the AI task of scene understanding. However, most VQA benchmarks to date are focused on questions…

计算机视觉与模式识别 · 计算机科学 2019-09-05 Kenneth Marino , Mohammad Rastegari , Ali Farhadi , Roozbeh Mottaghi

In the realm of multimodal tasks, Visual Question Answering (VQA) plays a crucial role by addressing natural language questions grounded in visual content. Knowledge-Based Visual Question Answering (KBVQA) advances this concept by adding…

计算与语言 · 计算机科学 2024-06-17 Manas Jhalani , Annervaz K M , Pushpak Bhattacharyya