中文
相关论文

相关论文: VQA Therapy: Exploring Answer Differences by Visua…

200 篇论文

The current success of modern visual reasoning systems is arguably attributed to cross-modality attention mechanisms. However, in deliberative reasoning such as in VQA, attention is unconstrained at each step, and thus may serve as a…

计算机视觉与模式识别 · 计算机科学 2022-05-26 Thao Minh Le , Vuong Le , Sunil Gupta , Svetha Venkatesh , Truyen Tran

Most existing works in visual question answering (VQA) are dedicated to improving the accuracy of predicted answers, while disregarding the explanations. We argue that the explanation for an answer is of the same or even more importance…

计算机视觉与模式识别 · 计算机科学 2018-08-28 Qing Li , Qingyi Tao , Shafiq Joty , Jianfei Cai , Jiebo Luo

Visual question answering (VQA) models respond to open-ended natural language questions about images. While VQA is an increasingly popular area of research, it is unclear to what extent current VQA architectures learn key semantic…

计算机视觉与模式识别 · 计算机科学 2018-07-25 Gabriel Grand , Aron Szanto , Yoon Kim , Alexander Rush

Visual question answering (VQA) and image captioning require a shared body of general knowledge connecting language and vision. We present a novel approach to improve VQA performance that exploits this connection by jointly generating…

计算机视觉与模式识别 · 计算机科学 2020-01-07 Jialin Wu , Zeyuan Hu , Raymond J. Mooney

When answering questions about an image, it not only needs knowing what -- understanding the fine-grained contents (e.g., objects, relationships) in the image, but also telling why -- reasoning over grounding visual cues to derive the…

计算机视觉与模式识别 · 计算机科学 2020-12-22 Jianwei Yang , Jiayuan Mao , Jiajun Wu , Devi Parikh , David D. Cox , Joshua B. Tenenbaum , Chuang Gan

Visual question answering requires a system to provide an accurate natural language answer given an image and a natural language question. However, it is widely recognized that previous generic VQA methods often exhibit a tendency to…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Jie Ma , Pinghui Wang , Dechen Kong , Zewei Wang , Jun Liu , Hongbin Pei , Junzhou Zhao

Visual reasoning tasks such as visual question answering (VQA) require an interplay of visual perception with reasoning about the question semantics grounded in perception. However, recent advances in this area are still primarily driven by…

机器学习 · 计算机科学 2020-08-27 Saeed Amizadeh , Hamid Palangi , Oleksandr Polozov , Yichen Huang , Kazuhito Koishida

Visual Question Answering (VQA) has attracted a lot of attention in both Computer Vision and Natural Language Processing communities, not least because it offers insight into the relationships between two important sources of information.…

计算机视觉与模式识别 · 计算机科学 2017-08-09 Peng Wang , Qi Wu , Chunhua Shen , Anton van den Hengel , Anthony Dick

This paper presents a state-of-the-art model for visual question answering (VQA), which won the first place in the 2017 VQA Challenge. VQA is a task of significant importance for research in artificial intelligence, given its multimodal…

计算机视觉与模式识别 · 计算机科学 2017-08-10 Damien Teney , Peter Anderson , Xiaodong He , Anton van den Hengel

One of the most intriguing features of the Visual Question Answering (VQA) challenge is the unpredictability of the questions. Extracting the information required to answer them demands a variety of image operations from detection and…

计算机视觉与模式识别 · 计算机科学 2016-12-19 Peng Wang , Qi Wu , Chunhua Shen , Anton van den Hengel

Visual Question Answering (VQA) has attracted attention from both computer vision and natural language processing communities. Most existing approaches adopt the pipeline of representing an image via pre-trained CNNs, and then using the…

计算机视觉与模式识别 · 计算机科学 2018-01-30 Qing Li , Jianlong Fu , Dongfei Yu , Tao Mei , Jiebo Luo

Visual Question Answering (VQA) is a challenging task that requires cross-modal understanding and reasoning of visual image and natural language question. To inspect the association of VQA models to human cognition, we designed a survey to…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Liben Chen , Long Chen , Tian Ellison-Chen , Zhuoyuan Xu

Visual Question Answering (VQA) in its ideal form lets us study reasoning in the joint space of vision and language and serves as a proxy for the AI task of scene understanding. However, most VQA benchmarks to date are focused on questions…

计算机视觉与模式识别 · 计算机科学 2019-09-05 Kenneth Marino , Mohammad Rastegari , Ali Farhadi , Roozbeh Mottaghi

Visual question answering is concerned with answering free-form questions about an image. Since it requires a deep linguistic understanding of the question and the ability to associate it with various objects that are present in the image,…

机器学习 · 计算机科学 2020-07-03 Marcel Hildebrandt , Hang Li , Rajat Koner , Volker Tresp , Stephan Günnemann

Medical visual question answering (VQA) aims to answer clinically relevant questions regarding input medical images. This technique has the potential to improve the efficiency of medical professionals while relieving the burden on the…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Xinyue Hu , Lin Gu , Kazuma Kobayashi , Qiyuan An , Qingyu Chen , Zhiyong Lu , Chang Su , Tatsuya Harada , Yingying Zhu

Answering visual questions need acquire daily common knowledge and model the semantic connection among different parts in images, which is too difficult for VQA systems to learn from images with the only supervision from answers. Meanwhile,…

计算与语言 · 计算机科学 2018-05-23 Jialin Wu , Zeyuan Hu , Raymond J. Mooney

Modern Visual Question Answering (VQA) models have been shown to rely heavily on superficial correlations between question and answer words learned during training such as overwhelmingly reporting the type of room as kitchen or the sport…

计算机视觉与模式识别 · 计算机科学 2018-11-12 Sainandan Ramakrishnan , Aishwarya Agrawal , Stefan Lee

We tackle the challenge of Visual Question Answering in multi-image setting for the ISVQA dataset. Traditional VQA tasks have focused on a single-image setting where the target answer is generated from a single image. Image set VQA,…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Abhinav Khattar , Aviral Joshi , Har Simrat Singh , Pulkit Goel , Rohit Prakash Barnwal

This paper introduces speech-based visual question answering (VQA), the task of generating an answer given an image and a spoken question. Two methods are studied: an end-to-end, deep neural network that directly uses audio waveforms as…

计算与语言 · 计算机科学 2017-09-19 Ted Zhang , Dengxin Dai , Tinne Tuytelaars , Marie-Francine Moens , Luc Van Gool

In recent years, people have increasingly used AI to help them with their problems by asking questions on different topics. One of these topics can be software-related and programming questions. In this work, we focus on the questions which…

计算机视觉与模式识别 · 计算机科学 2024-05-20 Motahhare Mirzaei , Mohammad Javad Pirhadi , Sauleh Eetemadi