English
Related papers

Related papers: Semantic Equivalent Adversarial Data Augmentation …

200 papers

Methodologies for training visual question answering (VQA) models assume the availability of datasets with human-annotated \textit{Image-Question-Answer} (I-Q-A) triplets. This has led to heavy reliance on datasets and a lack of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Pratyay Banerjee , Tejas Gokhale , Yezhou Yang , Chitta Baral

Recent research advances in Computer Vision and Natural Language Processing have introduced novel tasks that are paving the way for solving AI-complete problems. One of those tasks is called Visual Question Answering (VQA). A VQA system…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Camila Kolling , Jônatas Wehrmann , Rodrigo C. Barros

The quality and size of training set have great impact on the results of deep learning-based face related tasks. However, collecting and labeling adequate samples with high quality and balanced distributions still remains a laborious and…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Xiang Wang , Kai Wang , Shiguo Lian

Deep Imitation Learning requires a large number of expert demonstrations, which are not always easy to obtain, especially for complex tasks. A way to overcome this shortage of labels is through data augmentation. However, this cannot be…

Machine Learning · Computer Science 2021-03-29 Dafni Antotsiou , Carlo Ciliberto , Tae-Kyun Kim

Deep neural networks have been playing an essential role in many computer vision tasks including Visual Question Answering (VQA). Until recently, the study of their accuracy was the main focus of research but now there is a trend toward…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Jia-Hong Huang , Cuong Duc Dao , Modar Alfadly , Bernard Ghanem

Visual question answering (VQA) is the task of answering questions about an image. The task assumes an understanding of both the image and the question to provide a natural language answer. VQA has gained popularity in recent years due to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Deepanway Ghosal , Navonil Majumder , Roy Ka-Wei Lee , Rada Mihalcea , Soujanya Poria

Thanks to recent advances in deep neural networks (DNNs), face recognition systems have become highly accurate in classifying a large number of face images. However, recent studies have found that DNNs could be vulnerable to adversarial…

Machine Learning · Computer Science 2020-01-29 Kazuya Kakizaki , Kosuke Yoshida

Visual question answering (VQA) demands simultaneous comprehension of both the image visual content and natural language questions. In some cases, the reasoning needs the help of common sense or general knowledge which usually appear in the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Hui Li , Peng Wang , Chunhua Shen , Anton van den Hengel

Visual Question Answering (VQA) models have achieved significant success in recent times. Despite the success of VQA models, they are mostly black-box models providing no reasoning about the predicted answer, thus raising questions for…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Nihar Bendre , Kevin Desai , Peyman Najafirad

Adversarial training has been shown effective at endowing the learned representations with stronger generalization ability. However, it typically requires expensive computation to determine the direction of the injected perturbations. In…

Computation and Language · Computer Science 2020-10-26 Dinghan Shen , Mingzhi Zheng , Yelong Shen , Yanru Qu , Weizhu Chen

Reading comprehension models often overfit to nuances of training datasets and fail at adversarial evaluation. Training with adversarially augmented dataset improves robustness against those adversarial attacks but hurts generalization of…

Computation and Language · Computer Science 2020-11-18 Adyasha Maharana , Mohit Bansal

A key solution to visual question answering (VQA) exists in how to fuse visual and language features extracted from an input image and question. We show that an attention mechanism that enables dense, bi-directional interactions between the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Duy-Kien Nguyen , Takayuki Okatani

Visual question answering (VQA) is known as an AI-complete task as it requires understanding, reasoning, and inferring about the vision and the language content. Over the past few years, numerous neural architectures have been suggested for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Övgü Özdemir , Erdem Akagündüz

In recent years, Classical Convolutional Neural Networks (CNNs) have been applied for image recognition successfully. Quantum Convolutional Neural Networks (QCNNs) are proposed as a novel generalization to CNNs by using quantum mechanisms.…

Quantum Physics · Physics 2023-12-04 Leting Zhouli , Peiyong Wang , Udaya Parampalli

Understanding images and text together is an important aspect of cognition and building advanced Artificial Intelligence (AI) systems. As a community, we have achieved good benchmarks over language and vision domains separately, however…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Shailaja Keyur Sampat , Yezhou Yang , Chitta Baral

Visual question answering (VQA) is a challenging multi-modal task that requires not only the semantic understanding of both images and questions, but also the sound perception of a step-by-step reasoning process that would lead to the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Siwen Luo , Soyeon Caren Han , Kaiyuan Sun , Josiah Poon

Visual Question Answering (VQA) is an emerging area of interest for researches, being a recent problem in natural language processing and image prediction. In this area, an algorithm needs to answer questions about certain images. As of the…

Recent Visual Question Answering (VQA) models have shown impressive performance on the VQA benchmark but remain sensitive to small linguistic variations in input questions. Existing approaches address this by augmenting the dataset with…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Yash Kant , Abhinav Moudgil , Dhruv Batra , Devi Parikh , Harsh Agrawal

While Visual Question Answering (VQA) models continue to push the state-of-the-art forward, they largely remain black-boxes - failing to provide insight into how or why an answer is generated. In this ongoing work, we propose addressing…

Computer Vision and Pattern Recognition · Computer Science 2019-11-18 Jingjing Pan , Yash Goyal , Stefan Lee

Visual reasoning tasks such as visual question answering (VQA) require an interplay of visual perception with reasoning about the question semantics grounded in perception. However, recent advances in this area are still primarily driven by…

Machine Learning · Computer Science 2020-08-27 Saeed Amizadeh , Hamid Palangi , Oleksandr Polozov , Yichen Huang , Kazuhito Koishida