中文
相关论文

相关论文: Zero-Shot Visual Question Answering

200 篇论文

Batteries are essential for various applications, including electric vehicles and renewable energy storage, making safety and efficiency critical concerns. Anomaly detection in battery thermal images helps identify failures early, but…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Marcella Astrid , Abdelrahman Shabayek , Djamila Aouada

This paper presents a new baseline for visual question answering task. Given an image and a question in natural language, our model produces accurate answers according to the content of the image. Our model, while being architecturally…

计算机视觉与模式识别 · 计算机科学 2017-04-13 Vahid Kazemi , Ali Elqursh

Visual Question Answering (VQA) is a challenge task that combines natural language processing and computer vision techniques and gradually becomes a benchmark test task in multimodal large language models (MLLMs). The goal of our survey is…

计算与语言 · 计算机科学 2024-11-27 Jiayi Kuang , Jingyou Xie , Haohao Luo , Ronghao Li , Zhe Xu , Xianfeng Cheng , Yinghui Li , Xika Lin , Ying Shen

Despite significant progress in Visual Question Answering over the years, robustness of today's VQA models leave much to be desired. We introduce a new evaluation protocol and associated dataset (VQA-Rephrasings) and show that…

计算机视觉与模式识别 · 计算机科学 2019-02-18 Meet Shah , Xinlei Chen , Marcus Rohrbach , Devi Parikh

Current methods of Visual Question Answering perform well on the answers with an amount of training data but have limited accuracy on the novel ones with few examples. However, humans can quickly adapt to these new categories with just a…

计算机视觉与模式识别 · 计算机科学 2021-02-23 Dalu Guo , Dacheng Tao

Visual question answering requires a deep understanding of both images and natural language. However, most methods mainly focus on visual concept; such as the relationships between various objects. The limited use of object categories…

计算机视觉与模式识别 · 计算机科学 2021-01-25 Jung-Jun Kim , Dong-Gyu Lee , Jialin Wu , Hong-Gyu Jung , Seong-Whan Lee

Fact-based Visual Question Answering (FVQA), a challenging variant of VQA, requires a QA-system to include facts from a diverse knowledge graph (KG) in its reasoning process to produce an answer. Large KGs, especially common-sense KGs, are…

计算与语言 · 计算机科学 2021-06-22 Kiran Ramnath , Mark Hasegawa-Johnson

Most recent state-of-the-art Visual Question Answering (VQA) systems are opaque black boxes that are only trained to fit the answer distribution given the question and visual content. As a result, these systems frequently take shortcuts,…

计算机视觉与模式识别 · 计算机科学 2020-06-30 Jialin Wu , Liyan Chen , Raymond J. Mooney

Text-based VQA aims at answering questions by reading the text present in the images. It requires a large amount of scene-text relationship understanding compared to the VQA task. Recent studies have shown that the question-answer pairs in…

计算机视觉与模式识别 · 计算机科学 2023-08-02 Shamanthak Hegde , Soumya Jahagirdar , Shankar Gangisetty

Knowledge-based visual question answering (KVQA) task aims to answer questions that require additional external knowledge as well as an understanding of images and questions. Recent studies on KVQA inject an external knowledge in a…

计算机视觉与模式识别 · 计算机科学 2022-07-28 Jinyeong Chae , Jihie Kim

Visual Question and Answering (VQA) problems are attracting increasing interest from multiple research disciplines. Solving VQA problems requires techniques from both computer vision for understanding the visual contents of a presented…

计算机视觉与模式识别 · 计算机科学 2016-04-07 Ilija Ilievski , Shuicheng Yan , Jiashi Feng

Teaching Visual Question Answering (VQA) models to refrain from answering unanswerable questions is necessary for building a trustworthy AI system. Existing studies, though have explored various aspects of VQA but somewhat ignored this…

计算机视觉与模式识别 · 计算机科学 2024-08-22 Yangyang Guo , Fangkai Jiao , Zhiqi Shen , Liqiang Nie , Mohan Kankanhalli

Current work on Visual Question Answering (VQA) explore deterministic approaches conditioned on various types of image and question features. We posit that, in addition to image and question pairs, other modalities are useful for teaching…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Zixu Wang , Yishu Miao , Lucia Specia

Deep neural networks have shown striking progress and obtained state-of-the-art results in many AI research fields in the recent years. However, it is often unsatisfying to not know why they predict what they do. In this paper, we address…

计算机视觉与模式识别 · 计算机科学 2016-09-12 Yash Goyal , Akrit Mohapatra , Devi Parikh , Dhruv Batra

Visual Question Answering (VQA) has received a lot of attention over the past couple of years. A number of deep learning models have been proposed for this task. However, it has been shown that these models are heavily driven by superficial…

计算机视觉与模式识别 · 计算机科学 2017-04-27 Aishwarya Agrawal , Aniruddha Kembhavi , Dhruv Batra , Devi Parikh

Knowledge-based Visual Question Answering (KVQA) requires external knowledge beyond the visible content to answer questions about an image. This ability is challenging but indispensable to achieve general VQA. One limitation of existing…

人工智能 · 计算机科学 2020-11-04 Jing Yu , Zihao Zhu , Yujing Wang , Weifeng Zhang , Yue Hu , Jianlong Tan

Bridging the semantic gap between image and question is an important step to improve the accuracy of the Visual Question Answering (VQA) task. However, most of the existing VQA methods focus on attention mechanisms or visual relations for…

计算机视觉与模式识别 · 计算机科学 2022-04-20 Binh X. Nguyen , Tuong Do , Huy Tran , Erman Tjiputra , Quang D. Tran , Anh Nguyen

Visual question answering (VQA) is a task of answering a visual question that is a pair of question and image. Some visual questions are ambiguous and some are clear, and it may be appropriate to change the ambiguity of questions from…

计算机视觉与模式识别 · 计算机科学 2020-12-02 Kento Terao , Toru Tamaki , Bisser Raytchev , Kazufumi Kaneda , Shun'ichi Satoh

Visual Question Answering (VQA) has emerged as a pivotal task in the intersection of computer vision and natural language processing, requiring models to understand and reason about visual content in response to natural language questions.…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Aiswarya Baby , Tintu Thankom Koshy

Visual Question Answering (VQA) entails answering questions about images. We introduce the first VQA dataset in which all contents originate from an authentic use case. Sourced from online question answering community forums, we call it…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Chongyan Chen , Mengchen Liu , Noel Codella , Yunsheng Li , Lu Yuan , Danna Gurari