中文
相关论文

相关论文: Logically Consistent Loss for Visual Question Answ…

200 篇论文

Visual Question Answering (VQA) deep-learning systems tend to capture superficial statistical correlations in the training data because of strong language priors and fail to generalize to test data with a significantly different…

计算机视觉与模式识别 · 计算机科学 2020-01-01 Jialin Wu , Raymond J. Mooney

Medical visual question answering (VQA) bridges the gap between visual information and clinical decision-making, enabling doctors to extract understanding from clinical images and videos. In particular, surgical VQA can enhance the…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Long Bai , Guankun Wang , Mobarakol Islam , Lalithkumar Seenivasan , An Wang , Hongliang Ren

Visual question answering (VQA) is an interesting learning setting for evaluating the abilities and shortcomings of current systems for image understanding. Many of the recently proposed VQA systems include attention or memory mechanisms…

计算机视觉与模式识别 · 计算机科学 2016-11-24 Allan Jabri , Armand Joulin , Laurens van der Maaten

Visual Question Answering (VQA) systems are tasked with answering natural language questions corresponding to a presented image. Traditional VQA datasets typically contain questions related to the spatial information of objects, object…

We propose a novel VQA dataset, BloomVQA, to facilitate comprehensive evaluation of large vision-language models on comprehension tasks. Unlike current benchmarks that often focus on fact-based memorization and simple reasoning tasks…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Yunye Gong , Robik Shrestha , Jared Claypoole , Michael Cogswell , Arijit Ray , Christopher Kanan , Ajay Divakaran

This paper proposes to improve visual question answering (VQA) with structured representations of both scene contents and questions. A key challenge in VQA is to require joint reasoning over the visual and text domains. The predominant…

计算机视觉与模式识别 · 计算机科学 2017-03-31 Damien Teney , Lingqiao Liu , Anton van den Hengel

Visual Question Answering (VQA) is a novel problem domain where multi-modal inputs must be processed in order to solve the task given in the form of a natural language. As the solutions inherently require to combine visual and natural…

计算机视觉与模式识别 · 计算机科学 2018-01-31 Mikyas T. Desta , Larry Chen , Tomasz Kornuta

AI systems' ability to explain their reasoning is critical to their utility and trustworthiness. Deep neural networks have enabled significant progress on many challenging problems such as visual question answering (VQA). However, most of…

计算与语言 · 计算机科学 2019-06-05 Jialin Wu , Raymond J. Mooney

There are two main lines of research on visual question answering (VQA): compositional model with explicit multi-hop reasoning, and monolithic network with implicit reasoning in the latent feature space. The former excels in…

计算机视觉与模式识别 · 计算机科学 2020-10-13 Ruixue Tang , Chao Ma

Visual Question Answering (VQA) presents a unique challenge as it requires the ability to understand and encode the multi-modal inputs - in terms of image processing and natural language processing. The algorithm further needs to learn how…

计算机视觉与模式识别 · 计算机科学 2017-09-26 Supriya Pandhre , Shagun Sodhani

Math word problem solver requires both precise relation reasoning about quantities in the text and reliable generation for the diverse equation. Current sequence-to-tree or relation extraction methods regard this only from a fixed view,…

计算与语言 · 计算机科学 2023-08-29 Wenqi Zhang , Yongliang Shen , Yanna Ma , Xiaoxia Cheng , Zeqi Tan , Qingpeng Nong , Weiming Lu

Recent advances in Visual Question Answering (VQA) have demonstrated impressive performance in natural image domains, with models like LLaVA leveraging large language models (LLMs) for open-ended reasoning. However, their generalization…

计算机视觉与模式识别 · 计算机科学 2025-10-31 Xinjin Li , Yulie Lu , Jinghan Cao , Yu Ma , Zhenglin Li , Yeyang Zhou

Visual Question Answering (VQA) is a multi-discipline research task. To produce the right answer, it requires an understanding of the visual content of images, the natural language questions, as well as commonsense reasoning over the…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Yao Zhang , Haokun Chen , Ahmed Frikha , Yezi Yang , Denis Krompass , Gengyuan Zhang , Jindong Gu , Volker Tresp

Visual Question Answering (VQA) is a challenge task that combines natural language processing and computer vision techniques and gradually becomes a benchmark test task in multimodal large language models (MLLMs). The goal of our survey is…

计算与语言 · 计算机科学 2024-11-27 Jiayi Kuang , Jingyou Xie , Haohao Luo , Ronghao Li , Zhe Xu , Xianfeng Cheng , Yinghui Li , Xika Lin , Ying Shen

Visual Question Answering (VQA) has emerged as a pivotal task in the intersection of computer vision and natural language processing, requiring models to understand and reason about visual content in response to natural language questions.…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Aiswarya Baby , Tintu Thankom Koshy

Audio-Visual Question Answering (AVQA) is a challenging multimodal reasoning task requiring intelligent systems to answer natural language queries based on paired audio-video inputs accurately. However, existing AVQA approaches often suffer…

多媒体 · 计算机科学 2025-04-03 Jie Ma , Zhitao Gao , Qi Chai , Jun Liu , Pinghui Wang , Jing Tao , Zhou Su

Visual Question Answering (VQA) has received a lot of attention over the past couple of years. A number of deep learning models have been proposed for this task. However, it has been shown that these models are heavily driven by superficial…

计算机视觉与模式识别 · 计算机科学 2017-04-27 Aishwarya Agrawal , Aniruddha Kembhavi , Dhruv Batra , Devi Parikh

Attention models are widely used in Vision-language (V-L) tasks to perform the visual-textual correlation. Humans perform such a correlation with a strong linguistic understanding of the visual world. However, even the best performing…

计算机视觉与模式识别 · 计算机科学 2021-08-27 Gouthaman KV , Athira Nambiar , Kancheti Sai Srinivas , Anurag Mittal

In this paper, we propose a novel approach for solving the Visual Question Answering (VQA) task in autonomous driving by integrating Vision-Language Models (VLMs) with continual learning. In autonomous driving, VQA plays a vital role in…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Yuxin Lin , Mengshi Qi , Liang Liu , Huadong Ma

Visual reasoning tasks such as visual question answering (VQA) require an interplay of visual perception with reasoning about the question semantics grounded in perception. However, recent advances in this area are still primarily driven by…

机器学习 · 计算机科学 2020-08-27 Saeed Amizadeh , Hamid Palangi , Oleksandr Polozov , Yichen Huang , Kazuhito Koishida