中文
相关论文

相关论文: Structured Triplet Learning with POS-tag Guided At…

200 篇论文

In this paper, we focus on the Audio-Visual Question Answering (AVQA) task, which aims to answer questions regarding different visual objects, sounds, and their associations in videos. The problem requires comprehensive multimodal…

计算机视觉与模式识别 · 计算机科学 2022-04-06 Guangyao Li , Yake Wei , Yapeng Tian , Chenliang Xu , Ji-Rong Wen , Di Hu

Visual Question Answering (VQA) models play a critical role in enhancing the perception capabilities of autonomous driving systems by allowing vehicles to analyze visual inputs alongside textual queries, fostering natural interaction and…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Kaavya Rekanar , Martin Hayes , Ganesh Sistu , Ciaran Eising

This paper presents a new model for the task of scene text visual question answering, in which questions about a given image can only be answered by reading and understanding scene text that is present in it. The proposed model is based on…

计算机视觉与模式识别 · 计算机科学 2020-06-26 Lluís Gómez , Ali Furkan Biten , Rubèn Tito , Andrés Mafla , Marçal Rusiñol , Ernest Valveny , Dimosthenis Karatzas

Methodologies for training visual question answering (VQA) models assume the availability of datasets with human-annotated \textit{Image-Question-Answer} (I-Q-A) triplets. This has led to heavy reliance on datasets and a lack of…

计算机视觉与模式识别 · 计算机科学 2021-05-31 Pratyay Banerjee , Tejas Gokhale , Yezhou Yang , Chitta Baral

Visual Question Answering (VQA) is a challenge task that combines natural language processing and computer vision techniques and gradually becomes a benchmark test task in multimodal large language models (MLLMs). The goal of our survey is…

计算与语言 · 计算机科学 2024-11-27 Jiayi Kuang , Jingyou Xie , Haohao Luo , Ronghao Li , Zhe Xu , Xianfeng Cheng , Yinghui Li , Xika Lin , Ying Shen

Modern Visual Question Answering (VQA) models have been shown to rely heavily on superficial correlations between question and answer words learned during training such as overwhelmingly reporting the type of room as kitchen or the sport…

计算机视觉与模式识别 · 计算机科学 2018-11-12 Sainandan Ramakrishnan , Aishwarya Agrawal , Stefan Lee

Visual question answering (VQA) models respond to open-ended natural language questions about images. While VQA is an increasingly popular area of research, it is unclear to what extent current VQA architectures learn key semantic…

计算机视觉与模式识别 · 计算机科学 2018-07-25 Gabriel Grand , Aron Szanto , Yoon Kim , Alexander Rush

Recently, a number of deep-learning based models have been proposed for the task of Visual Question Answering (VQA). The performance of most models is clustered around 60-70%. In this paper we propose systematic methods to analyze the…

计算与语言 · 计算机科学 2016-10-05 Aishwarya Agrawal , Dhruv Batra , Devi Parikh

We propose the task of free-form and open-ended Visual Question Answering (VQA). Given an image and a natural language question about the image, the task is to provide an accurate natural language answer. Mirroring real-world scenarios,…

计算与语言 · 计算机科学 2016-10-28 Aishwarya Agrawal , Jiasen Lu , Stanislaw Antol , Margaret Mitchell , C. Lawrence Zitnick , Dhruv Batra , Devi Parikh

One of the most intriguing features of the Visual Question Answering (VQA) challenge is the unpredictability of the questions. Extracting the information required to answer them demands a variety of image operations from detection and…

计算机视觉与模式识别 · 计算机科学 2016-12-19 Peng Wang , Qi Wu , Chunhua Shen , Anton van den Hengel

Visual question answering requires a system to provide an accurate natural language answer given an image and a natural language question. However, it is widely recognized that previous generic VQA methods often exhibit a tendency to…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Jie Ma , Pinghui Wang , Dechen Kong , Zewei Wang , Jun Liu , Hongbin Pei , Junzhou Zhao

In this paper, we propose a novel approach for solving the Visual Question Answering (VQA) task in autonomous driving by integrating Vision-Language Models (VLMs) with continual learning. In autonomous driving, VQA plays a vital role in…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Yuxin Lin , Mengshi Qi , Liang Liu , Huadong Ma

Visual question answering (VQA) is known as an AI-complete task as it requires understanding, reasoning, and inferring about the vision and the language content. Over the past few years, numerous neural architectures have been suggested for…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Övgü Özdemir , Erdem Akagündüz

We propose a novel probabilistic model for visual question answering (Visual QA). The key idea is to infer two sets of embeddings: one for the image and the question jointly and the other for the answers. The learning objective is to learn…

计算机视觉与模式识别 · 计算机科学 2018-06-12 Hexiang Hu , Wei-Lun Chao , Fei Sha

Systems that can find correspondences between multiple modalities, such as between speech and images, have great potential to solve different recognition and data analysis tasks in an unsupervised manner. This work studies multimodal…

计算机视觉与模式识别 · 计算机科学 2024-03-08 Khazar Khorrami , Okko Räsänen

Collaborative reasoning for understanding image-question pairs is a very critical but underexplored topic in interpretable visual question answering systems. Although very recent studies have attempted to use explicit compositional…

计算机视觉与模式识别 · 计算机科学 2019-12-30 Qingxing Cao , Bailin Li , Xiaodan Liang , Liang Lin

Visual question answering (VQA) requires joint comprehension of images and natural language questions, where many questions can't be directly or clearly answered from visual content but require reasoning from structured human knowledge with…

计算机视觉与模式识别 · 计算机科学 2018-06-14 Zhou Su , Chen Zhu , Yinpeng Dong , Dongqi Cai , Yurong Chen , Jianguo Li

Long-video multimodal question answering requires structured reasoning over visual evidence and dialogue, but Large Vision-Language Models (LVLMs) are constrained by context-window and compute limits. We propose POVQA, which compresses each…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Ashim Dahal , Ankit Ghimire , Saydul Akbar Murad , Nick Rahimi

Most existing approaches to Visual Question Answering (VQA) answer questions directly, however, people usually decompose a complex question into a sequence of simple sub questions and finally obtain the answer to the original question after…

计算与语言 · 计算机科学 2022-04-05 Ruonan Wang , Yuxi Qian , Fangxiang Feng , Xiaojie Wang , Huixing Jiang

Visual Question Answering (VQA) is a fundamental multimodal task that requires models to jointly understand visual and textual information. Early VQA systems relied heavily on language biases, motivating subsequent work to emphasize visual…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Nguyen Anh Tuong , Phan Ba Duc , Nguyen Trung Quoc , Tran Dac Thinh , Dang Duy Lan , Nguyen Quoc Thinh , Tung Le